2026-02-17T03:58:38.267 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T03:58:38.290 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T03:58:38.367 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50751 branch: wip-bharath18-testing-2026-02-13-0856 description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '50751' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath18-testing-2026-02-13-0856 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 325850157d309f65985eea9ec9bb9f1d56726fee ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 325850157d309f65985eea9ec9bb9f1d56726fee workunit: branch: wip-bharath18-testing-2026-02-13-0856 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 7109 sha1: 325850157d309f65985eea9ec9bb9f1d56726fee sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath18-testing-2026-02-13-0856 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 325850157d309f65985eea9ec9bb9f1d56726fee targets: trial090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLKCzyOxCBJiJrmaqozUIGDPTqIrH7+Auu1bfwPkGhZw/XI5ISv2g0gCBfY32Dq8hg7sJ0FqwOTP7qpx6vst9w= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_03:53:03 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T03:58:38.367 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa; will attempt to use it 2026-02-17T03:58:38.367 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_325850157d309f65985eea9ec9bb9f1d56726fee/qa/tasks 2026-02-17T03:58:38.367 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T03:58:38.369 INFO:teuthology.task.internal:Checking packages... 2026-02-17T03:58:38.369 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '325850157d309f65985eea9ec9bb9f1d56726fee' 2026-02-17T03:58:38.369 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T03:58:38.369 INFO:teuthology.packaging:ref: None 2026-02-17T03:58:38.369 INFO:teuthology.packaging:tag: None 2026-02-17T03:58:38.369 INFO:teuthology.packaging:branch: wip-bharath18-testing-2026-02-13-0856 2026-02-17T03:58:38.369 INFO:teuthology.packaging:sha1: 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T03:58:38.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath18-testing-2026-02-13-0856 2026-02-17T03:58:38.492 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5271.g32585015 2026-02-17T03:58:38.493 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T03:58:38.504 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T03:58:38.504 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T03:58:38.517 INFO:teuthology.task.internal:Saving configuration 2026-02-17T03:58:38.525 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T03:58:38.538 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T03:58:38.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial090.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50751', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 03:55:06.099947', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFLKCzyOxCBJiJrmaqozUIGDPTqIrH7+Auu1bfwPkGhZw/XI5ISv2g0gCBfY32Dq8hg7sJ0FqwOTP7qpx6vst9w='} 2026-02-17T03:58:38.618 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T03:58:38.629 INFO:teuthology.task.internal:roles: ubuntu@trial090.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T03:58:38.629 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T03:58:38.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x6ffc000d3880>, signals=[15]) 2026-02-17T03:58:38.715 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T03:58:38.726 INFO:teuthology.task.internal:Opening connections... 2026-02-17T03:58:38.726 DEBUG:teuthology.task.internal:connecting to ubuntu@trial090.front.sepia.ceph.com 2026-02-17T03:58:38.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T03:58:38.789 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T03:58:38.801 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-17T03:58:38.861 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-17T03:58:38.861 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T03:58:38.917 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T03:58:38.918 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T03:58:38.918 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-17T03:58:39.003 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T03:58:39.015 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T03:58:39.028 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T03:58:39.028 DEBUG:teuthology.orchestra.run.trial090:> test '!' -e /home/ubuntu/cephtest 2026-02-17T03:58:39.042 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T03:58:39.054 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T03:58:39.054 DEBUG:teuthology.orchestra.run.trial090:> test -z $(ls -A /var/lib/ceph) 2026-02-17T03:58:39.099 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T03:58:39.205 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T03:58:39.226 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T03:58:39.226 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T03:58:39.226 DEBUG:teuthology.orchestra.run.trial090:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T03:58:39.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T03:58:39.241 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-17T03:58:39.297 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-645.el9.x86_64 2026-02-17T03:58:39.297 INFO:teuthology.task.kernel:Running kernel on trial090: 5.14.0-645.el9.x86_64 2026-02-17T03:58:39.298 DEBUG:teuthology.orchestra.run.trial090:> sudo yum install -y kernel 2026-02-17T03:58:48.724 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:09 2026-02-17T03:58:52.574 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 27 MB 00:03 2026-02-17T03:58:55.947 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-17T03:58:56.766 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 199 kB/s | 20 kB 00:00 2026-02-17T03:58:57.342 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-17T03:59:00.506 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T03:59:01.528 INFO:teuthology.orchestra.run.trial090.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T03:59:01.548 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T03:59:01.549 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T03:59:01.549 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T03:59:01.550 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout:Install 4 Packages 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 88 M 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 135 M 2026-02-17T03:59:01.551 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T03:59:04.158 INFO:teuthology.orchestra.run.trial090.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 318 kB/s | 803 kB 00:02 2026-02-17T03:59:22.289 INFO:teuthology.orchestra.run.trial090.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 847 kB/s | 17 MB 00:20 2026-02-17T03:59:40.552 INFO:teuthology.orchestra.run.trial090.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 868 kB/s | 31 MB 00:36 2026-02-17T03:59:48.741 INFO:teuthology.orchestra.run.trial090.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 860 kB/s | 40 MB 00:47 2026-02-17T03:59:48.743 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T03:59:48.743 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.9 MB/s | 88 MB 00:47 2026-02-17T03:59:48.934 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T03:59:49.139 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T03:59:49.139 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T03:59:49.485 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T03:59:49.485 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T03:59:50.572 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T03:59:50.856 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T03:59:50.875 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T03:59:52.647 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T03:59:52.677 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T03:59:55.694 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T03:59:55.700 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T03:59:58.802 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:00:29.008 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:00:29.028 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:00:29.091 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:00:29.091 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T04:00:29.091 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T04:00:29.091 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T04:00:29.143 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T04:00:29.143 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:00:29.144 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:00:29.204 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T04:00:29.231 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T04:00:29.233 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T04:00:29.233 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T04:00:29.233 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T04:00:29.233 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T04:00:29.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial090.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T04:00:29.233 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T04:00:29.295 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.296 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T04:00:29.297 DEBUG:teuthology.orchestra.run.trial090:> sudo rpm -qi grub2-tools 2026-02-17T04:00:29.363 INFO:teuthology.orchestra.run.trial090.stdout:Name : grub2-tools 2026-02-17T04:00:29.363 INFO:teuthology.orchestra.run.trial090.stdout:Epoch : 1 2026-02-17T04:00:29.363 INFO:teuthology.orchestra.run.trial090.stdout:Version : 2.06 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Release : 118.el9 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Architecture: x86_64 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Group : Unspecified 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Size : 8393909 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:License : GPLv3+ 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Packager : builder@centos.org 2026-02-17T04:00:29.364 INFO:teuthology.orchestra.run.trial090.stdout:Vendor : CentOS 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:Summary : Support tools for GRUB. 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:Description : 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:hardware devices. 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:00:29.365 INFO:teuthology.orchestra.run.trial090.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T04:00:29.366 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T04:00:29.367 INFO:teuthology.task.kernel:Updating grub on trial090 to boot 5.14.0-681.el9.x86_64 2026-02-17T04:00:29.367 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T04:00:29.429 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T04:00:29.430 DEBUG:teuthology.orchestra.run.trial090:> sudo command -v grubby && echo yes || echo no 2026-02-17T04:00:29.494 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/grubby 2026-02-17T04:00:29.495 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-17T04:00:29.496 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T04:00:29.558 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T04:00:29.559 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.630 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T04:00:29.840 INFO:teuthology.orchestra.run.trial090.stderr:Generating grub configuration file ... 2026-02-17T04:00:29.902 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T04:00:29.908 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T04:00:30.153 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T04:00:30.159 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T04:00:30.191 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T04:00:30.197 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T04:00:30.220 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T04:00:30.227 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T04:00:30.308 INFO:teuthology.orchestra.run.trial090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T04:00:30.316 INFO:teuthology.orchestra.run.trial090.stderr:done 2026-02-17T04:00:30.318 DEBUG:teuthology.orchestra.run.trial090:> test -d /sys/firmware/efi 2026-02-17T04:00:30.335 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T04:00:30.401 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/BOOT 2026-02-17T04:00:30.402 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/centos 2026-02-17T04:00:30.403 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T04:00:30.468 INFO:teuthology.orchestra.run.trial090.stdout:no 2026-02-17T04:00:30.469 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T04:00:30.532 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-17T04:00:30.532 DEBUG:teuthology.orchestra.run.trial090:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T04:00:30.596 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial090 2026-02-17T04:00:30.596 DEBUG:teuthology.orchestra.run.trial090:> sudo bash -c ' 2026-02-17T04:00:30.597 DEBUG:teuthology.orchestra.run.trial090:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T04:00:30.597 DEBUG:teuthology.orchestra.run.trial090:> ' 2026-02-17T04:01:00.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T04:01:00.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T04:01:00.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:01:14.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-17T04:01:23.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T04:01:23.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:01:59.802 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-17T04:01:59.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T04:01:59.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T04:01:59.955 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-17T04:02:00.011 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-681.el9.x86_64 2026-02-17T04:02:00.011 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T04:02:00.011 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T04:02:00.011 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T04:02:01.012 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T04:02:01.012 DEBUG:teuthology.orchestra.run.trial090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T04:02:01.042 INFO:teuthology.orchestra.run.trial090.stdout:ttyS1 2026-02-17T04:02:01.067 DEBUG:teuthology.parallel:result is None 2026-02-17T04:02:01.068 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T04:02:01.085 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T04:02:01.085 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T04:02:01.123 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T04:02:01.134 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T04:02:01.148 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T04:02:01.149 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T04:02:01.181 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T04:02:01.192 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T04:02:01.192 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T04:02:01.243 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:02:01.252 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:02:01.253 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T04:02:01.266 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T04:02:01.266 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T04:02:01.317 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T04:02:01.330 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T04:02:01.330 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T04:02:01.372 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T04:02:01.518 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T04:02:01.542 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T04:02:01.678 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T04:02:01.703 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:02:01.703 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T04:02:01.767 DEBUG:teuthology.orchestra.run.trial090:> sudo service rsyslog restart 2026-02-17T04:02:01.834 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T04:02:02.235 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T04:02:02.255 INFO:teuthology.task.internal:Starting timer... 2026-02-17T04:02:02.255 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T04:02:02.274 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T04:02:02.293 DEBUG:teuthology.orchestra.run.trial090:> sudo service auditd rotate 2026-02-17T04:02:02.323 INFO:teuthology.orchestra.run.trial090.stdout:Rotating logs: 2026-02-17T04:02:02.325 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T04:02:02.325 DEBUG:teuthology.orchestra.run.trial090:> /usr/sbin/getenforce 2026-02-17T04:02:02.382 INFO:teuthology.orchestra.run.trial090.stdout:Permissive 2026-02-17T04:02:02.382 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial090.front.sepia.ceph.com': 'permissive'} 2026-02-17T04:02:02.383 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T04:02:02.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:02:02.447 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T04:02:02.448 DEBUG:teuthology.orchestra.run.trial090:> sudo /usr/sbin/setenforce permissive 2026-02-17T04:02:02.512 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T04:02:02.525 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T04:02:02.527 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T04:02:02.650 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T04:02:02.658 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T04:02:02.659 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T04:04:34.384 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial090.front.sepia.ceph.com')] 2026-02-17T04:04:34.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T04:04:34.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T04:04:34.457 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-17T04:04:34.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T04:04:34.530 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T04:04:34.543 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T04:04:34.544 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T04:04:34.544 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T04:04:34.597 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T04:04:34.609 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T04:04:34.629 INFO:teuthology.orchestra.run.trial090.stderr:sudo: ntpd: command not found 2026-02-17T04:04:34.639 INFO:teuthology.orchestra.run.trial090.stdout:506 Cannot talk to daemon 2026-02-17T04:04:34.650 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T04:04:34.661 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T04:04:34.705 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-17T04:04:34.707 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T04:04:34.707 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-17T04:04:34.708 INFO:teuthology.orchestra.run.trial090.stdout:^? 167-248-62-201.oa02.lnk0> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:04:34.708 INFO:teuthology.orchestra.run.trial090.stdout:^? 172-233-155-39.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:04:34.708 INFO:teuthology.orchestra.run.trial090.stdout:^? ntp6.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:04:34.708 INFO:teuthology.orchestra.run.trial090.stdout:^? vps5.drown.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T04:04:34.708 INFO:teuthology.run_tasks:Running task install... 2026-02-17T04:04:34.720 DEBUG:teuthology.task.install:project ceph 2026-02-17T04:04:34.720 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'}} 2026-02-17T04:04:34.720 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee'} 2026-02-17T04:04:34.720 INFO:teuthology.task.install:Using flavor: default 2026-02-17T04:04:34.723 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T04:04:34.723 INFO:teuthology.task.install:extra packages: [] 2026-02-17T04:04:34.723 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '325850157d309f65985eea9ec9bb9f1d56726fee', 'tag': None, 'wait_for_package': False} 2026-02-17T04:04:34.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:04:34.846 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/ 2026-02-17T04:04:34.846 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5271.g32585015 2026-02-17T04:04:34.974 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath18-testing-2026-02-13-0856/325850157d309f65985eea9ec9bb9f1d56726fee/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T04:04:34.974 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:04:34.974 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T04:04:34.999 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T04:04:34.999 DEBUG:teuthology.orchestra.run.trial090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/325850157d309f65985eea9ec9bb9f1d56726fee/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T04:04:35.063 DEBUG:teuthology.orchestra.run.trial090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T04:04:35.134 DEBUG:teuthology.orchestra.run.trial090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T04:04:35.198 INFO:teuthology.orchestra.run.trial090.stdout:check_obsoletes = 1 2026-02-17T04:04:35.199 DEBUG:teuthology.orchestra.run.trial090:> sudo yum clean all 2026-02-17T04:04:35.349 INFO:teuthology.orchestra.run.trial090.stdout:41 files removed 2026-02-17T04:04:35.364 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-radosgw 2026-02-17T04:04:36.059 INFO:teuthology.orchestra.run.trial090.stdout:ceph packages for x86_64 171 kB/s | 93 kB 00:00 2026-02-17T04:04:36.352 INFO:teuthology.orchestra.run.trial090.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2026-02-17T04:04:36.499 INFO:teuthology.orchestra.run.trial090.stdout:ceph source packages 16 kB/s | 2.1 kB 00:00 2026-02-17T04:04:37.178 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T04:04:40.719 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 27 MB 00:03 2026-02-17T04:04:44.138 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-17T04:04:44.977 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 177 kB/s | 20 kB 00:00 2026-02-17T04:04:45.259 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 94 MB/s | 20 MB 00:00 2026-02-17T04:04:48.437 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T04:04:49.664 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 13 M 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout: librados2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 3.5 M 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout: librbd1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.8 M 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T04:04:49.666 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.2 M 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 24 M 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 909 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1 x86_64 2:20.3.0-5271.g32585015.el9 ceph 248 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: librgw2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 M 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse x86_64 2:20.3.0-5271.g32585015.el9 ceph 45 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common x86_64 2:20.3.0-5271.g32585015.el9 ceph 185 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs x86_64 2:20.3.0-5271.g32585015.el9 ceph 204 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados x86_64 2:20.3.0-5271.g32585015.el9 ceph 324 k 2026-02-17T04:04:49.667 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 306 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw x86_64 2:20.3.0-5271.g32585015.el9 ceph 100 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5271.g32585015.el9 ceph 25 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Install 35 Packages 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 2 Packages 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 68 M 2026-02-17T04:04:49.668 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:04:50.243 INFO:teuthology.orchestra.run.trial090.stdout:(1/37): ceph-base-20.3.0-5271.g32585015.el9.x86 16 MB/s | 5.2 MB 00:00 2026-02-17T04:04:50.277 INFO:teuthology.orchestra.run.trial090.stdout:(2/37): ceph-selinux-20.3.0-5271.g32585015.el9. 746 kB/s | 25 kB 00:00 2026-02-17T04:04:50.315 INFO:teuthology.orchestra.run.trial090.stdout:(3/37): libcephfs-daemon-20.3.0-5271.g32585015. 958 kB/s | 37 kB 00:00 2026-02-17T04:04:50.354 INFO:teuthology.orchestra.run.trial090.stdout:(4/37): libcephfs-proxy2-20.3.0-5271.g32585015. 631 kB/s | 25 kB 00:00 2026-02-17T04:04:50.415 INFO:teuthology.orchestra.run.trial090.stdout:(5/37): libcephfs2-20.3.0-5271.g32585015.el9.x8 15 MB/s | 909 kB 00:00 2026-02-17T04:04:50.463 INFO:teuthology.orchestra.run.trial090.stdout:(6/37): libradosstriper1-20.3.0-5271.g32585015. 5.0 MB/s | 248 kB 00:00 2026-02-17T04:04:50.781 INFO:teuthology.orchestra.run.trial090.stdout:(7/37): librgw2-20.3.0-5271.g32585015.el9.x86_6 20 MB/s | 6.5 MB 00:00 2026-02-17T04:04:50.803 INFO:teuthology.orchestra.run.trial090.stdout:(8/37): ceph-radosgw-20.3.0-5271.g32585015.el9. 15 MB/s | 13 MB 00:00 2026-02-17T04:04:50.804 INFO:teuthology.orchestra.run.trial090.stdout:(9/37): python3-ceph-argparse-20.3.0-5271.g3258 1.9 MB/s | 45 kB 00:00 2026-02-17T04:04:50.822 INFO:teuthology.orchestra.run.trial090.stdout:(10/37): python3-ceph-common-20.3.0-5271.g32585 9.6 MB/s | 185 kB 00:00 2026-02-17T04:04:50.830 INFO:teuthology.orchestra.run.trial090.stdout:(11/37): python3-cephfs-20.3.0-5271.g32585015.e 7.6 MB/s | 204 kB 00:00 2026-02-17T04:04:50.851 INFO:teuthology.orchestra.run.trial090.stdout:(12/37): python3-rados-20.3.0-5271.g32585015.el 11 MB/s | 324 kB 00:00 2026-02-17T04:04:50.861 INFO:teuthology.orchestra.run.trial090.stdout:(13/37): python3-rbd-20.3.0-5271.g32585015.el9. 9.7 MB/s | 306 kB 00:00 2026-02-17T04:04:50.877 INFO:teuthology.orchestra.run.trial090.stdout:(14/37): python3-rgw-20.3.0-5271.g32585015.el9. 3.7 MB/s | 100 kB 00:00 2026-02-17T04:04:50.911 INFO:teuthology.orchestra.run.trial090.stdout:(15/37): ceph-common-20.3.0-5271.g32585015.el9. 24 MB/s | 24 MB 00:00 2026-02-17T04:04:51.449 INFO:teuthology.orchestra.run.trial090.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 56 kB/s | 33 kB 00:00 2026-02-17T04:04:51.472 INFO:teuthology.orchestra.run.trial090.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 4.6 MB/s | 104 kB 00:00 2026-02-17T04:04:51.481 INFO:teuthology.orchestra.run.trial090.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-17T04:04:51.488 INFO:teuthology.orchestra.run.trial090.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 23 MB/s | 160 kB 00:00 2026-02-17T04:04:51.492 INFO:teuthology.orchestra.run.trial090.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-17T04:04:51.503 INFO:teuthology.orchestra.run.trial090.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 63 MB/s | 662 kB 00:00 2026-02-17T04:04:51.509 INFO:teuthology.orchestra.run.trial090.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 46 MB/s | 292 kB 00:00 2026-02-17T04:04:51.515 INFO:teuthology.orchestra.run.trial090.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 40 MB/s | 240 kB 00:00 2026-02-17T04:04:51.519 INFO:teuthology.orchestra.run.trial090.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 8.5 MB/s | 37 kB 00:00 2026-02-17T04:04:51.524 INFO:teuthology.orchestra.run.trial090.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-17T04:04:51.652 INFO:teuthology.orchestra.run.trial090.stdout:(26/37): pciutils-3.7.0-7.el9.x86_64.rpm 126 kB/s | 93 kB 00:00 2026-02-17T04:04:51.965 INFO:teuthology.orchestra.run.trial090.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 697 kB/s | 308 kB 00:00 2026-02-17T04:04:52.174 INFO:teuthology.orchestra.run.trial090.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 119 kB/s | 25 kB 00:00 2026-02-17T04:04:52.369 INFO:teuthology.orchestra.run.trial090.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2026-02-17T04:04:52.464 INFO:teuthology.orchestra.run.trial090.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 168 kB/s | 49 kB 00:00 2026-02-17T04:04:52.658 INFO:teuthology.orchestra.run.trial090.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 233 kB/s | 67 kB 00:00 2026-02-17T04:04:52.762 INFO:teuthology.orchestra.run.trial090.stdout:(32/37): nvme-cli-2.13-1.el9.x86_64.rpm 596 kB/s | 1.1 MB 00:01 2026-02-17T04:04:52.966 INFO:teuthology.orchestra.run.trial090.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2026-02-17T04:04:53.009 INFO:teuthology.orchestra.run.trial090.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 545 kB/s | 191 kB 00:00 2026-02-17T04:04:53.097 INFO:teuthology.orchestra.run.trial090.stdout:(35/37): librados2-20.3.0-5271.g32585015.el9.x8 27 MB/s | 3.5 MB 00:00 2026-02-17T04:04:53.138 INFO:teuthology.orchestra.run.trial090.stdout:(36/37): librbd1-20.3.0-5271.g32585015.el9.x86_ 22 MB/s | 2.8 MB 00:00 2026-02-17T04:04:53.318 INFO:teuthology.orchestra.run.trial090.stdout:(37/37): thrift-0.15.0-4.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2026-02-17T04:04:53.323 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:04:53.323 INFO:teuthology.orchestra.run.trial090.stdout:Total 19 MB/s | 68 MB 00:03 2026-02-17T04:04:53.421 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:04:53.440 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:04:53.441 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:04:53.695 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:04:53.695 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:04:54.004 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:04:54.157 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T04:04:54.161 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:04:54.213 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:04:54.214 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:04:54.227 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:04:54.230 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 4/39 2026-02-17T04:04:54.230 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:04:54.259 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:04:54.262 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 6/39 2026-02-17T04:04:54.270 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T04:04:54.274 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T04:04:54.277 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T04:04:54.282 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T04:04:54.293 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 11/39 2026-02-17T04:04:54.304 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T04:04:54.305 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T04:04:54.331 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 13/39 2026-02-17T04:04:54.336 INFO:teuthology.orchestra.run.trial090.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T04:04:54.369 INFO:teuthology.orchestra.run.trial090.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T04:04:54.374 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T04:04:54.381 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T04:04:54.383 INFO:teuthology.orchestra.run.trial090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T04:04:54.387 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T04:04:54.508 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T04:04:54.509 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T04:04:54.536 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 21/39 2026-02-17T04:04:54.538 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 22/39 2026-02-17T04:04:54.544 INFO:teuthology.orchestra.run.trial090.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T04:04:54.826 INFO:teuthology.orchestra.run.trial090.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T04:04:54.827 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T04:04:54.843 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 25/39 2026-02-17T04:04:54.846 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 26/39 2026-02-17T04:04:54.851 INFO:teuthology.orchestra.run.trial090.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T04:04:54.853 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T04:04:54.854 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T04:04:54.873 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T04:04:54.985 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T04:04:54.988 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T04:04:55.271 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T04:04:55.271 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T04:04:55.271 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:04:55.317 INFO:teuthology.orchestra.run.trial090.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T04:04:55.319 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 33/39 2026-02-17T04:04:56.413 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:04:56.415 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:04:56.679 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 34/39 2026-02-17T04:04:56.683 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T04:04:56.724 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 35/39 2026-02-17T04:04:56.725 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T04:04:56.725 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T04:04:56.725 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:04:56.728 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:05:01.214 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:05:01.214 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /sys 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /proc 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /mnt 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /var/tmp 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /home 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /root 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /tmp 2026-02-17T04:05:01.215 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:01.793 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 37/39 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T04:05:01.817 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:01.819 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T04:05:01.833 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T04:05:01.833 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:05:01.889 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:05:01.889 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'qat' with GID 992. 2026-02-17T04:05:01.890 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 1/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 3/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 4/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_6 5/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_6 6/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 7/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_6 8/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librgw2-2:20.3.0-5271.g32585015.el9.x86_64 9/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5271.g32585015.el9. 10/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-common-2:20.3.0-5271.g32585015.el9.x8 11/39 2026-02-17T04:05:02.184 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 12/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 13/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 14/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 15/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:20.3.0-5271.g32585015.el9.x86_64 36/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T04:05:02.185 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:20.3.0-5271.g32585015.el9.x86_64 38/39 2026-02-17T04:05:02.248 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T04:05:02.248 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: librados2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: librbd1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: librgw2-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T04:05:02.249 INFO:teuthology.orchestra.run.trial090.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T04:05:02.250 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:02.250 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:02.293 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-test 2026-02-17T04:05:02.606 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test x86_64 2:20.3.0-5271.g32585015.el9 ceph 78 M 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite x86_64 2:20.3.0-5271.g32585015.el9 ceph 159 k 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T04:05:02.690 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:Install 10 Packages 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 82 M 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 339 M 2026-02-17T04:05:02.691 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:03.042 INFO:teuthology.orchestra.run.trial090.stdout:(1/10): libcephsqlite-20.3.0-5271.g32585015.el9 1.8 MB/s | 159 kB 00:00 2026-02-17T04:05:03.079 INFO:teuthology.orchestra.run.trial090.stdout:(2/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 17 MB/s | 2.1 MB 00:00 2026-02-17T04:05:03.094 INFO:teuthology.orchestra.run.trial090.stdout:(3/10): libatomic-11.5.0-14.el9.x86_64.rpm 441 kB/s | 23 kB 00:00 2026-02-17T04:05:03.124 INFO:teuthology.orchestra.run.trial090.stdout:(4/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.0 MB/s | 94 kB 00:00 2026-02-17T04:05:03.870 INFO:teuthology.orchestra.run.trial090.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2026-02-17T04:05:03.871 INFO:teuthology.orchestra.run.trial090.stdout:(6/10): libxslt-1.1.34-12.el9.x86_64.rpm 300 kB/s | 233 kB 00:00 2026-02-17T04:05:04.122 INFO:teuthology.orchestra.run.trial090.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 253 kB/s | 64 kB 00:00 2026-02-17T04:05:04.150 INFO:teuthology.orchestra.run.trial090.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.2 MB/s | 122 kB 00:00 2026-02-17T04:05:04.300 INFO:teuthology.orchestra.run.trial090.stdout:(9/10): socat-1.7.4.1-8.el9.x86_64.rpm 706 kB/s | 303 kB 00:00 2026-02-17T04:05:04.508 INFO:teuthology.orchestra.run.trial090.stdout:(10/10): ceph-test-20.3.0-5271.g32585015.el9.x8 50 MB/s | 78 MB 00:01 2026-02-17T04:05:04.509 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:04.510 INFO:teuthology.orchestra.run.trial090.stdout:Total 45 MB/s | 82 MB 00:01 2026-02-17T04:05:04.572 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:04.584 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:04.584 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:04.872 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:04.872 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:05.182 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:05.191 INFO:teuthology.orchestra.run.trial090.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-17T04:05:05.200 INFO:teuthology.orchestra.run.trial090.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-17T04:05:05.205 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-17T04:05:05.209 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-17T04:05:05.215 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-17T04:05:05.216 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-17T04:05:05.226 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-17T04:05:05.234 INFO:teuthology.orchestra.run.trial090.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-17T04:05:05.235 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T04:05:08.667 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 9/10 2026-02-17T04:05:08.686 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 10/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 1/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-17T04:05:09.005 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-17T04:05:09.006 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-17T04:05:09.006 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-17T04:05:09.006 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-17T04:05:09.006 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:09.061 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:09.102 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph 2026-02-17T04:05:09.420 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:09.507 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph x86_64 2:20.3.0-5271.g32585015.el9 ceph 6.5 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 57 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.4 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr x86_64 2:20.3.0-5271.g32585015.el9 ceph 936 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 297 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon x86_64 2:20.3.0-5271.g32585015.el9 ceph 5.0 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd x86_64 2:20.3.0-5271.g32585015.el9 ceph 167 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic x86_64 2:20.3.0-5271.g32585015.el9 ceph 16 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson x86_64 2:20.3.0-5271.g32585015.el9 ceph 19 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 17 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 1.0 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T04:05:09.510 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T04:05:09.511 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 184 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 51 M 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 7.4 M 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 22 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 50 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume noarch 2:20.3.0-5271.g32585015.el9 ceph-noarch 299 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-17T04:05:09.512 INFO:teuthology.orchestra.run.trial090.stdout:Install 96 Packages 2026-02-17T04:05:09.513 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:09.513 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 158 M 2026-02-17T04:05:09.513 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 732 M 2026-02-17T04:05:09.513 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:10.119 INFO:teuthology.orchestra.run.trial090.stdout:(1/96): ceph-20.3.0-5271.g32585015.el9.x86_64.r 120 kB/s | 6.5 kB 00:00 2026-02-17T04:05:10.184 INFO:teuthology.orchestra.run.trial090.stdout:(2/96): ceph-mgr-20.3.0-5271.g32585015.el9.x86_ 7.7 MB/s | 936 kB 00:00 2026-02-17T04:05:10.196 INFO:teuthology.orchestra.run.trial090.stdout:(3/96): ceph-osd-20.3.0-5271.g32585015.el9.x86_ 14 MB/s | 167 kB 00:00 2026-02-17T04:05:10.252 INFO:teuthology.orchestra.run.trial090.stdout:(4/96): ceph-mds-20.3.0-5271.g32585015.el9.x86_ 13 MB/s | 2.4 MB 00:00 2026-02-17T04:05:10.482 INFO:teuthology.orchestra.run.trial090.stdout:(5/96): ceph-mon-20.3.0-5271.g32585015.el9.x86_ 14 MB/s | 5.0 MB 00:00 2026-02-17T04:05:10.534 INFO:teuthology.orchestra.run.trial090.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5271.g32 1.1 MB/s | 57 kB 00:00 2026-02-17T04:05:10.595 INFO:teuthology.orchestra.run.trial090.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5271.g32585015. 2.9 MB/s | 184 kB 00:00 2026-02-17T04:05:10.951 INFO:teuthology.orchestra.run.trial090.stdout:(8/96): ceph-osd-crimson-20.3.0-5271.g32585015. 27 MB/s | 19 MB 00:00 2026-02-17T04:05:11.018 INFO:teuthology.orchestra.run.trial090.stdout:(9/96): ceph-osd-classic-20.3.0-5271.g32585015. 19 MB/s | 16 MB 00:00 2026-02-17T04:05:11.072 INFO:teuthology.orchestra.run.trial090.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5271.g325850 409 kB/s | 22 kB 00:00 2026-02-17T04:05:11.143 INFO:teuthology.orchestra.run.trial090.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5271.g325 4.1 MB/s | 297 kB 00:00 2026-02-17T04:05:11.210 INFO:teuthology.orchestra.run.trial090.stdout:(12/96): ceph-mgr-rook-20.3.0-5271.g32585015.el 759 kB/s | 50 kB 00:00 2026-02-17T04:05:11.257 INFO:teuthology.orchestra.run.trial090.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5271.g32 371 kB/s | 17 kB 00:00 2026-02-17T04:05:11.267 INFO:teuthology.orchestra.run.trial090.stdout:(14/96): ceph-mgr-diskprediction-local-20.3.0-5 23 MB/s | 7.4 MB 00:00 2026-02-17T04:05:11.271 INFO:teuthology.orchestra.run.trial090.stdout:(15/96): ceph-volume-20.3.0-5271.g32585015.el9. 20 MB/s | 299 kB 00:00 2026-02-17T04:05:11.298 INFO:teuthology.orchestra.run.trial090.stdout:(16/96): cephadm-20.3.0-5271.g32585015.el9.noar 33 MB/s | 1.0 MB 00:00 2026-02-17T04:05:11.876 INFO:teuthology.orchestra.run.trial090.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-17T04:05:12.098 INFO:teuthology.orchestra.run.trial090.stdout:(18/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 424 kB/s | 350 kB 00:00 2026-02-17T04:05:12.120 INFO:teuthology.orchestra.run.trial090.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 295 kB/s | 72 kB 00:00 2026-02-17T04:05:12.292 INFO:teuthology.orchestra.run.trial090.stdout:(20/96): ceph-mgr-dashboard-20.3.0-5271.g325850 30 MB/s | 51 MB 00:01 2026-02-17T04:05:12.346 INFO:teuthology.orchestra.run.trial090.stdout:(21/96): libgfortran-11.5.0-14.el9.x86_64.rpm 3.1 MB/s | 794 kB 00:00 2026-02-17T04:05:12.368 INFO:teuthology.orchestra.run.trial090.stdout:(22/96): libquadmath-11.5.0-14.el9.x86_64.rpm 746 kB/s | 184 kB 00:00 2026-02-17T04:05:12.457 INFO:teuthology.orchestra.run.trial090.stdout:(23/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-17T04:05:12.616 INFO:teuthology.orchestra.run.trial090.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 428 kB/s | 106 kB 00:00 2026-02-17T04:05:12.677 INFO:teuthology.orchestra.run.trial090.stdout:(25/96): python3-cryptography-36.0.1-5.el9.x86_ 3.8 MB/s | 1.2 MB 00:00 2026-02-17T04:05:12.785 INFO:teuthology.orchestra.run.trial090.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 894 kB/s | 150 kB 00:00 2026-02-17T04:05:12.842 INFO:teuthology.orchestra.run.trial090.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 766 kB/s | 126 kB 00:00 2026-02-17T04:05:12.950 INFO:teuthology.orchestra.run.trial090.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 1.3 MB/s | 218 kB 00:00 2026-02-17T04:05:13.008 INFO:teuthology.orchestra.run.trial090.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-17T04:05:13.049 INFO:teuthology.orchestra.run.trial090.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 730 kB/s | 30 kB 00:00 2026-02-17T04:05:13.117 INFO:teuthology.orchestra.run.trial090.stdout:(31/96): python3-pycparser-2.20-6.el9.noarch.rp 205 kB/s | 135 kB 00:00 2026-02-17T04:05:13.121 INFO:teuthology.orchestra.run.trial090.stdout:(32/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 42 MB/s | 3.0 MB 00:00 2026-02-17T04:05:13.122 INFO:teuthology.orchestra.run.trial090.stdout:(33/96): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-02-17T04:05:13.134 INFO:teuthology.orchestra.run.trial090.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 18 MB/s | 246 kB 00:00 2026-02-17T04:05:13.141 INFO:teuthology.orchestra.run.trial090.stdout:(35/96): flexiblas-openblas-openmp-3.0.4-9.el9. 621 kB/s | 15 kB 00:00 2026-02-17T04:05:13.144 INFO:teuthology.orchestra.run.trial090.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T04:05:13.164 INFO:teuthology.orchestra.run.trial090.stdout:(37/96): lua-5.4.4-4.el9.x86_64.rpm 4.3 MB/s | 188 kB 00:00 2026-02-17T04:05:13.185 INFO:teuthology.orchestra.run.trial090.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 11 MB/s | 244 kB 00:00 2026-02-17T04:05:13.197 INFO:teuthology.orchestra.run.trial090.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-17T04:05:13.206 INFO:teuthology.orchestra.run.trial090.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 5.0 MB/s | 48 kB 00:00 2026-02-17T04:05:13.221 INFO:teuthology.orchestra.run.trial090.stdout:(41/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 67 MB/s | 5.3 MB 00:00 2026-02-17T04:05:13.222 INFO:teuthology.orchestra.run.trial090.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 11 MB/s | 177 kB 00:00 2026-02-17T04:05:13.231 INFO:teuthology.orchestra.run.trial090.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.8 MB/s | 35 kB 00:00 2026-02-17T04:05:13.243 INFO:teuthology.orchestra.run.trial090.stdout:(44/96): python3-babel-2.9.1-2.el9.noarch.rpm 60 MB/s | 6.0 MB 00:00 2026-02-17T04:05:13.253 INFO:teuthology.orchestra.run.trial090.stdout:(45/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 38 MB/s | 1.2 MB 00:00 2026-02-17T04:05:13.257 INFO:teuthology.orchestra.run.trial090.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 30 MB/s | 442 kB 00:00 2026-02-17T04:05:13.265 INFO:teuthology.orchestra.run.trial090.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 6.5 MB/s | 77 kB 00:00 2026-02-17T04:05:13.270 INFO:teuthology.orchestra.run.trial090.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 22 MB/s | 267 kB 00:00 2026-02-17T04:05:13.279 INFO:teuthology.orchestra.run.trial090.stdout:(49/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 128 MB/s | 6.1 MB 00:00 2026-02-17T04:05:13.279 INFO:teuthology.orchestra.run.trial090.stdout:(50/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 11 MB/s | 159 kB 00:00 2026-02-17T04:05:13.282 INFO:teuthology.orchestra.run.trial090.stdout:(51/96): python3-pyasn1-modules-0.4.8-6.el9.noa 21 MB/s | 279 kB 00:00 2026-02-17T04:05:13.288 INFO:teuthology.orchestra.run.trial090.stdout:(52/96): python3-requests-oauthlib-1.3.0-12.el9 5.7 MB/s | 54 kB 00:00 2026-02-17T04:05:13.295 INFO:teuthology.orchestra.run.trial090.stdout:(53/96): python3-toml-0.10.2-6.el9.noarch.rpm 3.4 MB/s | 42 kB 00:00 2026-02-17T04:05:13.297 INFO:teuthology.orchestra.run.trial090.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 19 MB/s | 189 kB 00:00 2026-02-17T04:05:13.306 INFO:teuthology.orchestra.run.trial090.stdout:(55/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 7.5 MB/s | 90 kB 00:00 2026-02-17T04:05:13.396 INFO:teuthology.orchestra.run.trial090.stdout:(56/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 166 MB/s | 19 MB 00:00 2026-02-17T04:05:13.396 INFO:teuthology.orchestra.run.trial090.stdout:(57/96): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2026-02-17T04:05:13.494 INFO:teuthology.orchestra.run.trial090.stdout:(58/96): protobuf-compiler-3.14.0-17.el9.x86_64 4.5 MB/s | 862 kB 00:00 2026-02-17T04:05:13.808 INFO:teuthology.orchestra.run.trial090.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 47 kB/s | 19 kB 00:00 2026-02-17T04:05:14.073 INFO:teuthology.orchestra.run.trial090.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 261 kB/s | 151 kB 00:00 2026-02-17T04:05:14.140 INFO:teuthology.orchestra.run.trial090.stdout:(61/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 741 kB/s | 551 kB 00:00 2026-02-17T04:05:14.156 INFO:teuthology.orchestra.run.trial090.stdout:(62/96): python3-autocommand-2.2.2-8.el9.noarch 356 kB/s | 29 kB 00:00 2026-02-17T04:05:14.214 INFO:teuthology.orchestra.run.trial090.stdout:(63/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.3 MB/s | 548 kB 00:00 2026-02-17T04:05:14.223 INFO:teuthology.orchestra.run.trial090.stdout:(64/96): python3-backports-tarfile-1.2.0-1.el9. 727 kB/s | 60 kB 00:00 2026-02-17T04:05:14.239 INFO:teuthology.orchestra.run.trial090.stdout:(65/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 526 kB/s | 43 kB 00:00 2026-02-17T04:05:14.295 INFO:teuthology.orchestra.run.trial090.stdout:(66/96): python3-cachetools-4.2.4-1.el9.noarch. 395 kB/s | 32 kB 00:00 2026-02-17T04:05:14.305 INFO:teuthology.orchestra.run.trial090.stdout:(67/96): python3-certifi-2023.05.07-4.el9.noarc 172 kB/s | 14 kB 00:00 2026-02-17T04:05:14.555 INFO:teuthology.orchestra.run.trial090.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 1.0 MB/s | 254 kB 00:00 2026-02-17T04:05:14.637 INFO:teuthology.orchestra.run.trial090.stdout:(69/96): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2026-02-17T04:05:14.726 INFO:teuthology.orchestra.run.trial090.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 1.6 MB/s | 144 kB 00:00 2026-02-17T04:05:14.811 INFO:teuthology.orchestra.run.trial090.stdout:(71/96): python3-cheroot-10.0.1-4.el9.noarch.rp 303 kB/s | 173 kB 00:00 2026-02-17T04:05:14.829 INFO:teuthology.orchestra.run.trial090.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.3 MB/s | 139 kB 00:00 2026-02-17T04:05:14.836 INFO:teuthology.orchestra.run.trial090.stdout:(73/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.2 MB/s | 2.0 MB 00:00 2026-02-17T04:05:14.896 INFO:teuthology.orchestra.run.trial090.stdout:(74/96): python3-isodate-0.6.1-3.el9.noarch.rpm 660 kB/s | 56 kB 00:00 2026-02-17T04:05:14.911 INFO:teuthology.orchestra.run.trial090.stdout:(75/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 131 kB/s | 11 kB 00:00 2026-02-17T04:05:14.918 INFO:teuthology.orchestra.run.trial090.stdout:(76/96): python3-jaraco-classes-3.2.1-5.el9.noa 215 kB/s | 18 kB 00:00 2026-02-17T04:05:14.992 INFO:teuthology.orchestra.run.trial090.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 241 kB/s | 20 kB 00:00 2026-02-17T04:05:15.001 INFO:teuthology.orchestra.run.trial090.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 236 kB/s | 19 kB 00:00 2026-02-17T04:05:15.012 INFO:teuthology.orchestra.run.trial090.stdout:(79/96): python3-jaraco-collections-3.0.0-8.el9 199 kB/s | 23 kB 00:00 2026-02-17T04:05:15.074 INFO:teuthology.orchestra.run.trial090.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 323 kB/s | 26 kB 00:00 2026-02-17T04:05:15.179 INFO:teuthology.orchestra.run.trial090.stdout:(81/96): python3-more-itertools-8.12.0-2.el9.no 474 kB/s | 79 kB 00:00 2026-02-17T04:05:15.206 INFO:teuthology.orchestra.run.trial090.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 653 kB/s | 86 kB 00:00 2026-02-17T04:05:15.262 INFO:teuthology.orchestra.run.trial090.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 692 kB/s | 58 kB 00:00 2026-02-17T04:05:15.288 INFO:teuthology.orchestra.run.trial090.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 201 kB/s | 16 kB 00:00 2026-02-17T04:05:15.354 INFO:teuthology.orchestra.run.trial090.stdout:(85/96): python3-kubernetes-26.1.0-3.el9.noarch 2.9 MB/s | 1.0 MB 00:00 2026-02-17T04:05:15.370 INFO:teuthology.orchestra.run.trial090.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 374 kB/s | 31 kB 00:00 2026-02-17T04:05:15.454 INFO:teuthology.orchestra.run.trial090.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 710 kB/s | 59 kB 00:00 2026-02-17T04:05:15.499 INFO:teuthology.orchestra.run.trial090.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 1.3 MB/s | 188 kB 00:00 2026-02-17T04:05:15.500 INFO:teuthology.orchestra.run.trial090.stdout:(89/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 379 kB/s | 90 kB 00:00 2026-02-17T04:05:15.584 INFO:teuthology.orchestra.run.trial090.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 425 kB/s | 36 kB 00:00 2026-02-17T04:05:15.646 INFO:teuthology.orchestra.run.trial090.stdout:(91/96): python3-saml-1.16.0-1.el9.noarch.rpm 650 kB/s | 125 kB 00:00 2026-02-17T04:05:15.667 INFO:teuthology.orchestra.run.trial090.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 1.1 MB/s | 90 kB 00:00 2026-02-17T04:05:15.728 INFO:teuthology.orchestra.run.trial090.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 590 kB/s | 48 kB 00:00 2026-02-17T04:05:15.749 INFO:teuthology.orchestra.run.trial090.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 269 kB/s | 22 kB 00:00 2026-02-17T04:05:15.763 INFO:teuthology.orchestra.run.trial090.stdout:(95/96): python3-typing-extensions-4.15.0-1.el9 329 kB/s | 86 kB 00:00 2026-02-17T04:05:15.810 INFO:teuthology.orchestra.run.trial090.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 243 kB/s | 20 kB 00:00 2026-02-17T04:05:15.817 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:15.817 INFO:teuthology.orchestra.run.trial090.stdout:Total 25 MB/s | 158 MB 00:06 2026-02-17T04:05:16.241 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:16.279 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:16.279 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:16.879 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:16.879 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:17.502 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:17.504 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T04:05:17.508 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T04:05:17.530 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T04:05:17.563 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T04:05:17.569 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T04:05:17.571 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T04:05:17.576 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T04:05:17.599 INFO:teuthology.orchestra.run.trial090.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T04:05:17.611 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T04:05:17.614 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T04:05:17.620 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T04:05:17.622 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T04:05:17.633 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T04:05:17.639 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T04:05:17.663 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T04:05:17.666 INFO:teuthology.orchestra.run.trial090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T04:05:17.716 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T04:05:17.729 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T04:05:17.731 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T04:05:17.735 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T04:05:17.741 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T04:05:17.746 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T04:05:17.749 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T04:05:17.763 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T04:05:17.767 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T04:05:17.772 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T04:05:17.784 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T04:05:17.792 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T04:05:17.799 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T04:05:17.818 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T04:05:17.829 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T04:05:17.845 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T04:05:17.849 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T04:05:17.857 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T04:05:17.897 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T04:05:18.219 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T04:05:18.229 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T04:05:18.233 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T04:05:18.239 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T04:05:18.241 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T04:05:18.268 INFO:teuthology.orchestra.run.trial090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T04:05:18.311 INFO:teuthology.orchestra.run.trial090.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T04:05:18.320 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T04:05:18.326 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T04:05:18.329 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T04:05:18.335 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T04:05:18.338 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T04:05:18.345 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T04:05:18.349 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T04:05:18.376 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T04:05:18.386 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T04:05:18.392 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T04:05:18.399 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T04:05:18.433 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T04:05:18.657 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T04:05:18.680 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T04:05:18.684 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T04:05:18.742 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T04:05:18.744 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T04:05:18.765 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T04:05:19.089 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T04:05:19.162 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T04:05:19.830 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T04:05:19.848 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T04:05:19.858 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T04:05:19.864 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T04:05:19.878 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T04:05:19.893 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T04:05:19.969 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T04:05:19.977 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T04:05:20.001 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T04:05:20.030 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T04:05:20.080 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T04:05:20.086 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T04:05:20.090 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T04:05:20.091 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T04:05:20.109 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:05:20.110 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T04:05:20.110 INFO:teuthology.orchestra.run.trial090.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T04:05:20.110 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:20.117 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:05:20.142 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T04:05:20.142 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T04:05:20.142 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:20.178 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T04:05:20.803 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T04:05:21.567 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 80/96 2026-02-17T04:05:21.630 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 81/96 2026-02-17T04:05:21.632 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T04:05:21.648 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 82/96 2026-02-17T04:05:21.648 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:21.648 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T04:05:21.648 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:21.657 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 83/96 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T04:05:21.681 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:21.741 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T04:05:21.743 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephadm-2:20.3.0-5271.g32585015.el9.noarch 84/96 2026-02-17T04:05:21.752 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 85/96 2026-02-17T04:05:21.776 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 86/96 2026-02-17T04:05:21.778 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T04:05:24.673 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 87/96 2026-02-17T04:05:24.680 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T04:05:25.137 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 88/96 2026-02-17T04:05:25.139 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T04:05:25.152 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 89/96 2026-02-17T04:05:25.153 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T04:05:25.213 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 90/96 2026-02-17T04:05:25.255 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 91/96 2026-02-17T04:05:25.256 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 92/96 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T04:05:25.279 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:25.292 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T04:05:25.515 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 93/96 2026-02-17T04:05:25.517 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T04:05:25.538 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 94/96 2026-02-17T04:05:25.538 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:25.538 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T04:05:25.538 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T04:05:25.538 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T04:05:25.539 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:25.633 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 95/96 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T04:05:25.654 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T04:05:25.662 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T04:05:25.685 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 96/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-2:20.3.0-5271.g32585015.el9.x86_64 96/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-2:20.3.0-5271.g32585015.el9.x86_64 1/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 3/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 4/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 5/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_6 6/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_6 7/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el 8/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarc 9/96 2026-02-17T04:05:26.492 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noa 10/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585 11/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noa 12/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9. 13/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 14/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9 15/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 16/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephadm-2:20.3.0-5271.g32585015.el9.noarch 17/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T04:05:26.493 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T04:05:26.495 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T04:05:26.496 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T04:05:26.497 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout: ceph-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.562 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: cephadm-2:20.3.0-5271.g32585015.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T04:05:26.563 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T04:05:26.564 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T04:05:26.565 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T04:05:26.566 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: zip-3.0-35.el9.x86_64 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:26.567 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:26.627 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-base 2026-02-17T04:05:26.945 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:27.012 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-base-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:27.029 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:27.029 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:27.030 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:27.051 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install cephadm 2026-02-17T04:05:27.363 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:27.429 INFO:teuthology.orchestra.run.trial090.stdout:Package cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:27.446 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:27.446 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:27.447 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:27.467 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T04:05:27.777 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:27.860 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5271.g32585015.el9 ceph 147 k 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 147 k 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 419 k 2026-02-17T04:05:27.861 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:27.960 INFO:teuthology.orchestra.run.trial090.stdout:ceph-immutable-object-cache-20.3.0-5271.g325850 1.5 MB/s | 147 kB 00:00 2026-02-17T04:05:27.961 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:27.961 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.4 MB/s | 147 kB 00:00 2026-02-17T04:05:27.961 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:27.965 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:27.965 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:27.997 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:27.997 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:28.052 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:28.054 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:05:28.077 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:05:28.077 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:28.077 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T04:05:28.077 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:28.363 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5271.g32585015. 1/1 2026-02-17T04:05:28.364 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:28.364 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:28.364 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:28.364 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:28.364 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:28.391 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr 2026-02-17T04:05:28.709 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:28.774 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:28.792 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:28.792 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:28.792 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:28.814 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T04:05:29.123 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:29.188 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-dashboard-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:29.206 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:29.206 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:29.206 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:29.228 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T04:05:29.536 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:29.602 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:29.620 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:29.620 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:29.620 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:29.642 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-rook 2026-02-17T04:05:29.957 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:30.023 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-rook-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:30.040 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:30.041 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:30.041 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:30.062 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T04:05:30.369 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:30.433 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-cephadm-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:30.451 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:30.451 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:30.451 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:30.472 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-osd 2026-02-17T04:05:30.779 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:30.843 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-osd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:30.861 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:30.861 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:30.861 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:30.883 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-osd-classic 2026-02-17T04:05:31.191 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:31.256 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-osd-classic-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:31.273 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:31.274 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:31.274 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:31.295 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-fuse 2026-02-17T04:05:31.601 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:31.683 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:31.683 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:31.683 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T04:05:31.683 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 987 k 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 987 k 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 2.9 M 2026-02-17T04:05:31.684 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:31.803 INFO:teuthology.orchestra.run.trial090.stdout:ceph-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 8.1 MB/s | 987 kB 00:00 2026-02-17T04:05:31.804 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:31.804 INFO:teuthology.orchestra.run.trial090.stdout:Total 8.0 MB/s | 987 kB 00:00 2026-02-17T04:05:31.804 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:31.808 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:31.808 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:31.845 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:31.845 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:31.940 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:31.957 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:32.199 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:32.257 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:32.284 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-volume 2026-02-17T04:05:32.601 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:32.667 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-volume-2:20.3.0-5271.g32585015.el9.noarch is already installed. 2026-02-17T04:05:32.685 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:32.685 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:32.685 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:32.706 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados-devel 2026-02-17T04:05:33.014 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:33.095 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 123 k 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 123 k 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 437 k 2026-02-17T04:05:33.096 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:33.379 INFO:teuthology.orchestra.run.trial090.stdout:librados-devel-20.3.0-5271.g32585015.el9.x86_64 436 kB/s | 123 kB 00:00 2026-02-17T04:05:33.379 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:33.379 INFO:teuthology.orchestra.run.trial090.stdout:Total 435 kB/s | 123 kB 00:00 2026-02-17T04:05:33.379 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:33.383 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:33.383 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:33.414 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:33.415 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:33.469 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:33.485 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:33.570 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:33.630 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:33.659 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs2 2026-02-17T04:05:33.971 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:34.037 INFO:teuthology.orchestra.run.trial090.stdout:Package libcephfs2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:34.054 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:34.055 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:34.055 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:34.076 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs-devel 2026-02-17T04:05:34.384 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel x86_64 2:20.3.0-5271.g32585015.el9 ceph 37 k 2026-02-17T04:05:34.468 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 37 k 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 171 k 2026-02-17T04:05:34.469 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:34.715 INFO:teuthology.orchestra.run.trial090.stdout:libcephfs-devel-20.3.0-5271.g32585015.el9.x86_6 152 kB/s | 37 kB 00:00 2026-02-17T04:05:34.715 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:34.715 INFO:teuthology.orchestra.run.trial090.stdout:Total 151 kB/s | 37 kB 00:00 2026-02-17T04:05:34.715 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:34.718 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:34.718 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:34.721 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:34.721 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:34.742 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:34.758 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:34.814 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:34.872 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:34.901 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados2 2026-02-17T04:05:35.212 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:35.279 INFO:teuthology.orchestra.run.trial090.stdout:Package librados2-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:35.296 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:35.297 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:35.297 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:35.319 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librbd1 2026-02-17T04:05:35.631 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:35.696 INFO:teuthology.orchestra.run.trial090.stdout:Package librbd1-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:35.713 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:35.714 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:35.714 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:35.734 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rados 2026-02-17T04:05:36.048 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:36.112 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rados-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:36.130 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:36.130 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:36.130 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:36.152 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rgw 2026-02-17T04:05:36.467 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:36.533 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rgw-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:36.550 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:36.551 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:36.551 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:36.572 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-cephfs 2026-02-17T04:05:36.881 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:36.945 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-cephfs-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:36.963 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:36.963 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:36.963 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:36.985 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rbd 2026-02-17T04:05:37.295 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:37.361 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rbd-2:20.3.0-5271.g32585015.el9.x86_64 is already installed. 2026-02-17T04:05:37.379 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:37.379 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T04:05:37.379 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:37.401 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-fuse 2026-02-17T04:05:37.713 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse x86_64 2:20.3.0-5271.g32585015.el9 ceph 84 k 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:37.797 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:37.798 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 84 k 2026-02-17T04:05:37.798 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 209 k 2026-02-17T04:05:37.798 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:37.871 INFO:teuthology.orchestra.run.trial090.stdout:rbd-fuse-20.3.0-5271.g32585015.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-17T04:05:37.872 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:37.872 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-17T04:05:37.872 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:37.876 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:37.876 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:37.907 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:37.907 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:37.958 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:37.976 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:38.058 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:38.116 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:38.145 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-mirror 2026-02-17T04:05:38.460 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:38.543 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror x86_64 2:20.3.0-5271.g32585015.el9 ceph 2.9 M 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.9 M 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 11 M 2026-02-17T04:05:38.544 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:38.691 INFO:teuthology.orchestra.run.trial090.stdout:rbd-mirror-20.3.0-5271.g32585015.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-17T04:05:38.691 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:38.691 INFO:teuthology.orchestra.run.trial090.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-17T04:05:38.691 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:38.696 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:38.696 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:38.736 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:38.736 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:38.915 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:38.917 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:38.939 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:38.940 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T04:05:38.940 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T04:05:38.940 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T04:05:38.940 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T04:05:38.940 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:39.261 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:39.262 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:39.262 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:39.262 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:39.262 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:39.262 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:39.293 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-nbd 2026-02-17T04:05:39.608 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 04:04:48 AM UTC. 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd x86_64 2:20.3.0-5271.g32585015.el9 ceph 172 k 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 172 k 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 462 k 2026-02-17T04:05:39.691 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T04:05:40.097 INFO:teuthology.orchestra.run.trial090.stdout:rbd-nbd-20.3.0-5271.g32585015.el9.x86_64.rpm 426 kB/s | 172 kB 00:00 2026-02-17T04:05:40.097 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T04:05:40.097 INFO:teuthology.orchestra.run.trial090.stdout:Total 425 kB/s | 172 kB 00:00 2026-02-17T04:05:40.097 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T04:05:40.103 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T04:05:40.103 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T04:05:40.134 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T04:05:40.134 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T04:05:40.190 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T04:05:40.207 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:40.287 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 1/1 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd-2:20.3.0-5271.g32585015.el9.x86_64 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T04:05:40.347 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T04:05:40.377 DEBUG:teuthology.parallel:result is None 2026-02-17T04:05:40.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:05:40.497 DEBUG:teuthology.orchestra.run.trial090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T04:05:40.518 INFO:teuthology.orchestra.run.trial090.stdout:20.3.0-5271.g32585015.el9 2026-02-17T04:05:40.518 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5271.g32585015.el9 2026-02-17T04:05:40.518 INFO:teuthology.task.install:The correct ceph version 20.3.0-5271.g32585015 is installed. 2026-02-17T04:05:40.520 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T04:05:40.520 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:05:40.520 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T04:05:40.583 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T04:05:40.584 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:05:40.584 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T04:05:40.646 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T04:05:40.709 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T04:05:40.710 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:05:40.710 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T04:05:40.773 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T04:05:40.837 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T04:05:40.837 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:05:40.837 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T04:05:40.900 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T04:05:40.962 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T04:05:40.980 INFO:tasks.workunit:Pulling workunits from ref 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:05:40.981 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T04:05:40.981 INFO:tasks.workunit:timeout=3h 2026-02-17T04:05:40.981 INFO:tasks.workunit:cleanup=True 2026-02-17T04:05:40.981 DEBUG:teuthology.orchestra.run.trial090:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T04:05:41.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T04:05:41.018 INFO:teuthology.orchestra.run.trial090.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T04:05:41.018 DEBUG:teuthology.orchestra.run.trial090:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T04:05:41.075 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T04:05:41.075 DEBUG:teuthology.orchestra.run.trial090:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T04:05:41.131 DEBUG:teuthology.orchestra.run.trial090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 325850157d309f65985eea9ec9bb9f1d56726fee 2026-02-17T04:05:41.195 INFO:tasks.workunit.client.0.trial090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:Note: switching to '325850157d309f65985eea9ec9bb9f1d56726fee'. 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr: git switch -c 2026-02-17T04:06:00.714 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr:Or undo this operation with: 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr: git switch - 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr: 2026-02-17T04:06:00.715 INFO:tasks.workunit.client.0.trial090.stderr:HEAD is now at 325850157d3 Merge branch 'issue73891' of https://github.com/bill-scales/ceph into wip-bharath18-testing-2026-02-13-0856 2026-02-17T04:06:00.721 DEBUG:teuthology.orchestra.run.trial090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T04:06:00.779 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T04:06:00.779 DEBUG:teuthology.orchestra.run.trial090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T04:06:00.837 INFO:tasks.workunit:Running workunits matching scrub on client.0... 2026-02-17T04:06:00.837 INFO:tasks.workunit:Running workunit scrub/osd-mapper.sh... 2026-02-17T04:06:00.837 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-mapper.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh 2026-02-17T04:06:00.899 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-mapper 2026-02-17T04:06:00.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:12: run: local dir=td/osd-mapper 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:13: run: shift 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:15: run: export CEPH_MON=127.0.0.1:7144 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:15: run: CEPH_MON=127.0.0.1:7144 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:16: run: export CEPH_ARGS 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:17: run: uuidgen 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:17: run: CEPH_ARGS+='--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none ' 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:18: run: CEPH_ARGS+='--mon-host=127.0.0.1:7144 ' 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:20: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:06:00.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: set 2026-02-17T04:06:00.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: local funcs=TEST_truncated_sna_record 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:22: run: for func in $funcs 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:23: run: setup td/osd-mapper 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-mapper 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-mapper 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:06:00.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-17T04:06:00.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:00.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:00.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:00.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:00.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:00.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:00.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:06:00.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:06:00.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:06:00.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:06:00.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:06:00.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:06:00.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:00.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:06:00.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:06:00.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:06:00.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:06:00.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-17T04:06:00.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:06:00.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:00.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37513 2026-02-17T04:06:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:06:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:06:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-mapper 2026-02-17T04:06:00.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:06:00.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:00.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:00.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.37513 2026-02-17T04:06:00.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-mapper 1' TERM HUP INT 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:24: run: TEST_truncated_sna_record td/osd-mapper 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:46: TEST_truncated_sna_record: local dir=td/osd-mapper 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:47: TEST_truncated_sna_record: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test') 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:47: TEST_truncated_sna_record: local -A cluster_conf 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:53: TEST_truncated_sna_record: local extr_dbg=3 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:54: TEST_truncated_sna_record: (( extr_dbg > 1 )) 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:54: TEST_truncated_sna_record: echo 'Dir: td/osd-mapper' 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stdout:Dir: td/osd-mapper 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:55: TEST_truncated_sna_record: standard_scrub_cluster td/osd-mapper cluster_conf 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-mapper 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-17T04:06:00.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local extra_pars= 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:06:00.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:06:01.144 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 57834909-71a8-40e0-b171-88ca927d2362 2026-02-17T04:06:01.229 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:01.255 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.252+0000 7f818f215780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.254+0000 7f818f215780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.254+0000 7f818f215780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.255+0000 7f818f215780 -1 bdev(0x4148c00 td/osd-mapper/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:01.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.255+0000 7f818f215780 -1 bluestore(td/osd-mapper/0) _read_fsid unparsable uuid 2026-02-17T04:06:01.706 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:06:01.788 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:06:01.806 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.803+0000 7f15dac0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.808 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.805+0000 7f15dac0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.809 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:01.806+0000 7f15dac0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:01.864 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:02.015 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:02.013+0000 7f15dac0d780 -1 Falling back to public interface 2026-02-17T04:06:02.474 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:02.471+0000 7f15dac0d780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:06:02.944 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:04.023 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:06:04.187 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/255677338,v1:127.0.0.1:6801/255677338] [v2:127.0.0.1:6802/255677338,v1:127.0.0.1:6803/255677338] exists,up 57834909-71a8-40e0-b171-88ca927d2362 2026-02-17T04:06:04.190 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 6c7ee862-133c-4019-a3af-fe8f05e2475b 2026-02-17T04:06:04.359 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:04.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.384+0000 7f3456a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:04.387 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.385+0000 7f3456a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:04.388 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.386+0000 7f3456a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:04.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.386+0000 7f3456a10780 -1 bdev(0x3b7ec00 td/osd-mapper/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:04.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.386+0000 7f3456a10780 -1 bluestore(td/osd-mapper/1) _read_fsid unparsable uuid 2026-02-17T04:06:04.707 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:06:04.917 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:06:04.935 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.932+0000 7f1799473780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:04.936 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.934+0000 7f1799473780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:04.937 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:04.935+0000 7f1799473780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:05.068 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:05.065+0000 7f1799473780 -1 Falling back to public interface 2026-02-17T04:06:05.077 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:05.352 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:05.349+0000 7f1799473780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:06:06.240 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:06.407 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1886667330,v1:127.0.0.1:6811/1886667330] [v2:127.0.0.1:6812/1886667330,v1:127.0.0.1:6813/1886667330] exists,up 6c7ee862-133c-4019-a3af-fe8f05e2475b 2026-02-17T04:06:06.411 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 fba62260-7d13-4d0e-8669-c8da9c578a50 2026-02-17T04:06:06.580 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:06:06.607 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:06.605+0000 7fb394008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:06.609 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:06.606+0000 7fb394008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:06.609 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:06.607+0000 7fb394008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:06.610 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:06.607+0000 7fb394008780 -1 bdev(0x315ac00 td/osd-mapper/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:06.610 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:06.607+0000 7fb394008780 -1 bluestore(td/osd-mapper/2) _read_fsid unparsable uuid 2026-02-17T04:06:06.935 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:06:07.147 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:06:07.164 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:07.162+0000 7f9da583b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:07.166 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:07.163+0000 7f9da583b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:07.167 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:07.164+0000 7f9da583b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:07.287 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:07.284+0000 7f9da583b780 -1 Falling back to public interface 2026-02-17T04:06:07.313 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:07.603 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:07.600+0000 7f9da583b780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:06:08.478 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:08.644 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/115322235,v1:127.0.0.1:6819/115322235] [v2:127.0.0.1:6820/115322235,v1:127.0.0.1:6821/115322235] exists,up fba62260-7d13-4d0e-8669-c8da9c578a50 2026-02-17T04:06:08.858 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:06:10.300 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836488 2026-02-17T04:06:11.635 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705670 2026-02-17T04:06:11.803 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574851 2026-02-17T04:06:13.712 INFO:tasks.workunit.client.0.trial090.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-17T04:06:13.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:56: TEST_truncated_sna_record: ceph tell 'osd.*' config set osd_stats_update_period_not_scrubbing 1 2026-02-17T04:06:13.765 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:06:13.765 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:06:13.765 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.773 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:06:13.773 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:06:13.774 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.781 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:06:13.781 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:06:13.781 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:57: TEST_truncated_sna_record: ceph tell 'osd.*' config set osd_stats_update_period_scrubbing 1 2026-02-17T04:06:13.839 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:06:13.839 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-17T04:06:13.839 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.847 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:06:13.847 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-17T04:06:13.847 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.856 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:06:13.856 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-17T04:06:13.856 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:59: TEST_truncated_sna_record: local osdn=3 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:60: TEST_truncated_sna_record: local poolid=1 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:61: TEST_truncated_sna_record: local poolname=test 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:62: TEST_truncated_sna_record: local objname=objxxx 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:65: TEST_truncated_sna_record: make_a_clone test objxxx snap01 snap02 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-17T04:06:13.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-17T04:06:13.958 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap01 2026-02-17T04:06:14.058 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap02 2026-02-17T04:06:14.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:66: TEST_truncated_sna_record: make_a_clone test objxxx snap13 2026-02-17T04:06:14.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-17T04:06:14.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-17T04:06:14.160 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap13 2026-02-17T04:06:14.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:67: TEST_truncated_sna_record: make_a_clone test objxxx snap24 snap25 2026-02-17T04:06:14.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-17T04:06:14.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-17T04:06:14.262 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap24 2026-02-17T04:06:14.364 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap25 2026-02-17T04:06:14.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:68: TEST_truncated_sna_record: echo 31764 2026-02-17T04:06:14.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:68: TEST_truncated_sna_record: rados -p test put objxxx - 2026-02-17T04:06:14.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-17T04:06:14.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: jq -r .pgid 2026-02-17T04:06:14.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: local pgid=1.3 2026-02-17T04:06:14.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-17T04:06:14.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: jq -r '.up[0]' 2026-02-17T04:06:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: local osd=1 2026-02-17T04:06:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:73: TEST_truncated_sna_record: echo 'pgid is 1.3 (primary: osd.1)' 2026-02-17T04:06:14.712 INFO:tasks.workunit.client.0.trial090.stdout:pgid is 1.3 (primary: osd.1) 2026-02-17T04:06:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:75: TEST_truncated_sna_record: set_query_debug 1.3 2026-02-17T04:06:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.3 2026-02-17T04:06:14.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-17T04:06:14.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.3' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-17T04:06:14.866 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:06:14.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-17T04:06:14.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.3 is 1' 2026-02-17T04:06:14.873 INFO:tasks.workunit.client.0.trial090.stdout:Setting scrub debug data. Primary for 1.3 is 1 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.37513/ceph-osd.1.asok 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-17T04:06:14.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.37513/ceph-osd.1.asok scrubdebug 1.3 set sessions 2026-02-17T04:06:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:78: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:78: TEST_truncated_sna_record: rados --format json-pretty -p test listsnaps objxxx 2026-02-17T04:06:14.940 INFO:tasks.workunit.client.0.trial090.stdout:{"success":true}{ 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "objxxx", 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 5, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 2, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 1, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap01" 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 2, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap02" 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "size": 5, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 3, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 3, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap13" 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 5, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 4, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap24" 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "id": 5, 2026-02-17T04:06:14.941 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap25" 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6, 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: "id": "head", 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [], 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:14.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:81: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-17T04:06:14.993 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:14.993 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:06:14.993 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:06:14.993 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:06:14.993 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:14.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:85: TEST_truncated_sna_record: sleep 3 2026-02-17T04:06:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:86: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-17T04:06:15.314144+0000 21'7 21:41 [1,2,0] 1 [1,2,0] 1 21'7 2026-02-17T04:06:15.314103+0000 21'7 2026-02-17T04:06:15.314103+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:06:15.314103+0000 4 0 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.962965+0000 0'0 21:26 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.962693+0000 0'0 21:29 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.963274+0000 0'0 21:30 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:06:18.156 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:06:18.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:87: TEST_truncated_sna_record: grep -a -q -- 'event: --^^^^---- ScrubFinished' td/osd-mapper/osd.1.log 2026-02-17T04:06:18.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:91: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-17T04:06:15.314144+0000 21'7 21:41 [1,2,0] 1 [1,2,0] 1 21'7 2026-02-17T04:06:15.314103+0000 21'7 2026-02-17T04:06:15.314103+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:06:15.314103+0000 4 0 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.962965+0000 0'0 21:26 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.962693+0000 0'0 21:29 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:08.963274+0000 0'0 21:30 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:06:18.317 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:06:18.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:92: TEST_truncated_sna_record: ceph osd set noscrub 2026-02-17T04:06:18.538 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:06:18.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:93: TEST_truncated_sna_record: ceph osd set nodeep-scrub 2026-02-17T04:06:18.741 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:06:18.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:94: TEST_truncated_sna_record: sleep 5 2026-02-17T04:06:23.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:95: TEST_truncated_sna_record: grep -a -q -v ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:23.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:98: TEST_truncated_sna_record: kill_daemons td/osd-mapper TERM osd 2026-02-17T04:06:23.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:23.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:23.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:23.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:23.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:24.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:24.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:100: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:24.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:100: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-17T04:06:24.075 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.072+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.075 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.072+0000 7f3055235a80 0 bdev(0x2ecf000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.075 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.072+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.075 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.073+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) close 2026-02-17T04:06:24.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 0 bdev(0x2ecf000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 0 bdev(0x2ecf400 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bluefs mount 2026-02-17T04:06:24.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.089+0000 7f3055235a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluefs mount shared_bdev_used = 0 2026-02-17T04:06:24.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.092+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.101+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.101+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_super_meta old nid_max 2050 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.101+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_super_meta old blobid_max 20480 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.101+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.101+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_super_meta min_alloc_size 0x1000 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.102+0000 7f3055235a80 1 freelist init 2026-02-17T04:06:24.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.102+0000 7f3055235a80 1 freelist _read_cfg 2026-02-17T04:06:24.105 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.102+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-17T04:06:24.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.104+0000 7f3055235a80 1 fbmap_alloc 0x2f718c0 shutdown 2026-02-17T04:06:24.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.104+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-17T04:06:24.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.104+0000 7f3055235a80 1 bluefs umount 2026-02-17T04:06:24.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.104+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) close 2026-02-17T04:06:24.124 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.124 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 0 bdev(0x2ecf400 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-17T04:06:24.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 1 bluefs mount 2026-02-17T04:06:24.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.122+0000 7f3055235a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluefs mount shared_bdev_used = 27656192 2026-02-17T04:06:24.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.123+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.134 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.132+0000 7f3055235a80 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000000 0b 05 58 02 00 00 11 22 04 db bc a5 41 ab ae 2f |..X...."....A../| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000010 90 25 e4 b9 b2 56 00 00 00 00 18 00 00 00 00 00 |.%...V..........| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:* 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-17T04:06:24.135 INFO:tasks.workunit.client.0.trial090.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000220 72 65 18 00 00 00 05 00 00 00 57 83 49 09 71 a8 |re........W.I.q.| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000230 40 e0 b1 71 88 ca 92 7d 23 62 00 00 00 00 00 00 |@..q...}#b......| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000240 00 00 18 00 00 00 2b e9 93 69 dc 22 6b 1e 01 00 |......+..i."k...| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-17T04:06:24.136 INFO:tasks.workunit.client.0.trial090.stdout:0000025e 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:0000003f 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.137 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.132+0000 7f3055235a80 1 bluefs umount 2026-02-17T04:06:24.139 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.132+0000 7f3055235a80 1 bdev(0x2ecf400 td/osd-mapper/0/block) close 2026-02-17T04:06:24.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.150+0000 7f3055235a80 1 freelist shutdown 2026-02-17T04:06:24.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.150+0000 7f3055235a80 1 bdev(0x2ecf000 td/osd-mapper/0/block) close 2026-02-17T04:06:24.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:24.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-17T04:06:24.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: grep -a SNA_ 2026-02-17T04:06:24.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.182+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:24.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.182+0000 7f2a6aa63a80 0 bdev(0x3489000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:24.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.182+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.183+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) close 2026-02-17T04:06:24.206 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:24.206 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 0 bdev(0x3489000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:24.206 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 0 bdev(0x3489400 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bluefs mount 2026-02-17T04:06:24.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.204+0000 7f2a6aa63a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluefs mount shared_bdev_used = 0 2026-02-17T04:06:24.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.207+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_super_meta old nid_max 2051 2026-02-17T04:06:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_super_meta old blobid_max 20480 2026-02-17T04:06:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T04:06:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_super_meta min_alloc_size 0x1000 2026-02-17T04:06:24.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 freelist init 2026-02-17T04:06:24.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 freelist _read_cfg 2026-02-17T04:06:24.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.217+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-17T04:06:24.222 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.219+0000 7f2a6aa63a80 1 fbmap_alloc 0x352b8c0 shutdown 2026-02-17T04:06:24.222 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.219+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-17T04:06:24.222 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.219+0000 7f2a6aa63a80 1 bluefs umount 2026-02-17T04:06:24.222 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.219+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) close 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 0 bdev(0x3489400 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 1 bluefs mount 2026-02-17T04:06:24.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.234+0000 7f2a6aa63a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.239 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.239 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluefs mount shared_bdev_used = 27656192 2026-02-17T04:06:24.239 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.235+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.247 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.244+0000 7f2a6aa63a80 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.247 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.244+0000 7f2a6aa63a80 1 bluefs umount 2026-02-17T04:06:24.247 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.244+0000 7f2a6aa63a80 1 bdev(0x3489400 td/osd-mapper/2/block) close 2026-02-17T04:06:24.261 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.259+0000 7f2a6aa63a80 1 freelist shutdown 2026-02-17T04:06:24.261 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.259+0000 7f2a6aa63a80 1 bdev(0x3489000 td/osd-mapper/2/block) close 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:102: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:24.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:102: TEST_truncated_sna_record: grep -a SNA_ /tmp/oo2.dump 2026-02-17T04:06:24.283 INFO:tasks.workunit.client.0.trial090.stderr:grep: /tmp/oo2.dump: No such file or directory 2026-02-17T04:06:24.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:103: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:24.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:103: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-17T04:06:24.355 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-17T04:06:24.355 INFO:tasks.workunit.client.0.trial090.stdout:00000000 0b 05 58 02 00 00 11 22 04 db bc a5 41 ab ae 2f |..X...."....A../| 2026-02-17T04:06:24.355 INFO:tasks.workunit.client.0.trial090.stdout:00000010 90 25 e4 b9 b2 56 02 00 00 00 18 00 00 00 00 00 |.%...V..........| 2026-02-17T04:06:24.355 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T04:06:24.355 INFO:tasks.workunit.client.0.trial090.stdout:* 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-17T04:06:24.356 INFO:tasks.workunit.client.0.trial090.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000220 72 65 18 00 00 00 0d 00 00 00 fb a6 22 60 7d 13 |re.........."`}.| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000230 4d 0e 86 69 c8 da 9c 57 8a 50 00 00 00 00 00 00 |M..i...W.P......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000240 00 00 18 00 00 00 30 e9 93 69 62 9a 90 21 01 00 |......0..ib..!..| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:0000025e 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-17T04:06:24.357 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:0000003f 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.358 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.359 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.360 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.360 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-17T04:06:24.360 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.360 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-17T04:06:24.360 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-17T04:06:24.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_000000000000000[0-9]_000000000000000' 2026-02-17T04:06:24.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:24.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: wc -l 2026-02-17T04:06:24.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: local num_sna_b4=5 2026-02-17T04:06:24.504 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: expr 3 - 1 2026-02-17T04:06:24.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: seq 0 2 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/0 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.0 (db: td/osd-mapper/0)' 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stdout:corrupting the SnapMapper DB of osd.0 (db: td/osd-mapper/0) 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-17T04:06:24.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-17T04:06:24.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.515+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.515+0000 7fd16ae10a80 0 bdev(0x231f000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.515+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.515+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) close 2026-02-17T04:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 0 bdev(0x231f000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 0 bdev(0x231f400 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bluefs mount 2026-02-17T04:06:24.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.541+0000 7fd16ae10a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.546 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluefs mount shared_bdev_used = 0 2026-02-17T04:06:24.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.544+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.553+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.553+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_super_meta old nid_max 2050 2026-02-17T04:06:24.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.553+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_super_meta old blobid_max 20480 2026-02-17T04:06:24.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.553+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T04:06:24.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.553+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_super_meta min_alloc_size 0x1000 2026-02-17T04:06:24.557 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.554+0000 7fd16ae10a80 1 freelist init 2026-02-17T04:06:24.557 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.554+0000 7fd16ae10a80 1 freelist _read_cfg 2026-02-17T04:06:24.557 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.554+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-17T04:06:24.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.556+0000 7fd16ae10a80 1 fbmap_alloc 0x23c18c0 shutdown 2026-02-17T04:06:24.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.556+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-17T04:06:24.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.556+0000 7fd16ae10a80 1 bluefs umount 2026-02-17T04:06:24.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.556+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) close 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 0 bdev(0x231f400 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 1 bluefs mount 2026-02-17T04:06:24.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.578+0000 7fd16ae10a80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluefs mount shared_bdev_used = 27656192 2026-02-17T04:06:24.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.579+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:24.590 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.588+0000 7fd16ae10a80 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000000 0b 05 58 02 00 00 11 22 04 db bc a5 41 ab ae 2f |..X...."....A../| 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000010 90 25 e4 b9 b2 56 00 00 00 00 18 00 00 00 00 00 |.%...V..........| 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:* 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-17T04:06:24.591 INFO:tasks.workunit.client.0.trial090.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-17T04:06:24.592 INFO:tasks.workunit.client.0.trial090.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000220 72 65 18 00 00 00 05 00 00 00 57 83 49 09 71 a8 |re........W.I.q.| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000230 40 e0 b1 71 88 ca 92 7d 23 62 00 00 00 00 00 00 |@..q...}#b......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000240 00 00 18 00 00 00 2b e9 93 69 dc 22 6b 1e 01 00 |......+..i."k...| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:0000025e 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-17T04:06:24.593 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:0000003f 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.594 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-17T04:06:24.595 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.596 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-17T04:06:24.596 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:24.596 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.588+0000 7fd16ae10a80 1 bluefs umount 2026-02-17T04:06:24.596 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.588+0000 7fd16ae10a80 1 bdev(0x231f400 td/osd-mapper/0/block) close 2026-02-17T04:06:24.604 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.602+0000 7fd16ae10a80 1 freelist shutdown 2026-02-17T04:06:24.604 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:24.602+0000 7fd16ae10a80 1 bdev(0x231f000 td/osd-mapper/0/block) close 2026-02-17T04:06:24.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-17T04:06:24.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-17T04:06:24.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:24.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:24.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-17T04:06:24.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-17T04:06:24.725 INFO:tasks.workunit.client.0.trial090.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-17T04:06:24.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.JIFYwLAtOh_the_val 2026-02-17T04:06:24.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:24.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.JIFYwLAtOh_the_val' 2026-02-17T04:06:24.727 INFO:tasks.workunit.client.0.trial090.stdout:Value dumped in: /tmp/tmp.JIFYwLAtOh_the_val 2026-02-17T04:06:24.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.JIFYwLAtOh_the_val 2026-02-17T04:06:24.804 INFO:tasks.workunit.client.0.trial090.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-17T04:06:24.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:24.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.JIFYwLAtOh_the_val 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-17T04:06:24.840 INFO:tasks.workunit.client.0.trial090.stdout:0000073 2026-02-17T04:06:24.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-17T04:06:24.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:24.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.JIFYwLAtOh_the_val 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/1 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.1 (db: td/osd-mapper/1)' 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stdout:corrupting the SnapMapper DB of osd.1 (db: td/osd-mapper/1) 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-17T04:06:25.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-17T04:06:25.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.061+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-17T04:06:25.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.061+0000 7fc0afa5da80 0 bdev(0x24e7000 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-17T04:06:25.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.061+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.064 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.061+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) close 2026-02-17T04:06:25.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-17T04:06:25.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 0 bdev(0x24e7000 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-17T04:06:25.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 0 bdev(0x24e7400 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bluefs add_block_device bdev 1 path td/osd-mapper/1/block size 100 GiB 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bluefs mount 2026-02-17T04:06:25.081 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.078+0000 7fc0afa5da80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluefs mount shared_bdev_used = 0 2026-02-17T04:06:25.084 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.081+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:25.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:25.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_super_meta old nid_max 2051 2026-02-17T04:06:25.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_super_meta old blobid_max 20480 2026-02-17T04:06:25.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T04:06:25.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_super_meta min_alloc_size 0x1000 2026-02-17T04:06:25.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 freelist init 2026-02-17T04:06:25.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 freelist _read_cfg 2026-02-17T04:06:25.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.091+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-17T04:06:25.095 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.093+0000 7fc0afa5da80 1 fbmap_alloc 0x25898c0 shutdown 2026-02-17T04:06:25.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.093+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-17T04:06:25.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.093+0000 7fc0afa5da80 1 bluefs umount 2026-02-17T04:06:25.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.093+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) close 2026-02-17T04:06:25.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-17T04:06:25.125 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 0 bdev(0x24e7400 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-17T04:06:25.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 1 bluefs add_block_device bdev 1 path td/osd-mapper/1/block size 100 GiB 2026-02-17T04:06:25.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 1 bluefs mount 2026-02-17T04:06:25.126 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.123+0000 7fc0afa5da80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluefs mount shared_bdev_used = 27656192 2026-02-17T04:06:25.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.125+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.133+0000 7fc0afa5da80 1 bluestore(td/osd-mapper/1) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000000 0b 05 58 02 00 00 11 22 04 db bc a5 41 ab ae 2f |..X...."....A../| 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000010 90 25 e4 b9 b2 56 01 00 00 00 18 00 00 00 00 00 |.%...V..........| 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:* 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-17T04:06:25.136 INFO:tasks.workunit.client.0.trial090.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000220 72 65 18 00 00 00 09 00 00 00 6c 7e e8 62 13 3c |re........l~.b.<| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000230 40 19 a3 af fe 8f 05 e2 47 5b 00 00 00 00 00 00 |@.......G[......| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000240 00 00 18 00 00 00 2e e9 93 69 de 5c c3 12 01 00 |.........i.\....| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:0000025e 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.137 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:0000003f 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.138 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-17T04:06:25.139 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.140 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.133+0000 7fc0afa5da80 1 bluefs umount 2026-02-17T04:06:25.140 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.133+0000 7fc0afa5da80 1 bdev(0x24e7400 td/osd-mapper/1/block) close 2026-02-17T04:06:25.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.150+0000 7fc0afa5da80 1 freelist shutdown 2026-02-17T04:06:25.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.150+0000 7fc0afa5da80 1 bdev(0x24e7000 td/osd-mapper/1/block) close 2026-02-17T04:06:25.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-17T04:06:25.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-17T04:06:25.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:25.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-17T04:06:25.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-17T04:06:25.292 INFO:tasks.workunit.client.0.trial090.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-17T04:06:25.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.UBYXgIu7Rb_the_val 2026-02-17T04:06:25.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.294 INFO:tasks.workunit.client.0.trial090.stdout:Value dumped in: /tmp/tmp.UBYXgIu7Rb_the_val 2026-02-17T04:06:25.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.UBYXgIu7Rb_the_val' 2026-02-17T04:06:25.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.UBYXgIu7Rb_the_val 2026-02-17T04:06:25.367 INFO:tasks.workunit.client.0.trial090.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-17T04:06:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.UBYXgIu7Rb_the_val 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-17T04:06:25.403 INFO:tasks.workunit.client.0.trial090.stdout:0000073 2026-02-17T04:06:25.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-17T04:06:25.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.UBYXgIu7Rb_the_val 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/2 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stdout:corrupting the SnapMapper DB of osd.2 (db: td/osd-mapper/2) 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.2 (db: td/osd-mapper/2)' 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-17T04:06:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-17T04:06:25.635 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.633+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:25.636 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.633+0000 7f4efb23da80 0 bdev(0x1d4f000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:25.636 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.633+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.636 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.633+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) close 2026-02-17T04:06:25.651 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:25.651 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 0 bdev(0x1d4f000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:25.651 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 0 bdev(0x1d4f400 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bluefs mount 2026-02-17T04:06:25.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.649+0000 7f4efb23da80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:25.654 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.654 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.655 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.655 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.655 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.655 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluefs mount shared_bdev_used = 0 2026-02-17T04:06:25.655 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.652+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.661+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.661+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_super_meta old nid_max 2051 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.661+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_super_meta old blobid_max 20480 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.661+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.661+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_super_meta min_alloc_size 0x1000 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.662+0000 7f4efb23da80 1 freelist init 2026-02-17T04:06:25.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.662+0000 7f4efb23da80 1 freelist _read_cfg 2026-02-17T04:06:25.665 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.662+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-17T04:06:25.666 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.664+0000 7f4efb23da80 1 fbmap_alloc 0x1df1320 shutdown 2026-02-17T04:06:25.667 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.664+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-17T04:06:25.667 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.664+0000 7f4efb23da80 1 bluefs umount 2026-02-17T04:06:25.667 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.664+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) close 2026-02-17T04:06:25.685 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-17T04:06:25.685 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 0 bdev(0x1d4f400 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-17T04:06:25.685 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T04:06:25.686 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-17T04:06:25.686 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 1 bluefs mount 2026-02-17T04:06:25.686 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.683+0000 7f4efb23da80 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluefs mount shared_bdev_used = 27656192 2026-02-17T04:06:25.687 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.684+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T04:06:25.695 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.693+0000 7f4efb23da80 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000000 0b 05 58 02 00 00 11 22 04 db bc a5 41 ab ae 2f |..X...."....A../| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000010 90 25 e4 b9 b2 56 02 00 00 00 18 00 00 00 00 00 |.%...V..........| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:* 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-17T04:06:25.696 INFO:tasks.workunit.client.0.trial090.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000220 72 65 18 00 00 00 0d 00 00 00 fb a6 22 60 7d 13 |re.........."`}.| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000230 4d 0e 86 69 c8 da 9c 57 8a 50 00 00 00 00 00 00 |M..i...W.P......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000240 00 00 18 00 00 00 30 e9 93 69 62 9a 90 21 01 00 |......0..ib..!..| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:0000025e 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.697 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:0000003f 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000047 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-17T04:06:25.698 INFO:tasks.workunit.client.0.trial090.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout:0000003b 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.693+0000 7f4efb23da80 1 bluefs umount 2026-02-17T04:06:25.699 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.693+0000 7f4efb23da80 1 bdev(0x1d4f400 td/osd-mapper/2/block) close 2026-02-17T04:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.711+0000 7f4efb23da80 1 freelist shutdown 2026-02-17T04:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:25.711+0000 7f4efb23da80 1 bdev(0x1d4f000 td/osd-mapper/2/block) close 2026-02-17T04:06:25.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-17T04:06:25.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-17T04:06:25.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:25.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-17T04:06:25.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-17T04:06:25.844 INFO:tasks.workunit.client.0.trial090.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:25.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-17T04:06:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.hYAaG6ypT6_the_val 2026-02-17T04:06:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.hYAaG6ypT6_the_val' 2026-02-17T04:06:25.845 INFO:tasks.workunit.client.0.trial090.stdout:Value dumped in: /tmp/tmp.hYAaG6ypT6_the_val 2026-02-17T04:06:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.hYAaG6ypT6_the_val 2026-02-17T04:06:25.922 INFO:tasks.workunit.client.0.trial090.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-17T04:06:25.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:25.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.hYAaG6ypT6_the_val 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stdout:0000073 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-17T04:06:25.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:26.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.hYAaG6ypT6_the_val 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:130: TEST_truncated_sna_record: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 ' 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:131: TEST_truncated_sna_record: echo --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:131: TEST_truncated_sna_record: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:132: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:132: TEST_truncated_sna_record: echo 'Copied OSD args: / --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ /--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/' 2026-02-17T04:06:26.183 INFO:tasks.workunit.client.0.trial090.stdout:Copied OSD args: / --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ /--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ 2026-02-17T04:06:26.184 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: expr 3 - 1 2026-02-17T04:06:26.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: seq 0 2 2026-02-17T04:06:26.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:26.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:26.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 0 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/0 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/0' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/0/journal' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:26.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/0 2026-02-17T04:06:26.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:06:26.188 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:06:26.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/0 --osd-journal=td/osd-mapper/0/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:06:26.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/0/whoami 2026-02-17T04:06:26.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:06:26.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:06:26.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:06:26.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:06:26.214 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:26.211+0000 7fecad1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:26.215 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:26.213+0000 7fecad1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:26.216 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:26.214+0000 7fecad1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:26.344 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:26.341+0000 7fecad1fd780 -1 Falling back to public interface 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:26.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:06:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:26.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:26.612+0000 7fecad1fd780 -1 osd.0 24 log_to_monitors true 2026-02-17T04:06:27.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:27.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:27.541 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:27.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:27.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:27.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:06:27.722 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 27 up_thru 27 down_at 24 last_clean_interval [5,24) [v2:127.0.0.1:6800/3728934652,v1:127.0.0.1:6801/3728934652] [v2:127.0.0.1:6802/3728934652,v1:127.0.0.1:6803/3728934652] exists,up 57834909-71a8-40e0-b171-88ca927d2362 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 1 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/1 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/1' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/1/journal' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:27.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:06:27.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/1 2026-02-17T04:06:27.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:06:27.725 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:06:27.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/1 --osd-journal=td/osd-mapper/1/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:06:27.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/1/whoami 2026-02-17T04:06:27.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:06:27.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:06:27.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:06:27.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:06:27.752 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:27.749+0000 7f536b621780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:27.753 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:27.751+0000 7f536b621780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:27.754 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:27.752+0000 7f536b621780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:27.872 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:27.869+0000 7f536b621780 -1 Falling back to public interface 2026-02-17T04:06:27.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:06:28.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:28.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:28.175+0000 7f536b621780 -1 osd.1 24 log_to_monitors true 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:29.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:06:29.257 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 24 last_clean_interval [9,24) [v2:127.0.0.1:6810/2090984460,v1:127.0.0.1:6811/2090984460] [v2:127.0.0.1:6812/2090984460,v1:127.0.0.1:6813/2090984460] exists,up 6c7ee862-133c-4019-a3af-fe8f05e2475b 2026-02-17T04:06:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 2 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/2 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/2' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/2/journal' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/2 2026-02-17T04:06:29.260 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=112204db-bca5-41ab-ae2f-9025e4b9b256 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/2 --osd-journal=td/osd-mapper/2/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.37513/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/2/whoami 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:06:29.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:06:29.286 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:29.283+0000 7f0256dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:29.287 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:29.285+0000 7f0256dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:29.288 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:29.286+0000 7f0256dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:29.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:29.409+0000 7f0256dd6780 -1 Falling back to public interface 2026-02-17T04:06:29.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:06:29.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:29.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:29.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:06:29.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:29.741 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:29.738+0000 7f0256dd6780 -1 osd.2 24 log_to_monitors true 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:30.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:06:30.789 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 33 up_thru 33 down_at 24 last_clean_interval [13,24) [v2:127.0.0.1:6818/3807787258,v1:127.0.0.1:6819/3807787258] [v2:127.0.0.1:6820/3807787258,v1:127.0.0.1:6821/3807787258] exists,up fba62260-7d13-4d0e-8669-c8da9c578a50 2026-02-17T04:06:30.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:30.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:30.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:30.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:137: TEST_truncated_sna_record: sleep 1 2026-02-17T04:06:31.791 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: expr 3 - 1 2026-02-17T04:06:31.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: seq 0 2 2026-02-17T04:06:31.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:31.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.0 version 2026-02-17T04:06:31.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:31.849 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T04:06:31.849 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T04:06:31.849 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T04:06:31.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:31.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:31.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.1 version 2026-02-17T04:06:31.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:31.908 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T04:06:31.908 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T04:06:31.908 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T04:06:31.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:31.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-17T04:06:31.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.2 version 2026-02-17T04:06:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T04:06:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T04:06:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T04:06:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:31.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:143: TEST_truncated_sna_record: rados --format json-pretty -p test listsnaps objxxx 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "name": "objxxx", 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 5, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 2, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 1, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap01" 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 2, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap02" 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "size": 5, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 3, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 3, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap13" 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 5, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [ 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "id": 4, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap24" 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:31.987 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "id": 5, 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "name": "snap25" 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6, 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "overlaps": [] 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "id": "head", 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "snapshots": [], 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: "size": 6 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:31.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:146: TEST_truncated_sna_record: ceph osd unset nodeep-scrub 2026-02-17T04:06:32.200 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is unset 2026-02-17T04:06:32.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:147: TEST_truncated_sna_record: ceph osd unset noscrub 2026-02-17T04:06:32.396 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is unset 2026-02-17T04:06:32.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-17T04:06:32.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: jq -r '.up[0]' 2026-02-17T04:06:32.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: local cur_prim=1 2026-02-17T04:06:32.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:151: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-17T04:06:30.100424+0000 21'7 36:71 [1,2,0] 1 [1,2,0] 1 21'7 2026-02-17T04:06:15.314103+0000 21'7 2026-02-17T04:06:15.314103+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:06:15.314103+0000 4 0 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100499+0000 0'0 35:63 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.004140+0000 0'0 35:52 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100270+0000 0'0 36:62 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:32.724 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:32.725 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:06:32.725 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:06:32.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:152: TEST_truncated_sna_record: sleep 2 2026-02-17T04:06:34.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:153: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-17T04:06:34.787 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:34.787 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:06:34.787 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:06:34.787 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:06:34.788 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:34.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:154: TEST_truncated_sna_record: sleep 5 2026-02-17T04:06:39.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:155: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-17T04:06:39.948 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:06:39.948 INFO:tasks.workunit.client.0.trial090.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-17T04:06:35.285388+0000 21'7 40:87 [1,2,0] 1 [1,2,0] 1 21'7 2026-02-17T04:06:35.285352+0000 21'7 2026-02-17T04:06:35.285352+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:06:35.285352+0000 4 0 2026-02-17T04:06:39.948 INFO:tasks.workunit.client.0.trial090.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100499+0000 0'0 40:73 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:39.949 INFO:tasks.workunit.client.0.trial090.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.004140+0000 0'0 39:61 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:39.949 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100270+0000 0'0 40:71 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:39.949 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:39.949 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:06:39.949 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:06:39.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:156: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:39.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:156: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:39.957 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:06:35.284+0000 7f5347765640 -1 log_channel(cluster) log [ERR] : osd.1 found snap mapper error on pg 1.3 oid 1:f5ae0ba1:::objxxx:3 snaps in mapper: {}, oi: {3} ...repaired 2026-02-17T04:06:39.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:157: TEST_truncated_sna_record: grep -a -q ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:39.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:39.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: wc -l 2026-02-17T04:06:39.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: local prev_err_cnt=1 2026-02-17T04:06:39.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:162: TEST_truncated_sna_record: echo 'prev count: 1' 2026-02-17T04:06:39.960 INFO:tasks.workunit.client.0.trial090.stdout:prev count: 1 2026-02-17T04:06:39.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:165: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-17T04:06:40.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:06:40.014 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:06:40.014 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:06:40.014 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:06:40.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:06:40.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:166: TEST_truncated_sna_record: sleep 5 2026-02-17T04:06:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:167: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-17T04:06:45.176 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-17T04:06:40.288861+0000 21'7 40:96 [1,2,0] 1 [1,2,0] 1 21'7 2026-02-17T04:06:40.288822+0000 21'7 2026-02-17T04:06:40.288822+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:06:40.288822+0000 4 0 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100499+0000 0'0 40:74 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.004140+0000 0'0 40:64 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:30.100270+0000 0'0 40:72 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:06:08.856455+0000 0'0 2026-02-17T04:06:08.856455+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:06:08.856455+0000 0 0 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:06:45.177 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:06:45.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:168: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:45.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:168: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:45.185 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:06:35.284+0000 7f5347765640 -1 log_channel(cluster) log [ERR] : osd.1 found snap mapper error on pg 1.3 oid 1:f5ae0ba1:::objxxx:3 snaps in mapper: {}, oi: {3} ...repaired 2026-02-17T04:06:45.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-17T04:06:45.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: wc -l 2026-02-17T04:06:45.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: local current_err_cnt=1 2026-02-17T04:06:45.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:170: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-17T04:06:45.188 INFO:tasks.workunit.client.0.trial090.stdout:current count: 1 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:170: TEST_truncated_sna_record: echo 'current count: 1' 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:171: TEST_truncated_sna_record: (( current_err_cnt == prev_err_cnt )) 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:172: TEST_truncated_sna_record: kill_daemons td/osd-mapper TERM osd 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:45.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:45.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:173: TEST_truncated_sna_record: kvdir=td/osd-mapper/1 2026-02-17T04:06:45.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-17T04:06:45.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-17T04:06:45.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_' 2026-02-17T04:06:45.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:175: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:45.606 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_000000000000000[0-9]_000000000000000' 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-17T04:06:45.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: wc -l 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: local num_sna_full=5 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:178: TEST_truncated_sna_record: (( num_sna_full == num_sna_b4 )) 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:179: TEST_truncated_sna_record: return 0 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:25: run: teardown td/osd-mapper 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:45.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:45.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:06:45.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:06:45.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:06:45.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:06:45.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:06:45.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:06:45.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:06:45.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:06:45.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:06:45.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:06:45.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-17T04:06:45.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:06:45.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:45.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:45.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37513 2026-02-17T04:06:45.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:06:45.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:06:45.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-mapper 0 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:45.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:45.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:45.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:06:45.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:06:45.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:06:45.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:06:45.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:06:45.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:06:45.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:06:45.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:06:45.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:06:45.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T04:06:45.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-17T04:06:45.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:06:45.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:45.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37513 2026-02-17T04:06:45.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37513 2026-02-17T04:06:45.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:06:45.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:06:45.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T04:06:45.839 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T04:06:45.839 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:06:45.903 INFO:tasks.workunit:Running workunit scrub/osd-recovery-scrub.sh... 2026-02-17T04:06:45.903 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-recovery-scrub.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh 2026-02-17T04:06:45.965 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-recovery-scrub 2026-02-17T04:06:45.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:20: run: local dir=td/osd-recovery-scrub 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:21: run: shift 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: export CEPH_MON=127.0.0.1:7124 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: CEPH_MON=127.0.0.1:7124 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:24: run: export CEPH_ARGS 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: uuidgen 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: CEPH_ARGS+='--fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none ' 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:27: run: CEPH_ARGS+='--osd-op-queue=wpq ' 2026-02-17T04:06:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:29: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:06:45.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: set 2026-02-17T04:06:45.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: local funcs=TEST_recovery_scrub_1 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:31: run: for func in $funcs 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:32: run: TEST_recovery_scrub_1 td/osd-recovery-scrub 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:39: TEST_recovery_scrub_1: local dir=td/osd-recovery-scrub 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:40: TEST_recovery_scrub_1: local poolname=test 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:42: TEST_recovery_scrub_1: TESTDATA=testdata.54249 2026-02-17T04:06:45.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:43: TEST_recovery_scrub_1: OSDS=4 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:44: TEST_recovery_scrub_1: PGS=1 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:45: TEST_recovery_scrub_1: OBJECTS=100 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:46: TEST_recovery_scrub_1: ERRORS=0 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:48: TEST_recovery_scrub_1: setup td/osd-recovery-scrub 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-recovery-scrub 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-recovery-scrub 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:06:45.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:06:45.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:06:45.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:06:45.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:06:45.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:06:45.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:06:45.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:06:45.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:06:45.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:06:45.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:06:45.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:06:45.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:06:45.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:06:45.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-17T04:06:45.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.54249 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:06:45.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-recovery-scrub 2026-02-17T04:06:45.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:06:45.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:45.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:45.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.54249 2026-02-17T04:06:45.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:06:45.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-recovery-scrub 1' TERM HUP INT 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub_1: run_mon td/osd-recovery-scrub a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-recovery-scrub 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-recovery-scrub/a 2026-02-17T04:06:45.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-recovery-scrub/a --run-dir=td/osd-recovery-scrub --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:06:46.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:06:46.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:46.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:46.001 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:46.001 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:46.001 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:46.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:46.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-recovery-scrub/a '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --mon-cluster-log-file=td/osd-recovery-scrub/log --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:06:46.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:06:46.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.54249/ceph-mon.a.asok 2026-02-17T04:06:46.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:06:46.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.54249/ceph-mon.a.asok config get fsid 2026-02-17T04:06:46.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:06:46.071 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:46.072 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:46.072 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.54249/ceph-mon.a.asok 2026-02-17T04:06:46.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:06:46.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.54249/ceph-mon.a.asok config get mon_host 2026-02-17T04:06:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:50: TEST_recovery_scrub_1: run_mgr td/osd-recovery-scrub x 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-recovery-scrub 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-recovery-scrub/x 2026-02-17T04:06:46.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:46.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:06:46.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-recovery-scrub/x '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:06:46.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:51: TEST_recovery_scrub_1: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 ' 2026-02-17T04:06:46.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:52: TEST_recovery_scrub_1: ceph_osd_args+='--osd_scrub_backoff_ratio=0 ' 2026-02-17T04:06:46.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:53: TEST_recovery_scrub_1: ceph_osd_args+='--osd_stats_update_period_not_scrubbing=3 ' 2026-02-17T04:06:46.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:54: TEST_recovery_scrub_1: ceph_osd_args+=--osd_stats_update_period_scrubbing=2 2026-02-17T04:06:46.209 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: expr 4 - 1 2026-02-17T04:06:46.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: seq 0 3 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 0 --osd_scrub_during_recovery=false 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/0 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/0' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/0/journal' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:46.212 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/0 2026-02-17T04:06:46.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:06:46.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8650daa7-1945-4315-b441-3d5e57efbcff 2026-02-17T04:06:46.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8650daa7-1945-4315-b441-3d5e57efbcff' 2026-02-17T04:06:46.214 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 8650daa7-1945-4315-b441-3d5e57efbcff 2026-02-17T04:06:46.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:06:46.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBW6ZNpK6VDDRAAzpqH+W/ZWH3uMdaQ9izdIw== 2026-02-17T04:06:46.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBW6ZNpK6VDDRAAzpqH+W/ZWH3uMdaQ9izdIw=="}' 2026-02-17T04:06:46.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8650daa7-1945-4315-b441-3d5e57efbcff -i td/osd-recovery-scrub/0/new.json 2026-02-17T04:06:46.306 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:46.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/0/new.json 2026-02-17T04:06:46.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQBW6ZNpK6VDDRAAzpqH+W/ZWH3uMdaQ9izdIw== --osd-uuid 8650daa7-1945-4315-b441-3d5e57efbcff 2026-02-17T04:06:46.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.326+0000 7f87b0416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.328+0000 7f87b0416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.330 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.328+0000 7f87b0416780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.330 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.329+0000 7f87b0416780 -1 bdev(0x3f3ec00 td/osd-recovery-scrub/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:46.330 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.329+0000 7f87b0416780 -1 bluestore(td/osd-recovery-scrub/0) _read_fsid unparsable uuid 2026-02-17T04:06:46.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/0/keyring 2026-02-17T04:06:46.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:06:46.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:06:46.801 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:06:46.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:06:46.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:06:46.886 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:06:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-17T04:06:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:06:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:06:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:06:46.901 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.899+0000 7fd1a3a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.902 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.901+0000 7fd1a3a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.903 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:46.901+0000 7fd1a3a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:46.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:46.967 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:46.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:46.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:06:47.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:47.110 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:47.108+0000 7fd1a3a11780 -1 Falling back to public interface 2026-02-17T04:06:47.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:47.411+0000 7fd1a3a11780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:06:48.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:48.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:48.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:48.046 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:06:48.125 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4220277791,v1:127.0.0.1:6801/4220277791] [v2:127.0.0.1:6802/4220277791,v1:127.0.0.1:6803/4220277791] exists,up 8650daa7-1945-4315-b441-3d5e57efbcff 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 1 --osd_scrub_during_recovery=false 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/1 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/1' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/1/journal' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/1 2026-02-17T04:06:48.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:06:48.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=40307db4-ad94-4977-aa31-daf56d4baabf 2026-02-17T04:06:48.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 40307db4-ad94-4977-aa31-daf56d4baabf' 2026-02-17T04:06:48.128 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 40307db4-ad94-4977-aa31-daf56d4baabf 2026-02-17T04:06:48.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:06:48.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBY6ZNpYMoiCBAA6bcRYu3kGWUm+9nBlcTBnQ== 2026-02-17T04:06:48.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBY6ZNpYMoiCBAA6bcRYu3kGWUm+9nBlcTBnQ=="}' 2026-02-17T04:06:48.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 40307db4-ad94-4977-aa31-daf56d4baabf -i td/osd-recovery-scrub/1/new.json 2026-02-17T04:06:48.217 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:48.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/1/new.json 2026-02-17T04:06:48.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQBY6ZNpYMoiCBAA6bcRYu3kGWUm+9nBlcTBnQ== --osd-uuid 40307db4-ad94-4977-aa31-daf56d4baabf 2026-02-17T04:06:48.241 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.239+0000 7f1dbb633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.242 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.240+0000 7f1dbb633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.243 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.241+0000 7f1dbb633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.243 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.242+0000 7f1dbb633780 -1 bdev(0x384cc00 td/osd-recovery-scrub/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:48.244 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.242+0000 7f1dbb633780 -1 bluestore(td/osd-recovery-scrub/1) _read_fsid unparsable uuid 2026-02-17T04:06:48.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/1/keyring 2026-02-17T04:06:48.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:06:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:06:48.567 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:06:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:06:48.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:06:48.775 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:06:48.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-17T04:06:48.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:06:48.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:06:48.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:06:48.789 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.788+0000 7f3b05865780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.791 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.789+0000 7f3b05865780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.792 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.790+0000 7f3b05865780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:48.926 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:48.924+0000 7f3b05865780 -1 Falling back to public interface 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:48.939 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:48.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:48.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:06:49.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:49.188 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:49.186+0000 7f3b05865780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:50.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:06:50.266 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2232128672,v1:127.0.0.1:6811/2232128672] [v2:127.0.0.1:6812/2232128672,v1:127.0.0.1:6813/2232128672] exists,up 40307db4-ad94-4977-aa31-daf56d4baabf 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 2 --osd_scrub_during_recovery=false 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/2 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:50.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/2' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/2/journal' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-17T04:06:50.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/2 2026-02-17T04:06:50.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:06:50.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0490e4af-e0ff-4d3a-a2cb-56bff1678340 2026-02-17T04:06:50.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0490e4af-e0ff-4d3a-a2cb-56bff1678340' 2026-02-17T04:06:50.271 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 0490e4af-e0ff-4d3a-a2cb-56bff1678340 2026-02-17T04:06:50.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:06:50.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBa6ZNpxNieEBAAMY0aAuJiBA5naWp5e0t0wQ== 2026-02-17T04:06:50.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBa6ZNpxNieEBAAMY0aAuJiBA5naWp5e0t0wQ=="}' 2026-02-17T04:06:50.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0490e4af-e0ff-4d3a-a2cb-56bff1678340 -i td/osd-recovery-scrub/2/new.json 2026-02-17T04:06:50.441 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:06:50.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/2/new.json 2026-02-17T04:06:50.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQBa6ZNpxNieEBAAMY0aAuJiBA5naWp5e0t0wQ== --osd-uuid 0490e4af-e0ff-4d3a-a2cb-56bff1678340 2026-02-17T04:06:50.467 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:50.465+0000 7f5834bd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:50.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:50.467+0000 7f5834bd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:50.469 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:50.468+0000 7f5834bd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:50.470 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:50.468+0000 7f5834bd6780 -1 bdev(0x2446c00 td/osd-recovery-scrub/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:50.470 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:50.468+0000 7f5834bd6780 -1 bluestore(td/osd-recovery-scrub/2) _read_fsid unparsable uuid 2026-02-17T04:06:50.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/2/keyring 2026-02-17T04:06:50.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:06:50.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:06:50.795 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:06:50.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:06:51.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:06:51.010 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:06:51.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-17T04:06:51.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:06:51.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:06:51.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:06:51.025 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:51.023+0000 7fed06a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:51.026 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:51.024+0000 7fed06a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:51.027 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:51.025+0000 7fed06a34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:51.158 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:51.156+0000 7fed06a34780 -1 Falling back to public interface 2026-02-17T04:06:51.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:06:51.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:51.495 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:51.494+0000 7fed06a34780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:06:52.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:52.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:52.346 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:52.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:52.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:52.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:06:52.512 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2544328365,v1:127.0.0.1:6819/2544328365] [v2:127.0.0.1:6820/2544328365,v1:127.0.0.1:6821/2544328365] exists,up 0490e4af-e0ff-4d3a-a2cb-56bff1678340 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 3 --osd_scrub_during_recovery=false 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/3 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/3' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/3/journal' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:06:52.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:06:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:06:52.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:06:52.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:06:52.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-17T04:06:52.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/3 2026-02-17T04:06:52.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:06:52.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3276eddf-4e03-4d68-82e9-709770846090 2026-02-17T04:06:52.516 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 3276eddf-4e03-4d68-82e9-709770846090 2026-02-17T04:06:52.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 3276eddf-4e03-4d68-82e9-709770846090' 2026-02-17T04:06:52.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:06:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBc6ZNphcBEHxAAdSfMPxTZqf5iPZ5ts3nZ7Q== 2026-02-17T04:06:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBc6ZNphcBEHxAAdSfMPxTZqf5iPZ5ts3nZ7Q=="}' 2026-02-17T04:06:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3276eddf-4e03-4d68-82e9-709770846090 -i td/osd-recovery-scrub/3/new.json 2026-02-17T04:06:52.689 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:06:52.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/3/new.json 2026-02-17T04:06:52.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQBc6ZNphcBEHxAAdSfMPxTZqf5iPZ5ts3nZ7Q== --osd-uuid 3276eddf-4e03-4d68-82e9-709770846090 2026-02-17T04:06:52.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:52.712+0000 7fefcd267780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:52.714 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:52.713+0000 7fefcd267780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:52.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:52.714+0000 7fefcd267780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:52.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:52.714+0000 7fefcd267780 -1 bdev(0x34a0c00 td/osd-recovery-scrub/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:06:52.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:52.714+0000 7fefcd267780 -1 bluestore(td/osd-recovery-scrub/3) _read_fsid unparsable uuid 2026-02-17T04:06:53.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/3/keyring 2026-02-17T04:06:53.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:06:53.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:06:53.032 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:06:53.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=5984052f-8865-4133-aa1b-13d029c75b9b --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.54249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:06:53.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:06:53.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:53.256+0000 7f6b71bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:53.259 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:53.257+0000 7f6b71bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:53.260 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:53.258+0000 7f6b71bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:06:53.408 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:06:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:06:53.423 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:53.421+0000 7f6b71bfd780 -1 Falling back to public interface 2026-02-17T04:06:53.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:06:53.679 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:06:53.678+0000 7f6b71bfd780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:06:54.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:06:54.738 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2705326939,v1:127.0.0.1:6827/2705326939] [v2:127.0.0.1:6828/2705326939,v1:127.0.0.1:6829/2705326939] exists,up 3276eddf-4e03-4d68-82e9-709770846090 2026-02-17T04:06:54.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:06:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:06:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:06:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:61: TEST_recovery_scrub_1: create_pool test 1 1 2026-02-17T04:06:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:06:54.948 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:06:54.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:06:55.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:62: TEST_recovery_scrub_1: wait_for_clean 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:06:55.957 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:06:55.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:06:55.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:06:55.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:06:56.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:06:56.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:06:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:06:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:06:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:06:56.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:06:56.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:06:56.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:06:56.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:06:56.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:06:56.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:06:56.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:06:56.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-17T04:06:56.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-17T04:06:56.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-17T04:06:56.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:06:56.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:06:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T04:06:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T04:06:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-60129542147' 2026-02-17T04:06:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:06:56.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:06:56.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378626 2026-02-17T04:06:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378626 2026-02-17T04:06:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-60129542147 3-81604378626' 2026-02-17T04:06:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:06:56.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:06:56.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:06:56.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:06:56.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:06:56.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:06:56.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:06:56.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:06:56.447 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:06:56.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:06:56.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:06:56.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:06:57.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:06:57.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:06:57.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:06:57.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:06:58.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:06:58.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:06:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:06:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:06:58.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-17T04:06:58.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:06:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:06:58.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-17T04:06:58.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:06:58.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-17T04:06:58.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T04:06:58.946 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672963 2026-02-17T04:06:58.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:06:59.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T04:06:59.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:06:59.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T04:06:59.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:06:59.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:06:59.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T04:06:59.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:06:59.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T04:06:59.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T04:06:59.115 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T04:06:59.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:06:59.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T04:06:59.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:06:59.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378626 2026-02-17T04:06:59.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:06:59.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:06:59.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378626 2026-02-17T04:06:59.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:06:59.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378626 2026-02-17T04:06:59.281 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 81604378626 2026-02-17T04:06:59.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378626' 2026-02-17T04:06:59.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:06:59.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378626 -lt 81604378626 2026-02-17T04:06:59.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:06:59.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:06:59.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:06:59.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:06:59.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:06:59.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:06:59.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:06:59.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:06:59.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:06:59.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:07:00.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:07:00.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:07:00.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: ceph osd dump 2026-02-17T04:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: grep '^pool.*['\'']test['\'']' 2026-02-17T04:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: awk '{ print $2 }' 2026-02-17T04:07:00.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: poolid=1 2026-02-17T04:07:00.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:65: TEST_recovery_scrub_1: ceph pg dump pgs 2026-02-17T04:07:00.353 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:07:00.354 INFO:tasks.workunit.client.0.trial090.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T04:06:55.363050+0000 0'0 21:9 [1] 1 [1] 1 0'0 2026-02-17T04:06:54.945957+0000 0'0 2026-02-17T04:06:54.945957+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:16:42.566776+0000 0 0 2026-02-17T04:07:00.354 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:07:00.354 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:07:00.354 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:00.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub_1: dd if=/dev/urandom of=testdata.54249 bs=1M count=50 2026-02-17T04:07:00.471 INFO:tasks.workunit.client.0.trial090.stderr:50+0 records in 2026-02-17T04:07:00.471 INFO:tasks.workunit.client.0.trial090.stderr:50+0 records out 2026-02-17T04:07:00.471 INFO:tasks.workunit.client.0.trial090.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.108817 s, 482 MB/s 2026-02-17T04:07:00.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: seq 1 100 2026-02-17T04:07:00.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj1 testdata.54249 2026-02-17T04:07:00.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj2 testdata.54249 2026-02-17T04:07:00.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj3 testdata.54249 2026-02-17T04:07:00.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj4 testdata.54249 2026-02-17T04:07:00.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj5 testdata.54249 2026-02-17T04:07:00.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj6 testdata.54249 2026-02-17T04:07:00.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj7 testdata.54249 2026-02-17T04:07:00.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj8 testdata.54249 2026-02-17T04:07:00.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:00.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj9 testdata.54249 2026-02-17T04:07:01.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj10 testdata.54249 2026-02-17T04:07:01.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj11 testdata.54249 2026-02-17T04:07:01.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj12 testdata.54249 2026-02-17T04:07:01.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj13 testdata.54249 2026-02-17T04:07:01.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj14 testdata.54249 2026-02-17T04:07:01.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj15 testdata.54249 2026-02-17T04:07:01.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj16 testdata.54249 2026-02-17T04:07:01.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj17 testdata.54249 2026-02-17T04:07:01.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj18 testdata.54249 2026-02-17T04:07:01.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj19 testdata.54249 2026-02-17T04:07:01.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj20 testdata.54249 2026-02-17T04:07:01.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj21 testdata.54249 2026-02-17T04:07:01.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj22 testdata.54249 2026-02-17T04:07:01.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj23 testdata.54249 2026-02-17T04:07:01.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj24 testdata.54249 2026-02-17T04:07:01.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj25 testdata.54249 2026-02-17T04:07:01.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:01.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj26 testdata.54249 2026-02-17T04:07:02.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj27 testdata.54249 2026-02-17T04:07:02.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj28 testdata.54249 2026-02-17T04:07:02.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj29 testdata.54249 2026-02-17T04:07:02.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj30 testdata.54249 2026-02-17T04:07:02.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj31 testdata.54249 2026-02-17T04:07:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj32 testdata.54249 2026-02-17T04:07:02.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj33 testdata.54249 2026-02-17T04:07:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj34 testdata.54249 2026-02-17T04:07:02.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj35 testdata.54249 2026-02-17T04:07:02.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj36 testdata.54249 2026-02-17T04:07:02.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj37 testdata.54249 2026-02-17T04:07:02.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj38 testdata.54249 2026-02-17T04:07:02.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj39 testdata.54249 2026-02-17T04:07:02.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj40 testdata.54249 2026-02-17T04:07:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj41 testdata.54249 2026-02-17T04:07:02.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:02.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj42 testdata.54249 2026-02-17T04:07:03.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj43 testdata.54249 2026-02-17T04:07:03.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj44 testdata.54249 2026-02-17T04:07:03.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj45 testdata.54249 2026-02-17T04:07:03.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj46 testdata.54249 2026-02-17T04:07:03.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj47 testdata.54249 2026-02-17T04:07:03.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj48 testdata.54249 2026-02-17T04:07:03.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj49 testdata.54249 2026-02-17T04:07:03.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj50 testdata.54249 2026-02-17T04:07:03.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj51 testdata.54249 2026-02-17T04:07:03.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj52 testdata.54249 2026-02-17T04:07:03.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj53 testdata.54249 2026-02-17T04:07:03.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj54 testdata.54249 2026-02-17T04:07:03.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj55 testdata.54249 2026-02-17T04:07:03.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj56 testdata.54249 2026-02-17T04:07:03.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj57 testdata.54249 2026-02-17T04:07:03.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj58 testdata.54249 2026-02-17T04:07:03.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:03.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj59 testdata.54249 2026-02-17T04:07:04.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj60 testdata.54249 2026-02-17T04:07:04.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj61 testdata.54249 2026-02-17T04:07:04.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj62 testdata.54249 2026-02-17T04:07:04.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj63 testdata.54249 2026-02-17T04:07:04.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj64 testdata.54249 2026-02-17T04:07:04.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj65 testdata.54249 2026-02-17T04:07:04.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj66 testdata.54249 2026-02-17T04:07:04.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj67 testdata.54249 2026-02-17T04:07:04.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj68 testdata.54249 2026-02-17T04:07:04.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj69 testdata.54249 2026-02-17T04:07:04.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj70 testdata.54249 2026-02-17T04:07:04.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj71 testdata.54249 2026-02-17T04:07:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj72 testdata.54249 2026-02-17T04:07:04.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj73 testdata.54249 2026-02-17T04:07:04.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:04.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj74 testdata.54249 2026-02-17T04:07:05.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj75 testdata.54249 2026-02-17T04:07:05.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj76 testdata.54249 2026-02-17T04:07:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj77 testdata.54249 2026-02-17T04:07:05.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj78 testdata.54249 2026-02-17T04:07:05.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj79 testdata.54249 2026-02-17T04:07:05.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj80 testdata.54249 2026-02-17T04:07:05.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj81 testdata.54249 2026-02-17T04:07:05.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj82 testdata.54249 2026-02-17T04:07:05.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj83 testdata.54249 2026-02-17T04:07:05.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj84 testdata.54249 2026-02-17T04:07:05.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj85 testdata.54249 2026-02-17T04:07:05.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj86 testdata.54249 2026-02-17T04:07:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj87 testdata.54249 2026-02-17T04:07:05.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj88 testdata.54249 2026-02-17T04:07:05.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj89 testdata.54249 2026-02-17T04:07:05.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:05.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj90 testdata.54249 2026-02-17T04:07:06.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj91 testdata.54249 2026-02-17T04:07:06.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj92 testdata.54249 2026-02-17T04:07:06.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj93 testdata.54249 2026-02-17T04:07:06.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj94 testdata.54249 2026-02-17T04:07:06.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj95 testdata.54249 2026-02-17T04:07:06.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj96 testdata.54249 2026-02-17T04:07:06.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj97 testdata.54249 2026-02-17T04:07:06.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj98 testdata.54249 2026-02-17T04:07:06.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj99 testdata.54249 2026-02-17T04:07:06.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-17T04:07:06.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj100 testdata.54249 2026-02-17T04:07:06.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:72: TEST_recovery_scrub_1: rm -f testdata.54249 2026-02-17T04:07:06.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:74: TEST_recovery_scrub_1: ceph osd pool set test size 4 2026-02-17T04:07:06.898 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 4 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:77: TEST_recovery_scrub_1: set -o pipefail 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:78: TEST_recovery_scrub_1: count=0 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-17T04:07:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-17T04:07:07.066 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-17T04:07:09.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 0 -eq 10 2026-02-17T04:07:09.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 0 + 1 2026-02-17T04:07:09.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=1 2026-02-17T04:07:09.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-17T04:07:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-17T04:07:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-17T04:07:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-17T04:07:09.239 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:09.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-17T04:07:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 1 -eq 10 2026-02-17T04:07:11.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 1 + 1 2026-02-17T04:07:11.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=2 2026-02-17T04:07:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-17T04:07:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-17T04:07:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-17T04:07:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-17T04:07:11.414 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:11.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-17T04:07:13.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 2 -eq 10 2026-02-17T04:07:13.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 2 + 1 2026-02-17T04:07:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=3 2026-02-17T04:07:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-17T04:07:13.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-17T04:07:13.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-17T04:07:13.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-17T04:07:13.590 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:13.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:84: TEST_recovery_scrub_1: break 2026-02-17T04:07:13.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:94: TEST_recovery_scrub_1: set +o pipefail 2026-02-17T04:07:13.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub_1: ceph pg dump pgs 2026-02-17T04:07:13.763 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:07:13.763 INFO:tasks.workunit.client.0.trial090.stdout:1.0 100 0 258 0 0 5242880000 0 0 1300 0 1300 active+recovering+undersized+degraded+remapped 2026-02-17T04:07:07.395821+0000 22'1300 25:1379 [1,0,2,3] 1 [1,0] 1 0'0 2026-02-17T04:06:54.945957+0000 0'0 2026-02-17T04:06:54.945957+0000 0 0 no scrub is scheduled 0 0 2026-02-17T04:07:13.763 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:07:13.763 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:07:13.763 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:13.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub_1: sleep 10 2026-02-17T04:07:23.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:99: TEST_recovery_scrub_1: kill_daemons td/osd-recovery-scrub 2026-02-17T04:07:23.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:07:23.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:07:23.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:07:23.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:07:23.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:07:29.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:07:29.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:101: TEST_recovery_scrub_1: declare -a err_strings 2026-02-17T04:07:29.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub_1: err_strings[0]='recovery in progress.*scrubs' 2026-02-17T04:07:29.088 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: expr 4 - 1 2026-02-17T04:07:29.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: seq 0 3 2026-02-17T04:07:29.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.0.log 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:07.561+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:08.592+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:09.564+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:10.558+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:11.556+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.095 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:12.543+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:13.592+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:14.577+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:15.567+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:16.611+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:17.566+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:18.540+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:19.541+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:20.496+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.096 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:21.498+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:22.458+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:23.412+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:24.450+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:25.419+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:26.414+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:27.395+0000 7fd19c5f2640 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.1.log 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:08.384+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:09.376+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:10.335+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:11.310+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:12.314+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:13.337+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.107 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:14.299+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:15.290+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:16.323+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:17.299+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:18.254+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:19.259+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:20.276+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:21.274+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:22.284+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:23.252+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:24.240+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:25.265+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:26.314+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.108 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:27.341+0000 7f3afe335640 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.2.log 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:07.664+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:08.676+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:09.706+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:10.724+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:11.705+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:12.747+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.111 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:13.723+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:14.708+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:15.672+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:16.716+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:17.708+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:18.716+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:19.765+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:20.799+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:21.775+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:22.797+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:23.767+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:24.806+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:25.846+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.112 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:26.851+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.113 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:27.896+0000 7fecff1f2640 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.3.log 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:07.547+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:08.503+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:09.507+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:10.478+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:11.430+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:12.406+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:13.376+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:14.335+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:15.338+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:16.294+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.115 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:17.340+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:18.300+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:19.252+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:20.277+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:21.300+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:22.332+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:23.362+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:24.388+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:25.374+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:26.343+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.116 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:07:27.385+0000 7f6b6a9e1640 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-17T04:07:29.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:108: TEST_recovery_scrub_1: for err_string in "${err_strings[@]}" 2026-02-17T04:07:29.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:110: TEST_recovery_scrub_1: found=false 2026-02-17T04:07:29.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:111: TEST_recovery_scrub_1: count=0 2026-02-17T04:07:29.118 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: expr 4 - 1 2026-02-17T04:07:29.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: seq 0 3 2026-02-17T04:07:29.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.0.log 2026-02-17T04:07:29.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-17T04:07:29.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 0 + 1 2026-02-17T04:07:29.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=1 2026-02-17T04:07:29.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.1.log 2026-02-17T04:07:29.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-17T04:07:29.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 1 + 1 2026-02-17T04:07:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=2 2026-02-17T04:07:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.2.log 2026-02-17T04:07:29.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-17T04:07:29.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 2 + 1 2026-02-17T04:07:29.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=3 2026-02-17T04:07:29.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:07:29.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.3.log 2026-02-17T04:07:29.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-17T04:07:29.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 3 + 1 2026-02-17T04:07:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=4 2026-02-17T04:07:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:120: TEST_recovery_scrub_1: '[' true = false ']' 2026-02-17T04:07:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:124: TEST_recovery_scrub_1: '[' 4 -eq 4 ']' 2026-02-17T04:07:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:127: TEST_recovery_scrub_1: teardown td/osd-recovery-scrub 2026-02-17T04:07:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:07:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:07:29.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:07:29.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:07:29.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:07:29.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:07:29.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:07:29.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:07:29.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:07:29.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:07:29.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:07:29.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:07:29.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:07:29.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-17T04:07:29.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:07:29.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:07:29.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:07:29.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.54249 2026-02-17T04:07:29.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:07:29.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:07:29.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:129: TEST_recovery_scrub_1: '[' 0 '!=' 0 ']' 2026-02-17T04:07:29.185 INFO:tasks.workunit.client.0.trial090.stdout:TEST PASSED 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:135: TEST_recovery_scrub_1: echo 'TEST PASSED' 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:136: TEST_recovery_scrub_1: return 0 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-recovery-scrub 0 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T04:07:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:07:29.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:07:29.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:07:29.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:07:29.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:07:29.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:07:29.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:07:29.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:07:29.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:07:29.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:07:29.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:07:29.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T04:07:29.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-17T04:07:29.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:07:29.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:07:29.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.54249 2026-02-17T04:07:29.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.54249 2026-02-17T04:07:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:07:29.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:07:29.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T04:07:29.196 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T04:07:29.196 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:07:29.260 INFO:tasks.workunit:Running workunit scrub/osd-scrub-dump.sh... 2026-02-17T04:07:29.261 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-scrub-dump.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh 2026-02-17T04:07:29.322 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:07:29.327 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:07:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:07:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:07:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:07:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-dump 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:23: run: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:24: run: shift 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:26: run: export CEPH_MON=127.0.0.1:7138 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:26: run: CEPH_MON=127.0.0.1:7138 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:27: run: export CEPH_ARGS 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:28: run: uuidgen 2026-02-17T04:07:29.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:28: run: CEPH_ARGS+='--fsid=9e8c0cb5-927f-4999-b4e5-ce8590b7d887 --auth-supported=none ' 2026-02-17T04:07:29.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:29: run: CEPH_ARGS+='--mon-host=127.0.0.1:7138 --osd_op_queue=wpq ' 2026-02-17T04:07:29.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:31: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:07:29.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: set 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: local 'funcs=TEST_rmobj_1 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_large_objects 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_large_objects_2 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_large_objects_2b 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_large_objects_3 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_measurements_basic_1 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_measurements_basic_2 2026-02-17T04:07:29.330 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_measurements_basic_2b 2026-02-17T04:07:29.331 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_measurements_basic_2c 2026-02-17T04:07:29.331 INFO:tasks.workunit.client.0.trial090.stderr:TEST_time_measurements_basic_3' 2026-02-17T04:07:29.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:33: run: for func in $funcs 2026-02-17T04:07:29.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:34: run: echo '-------------- Prepare Test TEST_rmobj_1 -------------------' 2026-02-17T04:07:29.331 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_rmobj_1 ------------------- 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:35: run: setup td/osd-scrub-dump 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-dump 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:07:29.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-dump KILL 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:07:29.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:07:29.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:07:29.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:07:29.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:07:29.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-dump 2026-02-17T04:07:29.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:07:29.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:07:29.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.63326 2026-02-17T04:07:29.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.63326 2026-02-17T04:07:29.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:07:29.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:07:29.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-dump 2026-02-17T04:07:29.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:07:29.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:07:29.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.63326 2026-02-17T04:07:29.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.63326 2026-02-17T04:07:29.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:07:29.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:07:29.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:07:29.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:07:29.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-dump 1' TERM HUP INT 2026-02-17T04:07:29.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:36: run: echo '-------------- Run Test TEST_rmobj_1 -----------------------' 2026-02-17T04:07:29.342 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_rmobj_1 ----------------------- 2026-02-17T04:07:29.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:37: run: TEST_rmobj_1 td/osd-scrub-dump 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:667: TEST_rmobj_1: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test' ['pool_default_size']='3' ['msg']='rm1' ['objects_per_pg']='16' ['modify_as_prim_cnt']='2' ['modify_as_repl_cnt']='2' ['manipulations']='rm_object') 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:667: TEST_rmobj_1: local -A cluster_conf 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:678: TEST_rmobj_1: corrupt_and_measure td/osd-scrub-dump cluster_conf rmobj_1 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:380: corrupt_and_measure: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:381: corrupt_and_measure: local -n alargs=cluster_conf 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:382: corrupt_and_measure: local test_name=rmobj_1 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:384: corrupt_and_measure: local OSDS=3 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:385: corrupt_and_measure: local PGS=4 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:386: corrupt_and_measure: local OBJS_PER_PG=16 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:387: corrupt_and_measure: local OBJECT_SIZE=256 2026-02-17T04:07:29.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:388: corrupt_and_measure: local modify_as_prim_cnt=2 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:389: corrupt_and_measure: local modify_as_repl_cnt=2 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:390: corrupt_and_measure: local stride_override=0 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:392: corrupt_and_measure: local objects=64 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:394: corrupt_and_measure: '[' 4 -gt 64 ']' 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:399: corrupt_and_measure: local extr_dbg=2 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:401: corrupt_and_measure: standard_scrub_wpq_cluster td/osd-scrub-dump alargs 0 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:302: standard_scrub_wpq_cluster: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:303: standard_scrub_wpq_cluster: local -n conf=alargs 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:304: standard_scrub_wpq_cluster: local osd_sleep=0 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:306: standard_scrub_wpq_cluster: conf['extras']=' --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:308: standard_scrub_wpq_cluster: standard_scrub_cluster td/osd-scrub-dump conf 2026-02-17T04:07:29.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-dump 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=conf 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=rm1 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:07:29.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:07:29.580 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 9a45cb85-74c4-423d-8baf-0ab4fc67610b 2026-02-17T04:07:29.668 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:07:29.696 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:29.693+0000 7f5842451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:29.697 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:29.694+0000 7f5842451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:29.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:29.695+0000 7f5842451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:29.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:29.696+0000 7f5842451780 -1 bdev(0x2bf0c00 td/osd-scrub-dump/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:07:29.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:29.696+0000 7f5842451780 -1 bluestore(td/osd-scrub-dump/0) _read_fsid unparsable uuid 2026-02-17T04:07:30.135 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:07:30.217 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:07:30.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:30.234+0000 7f9d607d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:30.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:30.236+0000 7f9d607d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:30.239 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:30.237+0000 7f9d607d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:30.297 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:07:30.453 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:30.451+0000 7f9d607d6780 -1 Falling back to public interface 2026-02-17T04:07:30.766 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:30.763+0000 7f9d607d6780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:07:31.377 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:31.456 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2867913241,v1:127.0.0.1:6801/2867913241] [v2:127.0.0.1:6802/2867913241,v1:127.0.0.1:6803/2867913241] exists,up 9a45cb85-74c4-423d-8baf-0ab4fc67610b 2026-02-17T04:07:31.461 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 d26028aa-f281-433f-9bbd-429459985981 2026-02-17T04:07:31.552 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:31.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:31.577+0000 7f3eca5fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:31.581 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:31.579+0000 7f3eca5fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:31.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:31.580+0000 7f3eca5fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:31.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:31.580+0000 7f3eca5fd780 -1 bdev(0x3740c00 td/osd-scrub-dump/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:07:31.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:31.580+0000 7f3eca5fd780 -1 bluestore(td/osd-scrub-dump/1) _read_fsid unparsable uuid 2026-02-17T04:07:31.921 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:07:32.141 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:07:32.161 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:32.158+0000 7f61fa867780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:32.162 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:32.159+0000 7f61fa867780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:32.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:32.160+0000 7f61fa867780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:32.295 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:32.292+0000 7f61fa867780 -1 Falling back to public interface 2026-02-17T04:07:32.304 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:07:32.619 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:32.616+0000 7f61fa867780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:07:33.473 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:33.637 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/278319783,v1:127.0.0.1:6811/278319783] [v2:127.0.0.1:6812/278319783,v1:127.0.0.1:6813/278319783] exists,up d26028aa-f281-433f-9bbd-429459985981 2026-02-17T04:07:33.641 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 c9222d88-165f-4279-a1dd-0dc00bd795c6 2026-02-17T04:07:33.818 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:07:33.847 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:33.845+0000 7f10d2dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:33.849 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:33.846+0000 7f10d2dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:33.849 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:33.847+0000 7f10d2dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:33.850 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:33.847+0000 7f10d2dc6780 -1 bdev(0x359ec00 td/osd-scrub-dump/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:07:33.850 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:33.847+0000 7f10d2dc6780 -1 bluestore(td/osd-scrub-dump/2) _read_fsid unparsable uuid 2026-02-17T04:07:34.168 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:07:34.378 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:07:34.397 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:34.395+0000 7f5d42813780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:34.399 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:34.396+0000 7f5d42813780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:34.400 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:34.397+0000 7f5d42813780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:07:34.542 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:07:34.560 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:34.557+0000 7f5d42813780 -1 Falling back to public interface 2026-02-17T04:07:34.836 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:07:34.833+0000 7f5d42813780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:07:35.706 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:35.872 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2206868952,v1:127.0.0.1:6819/2206868952] [v2:127.0.0.1:6820/2206868952,v1:127.0.0.1:6821/2206868952] exists,up c9222d88-165f-4279-a1dd-0dc00bd795c6 2026-02-17T04:07:36.086 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:07:37.533 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:07:37.700 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:07:37.869 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574851 2026-02-17T04:07:39.782 INFO:tasks.workunit.client.0.trial090.stdout:standard_scrub_cluster: rm1: test pool is test 1 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:402: corrupt_and_measure: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:403: corrupt_and_measure: echo --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:403: corrupt_and_measure: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0' 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:405: corrupt_and_measure: local poolid=1 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:406: corrupt_and_measure: local poolname=test 2026-02-17T04:07:39.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:07:39.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:07:39.784 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:07:39.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:07:39.989 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:07:40.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:07:40.194 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:07:40.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:07:40.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:07:40.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 256 4 2026-02-17T04:07:40.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:07:40.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301260202289031 2026-02-17T04:07:40.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:07:40.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:07:40.204 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:07:40.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.oWewTMyKUr bs=256 count=1 2026-02-17T04:07:40.207 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:07:40.207 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:07:40.207 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 6.6253e-05 s, 3.9 MB/s 2026-02-17T04:07:40.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:07:40.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:07:40.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:07:40.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:07:40.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:07:40.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.oWewTMyKUr 2026-02-17T04:07:40.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:07:40.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301260510294264 2026-02-17T04:07:40.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=308 2026-02-17T04:07:40.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 308 ms' 2026-02-17T04:07:40.512 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 64 objects in pool test in 308 ms 2026-02-17T04:07:40.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:07:40.512 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:07:40.511483468 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:07:40.511483468' 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:07:40.514 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:07:40.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:07:40.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:07:40.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:07:40.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:07:40.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:07:40.759 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:07:40.759 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:07:40.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:07:40.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:07:40.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:07:40.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:07:40.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:07:40.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:07:40.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:07:40.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:07:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:07:40.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:07:40.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T04:07:40.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:07:40.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:07:40.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-17T04:07:40.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-17T04:07:40.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-55834574855' 2026-02-17T04:07:40.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:07:40.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:07:40.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:07:40.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:07:40.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:07:40.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:07:40.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:07:40.936 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:07:40.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:07:40.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:07:41.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-17T04:07:41.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:07:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:07:42.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:07:42.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:07:42.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:07:42.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:07:42.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:07:42.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:07:42.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:07:42.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:07:42.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:07:42.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:07:42.280 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T04:07:42.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:07:42.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:07:42.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:07:42.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-17T04:07:42.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:07:42.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:07:42.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-17T04:07:42.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:07:42.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-17T04:07:42.446 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574855 2026-02-17T04:07:42.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-17T04:07:42.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:07:42.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-17T04:07:42.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:07:42.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:07:42.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:07:42.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:07:42.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:07:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:07:42.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:07:42.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:07:43.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:07:43.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:07:43.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:07:43.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:07:43.346 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:07:43.346 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:07:43.346 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:07:43.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:07:43.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:07:48.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:36.191441+0000 18'14 18:33 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:36.191607+0000 18'14 18:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:07:36.191256+0000 18'19 18:41 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:07:36.191347+0000 18'17 18:38 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:07:48.510 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:07:48.511 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:07:48.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:07:48.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:07:48.518 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:07:48.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:07:48.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:07:48.578 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:07:48.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:07:48.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:07:48.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:07:48.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:07:48.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:07:48.639379099' 2026-02-17T04:07:48.640 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:07:48.639379099 2026-02-17T04:07:48.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:07:48.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301268640435267 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:07:48.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:07:48.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:07:49.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:07:49.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301269754493862 2026-02-17T04:07:49.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:07:49.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:07:49.755564427 (1114 ms)' 2026-02-17T04:07:49.757 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:07:49.755564427 (1114 ms) 2026-02-17T04:07:49.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=4 2026-02-17T04:07:49.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:07:49.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:07:49.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 4 2026-02-17T04:07:49.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 4' 2026-02-17T04:07:49.759 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 4 2026-02-17T04:07:49.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.760 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj10 2026-02-17T04:07:49.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj10' 2026-02-17T04:07:49.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.761 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 64 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-17T04:07:49.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.763 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj10 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj10' 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj10 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj10 ' 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.764 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj42 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj42' 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj42 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj42 ' 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=2 )) 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-17T04:07:49.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj59 2026-02-17T04:07:49.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj59: acting: 2 0 1' 2026-02-17T04:07:49.767 INFO:tasks.workunit.client.0.trial090.stdout:Object obj59: acting: 2 0 1 2026-02-17T04:07:49.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:07:49.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:07:49.768 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:49.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:07:49.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.769 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj59 (2) 0 1 2 2026-02-17T04:07:49.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj59 (2) 0 1 2' 2026-02-17T04:07:49.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:07:49.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:07:49.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.770 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj59 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj59' 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj59 ' 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj13 2026-02-17T04:07:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.772 INFO:tasks.workunit.client.0.trial090.stdout:Object obj13: acting: 2 0 1 2026-02-17T04:07:49.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj13: acting: 2 0 1' 2026-02-17T04:07:49.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:07:49.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:07:49.773 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:07:49.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:07:49.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj13 (3) 0 1 2' 2026-02-17T04:07:49.774 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj13 (3) 0 1 2 2026-02-17T04:07:49.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:07:49.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:07:49.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:07:49.775 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj13 2026-02-17T04:07:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj13' 2026-02-17T04:07:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj13 ' 2026-02-17T04:07:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:07:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-17T04:07:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:07:49.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:07:49.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:07:49.816 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:07:49.816 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:07:49.817 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:07:49.824 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:07:49.824 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:07:49.824 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:07:49.832 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:07:49.832 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:07:49.832 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:07:49.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:07:49.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:07:49.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:07:49.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:07:49.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:07:49.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:07:50.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:07:50.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:07:51.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:07:51.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:07:51.150 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj59 2026-02-17T04:07:51.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj59 ' 2026-02-17T04:07:51.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:07:51.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:07:51.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj59 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj59 2026-02-17T04:07:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj59 remove 2026-02-17T04:07:51.241 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:b70eecc2:::obj59:head# 2026-02-17T04:07:51.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:07:51.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:07:51.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:07:51.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:07:51.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:07:51.288 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj10 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj10 ' 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:07:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj10 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj10 2026-02-17T04:07:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj10 remove 2026-02-17T04:07:51.381 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:d1337354:::obj10:head# 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj13 ' obj_to_pgid rm_object 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj13 ' 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=rm_object 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj13 ]] 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:07:51.432 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj13 2026-02-17T04:07:51.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj13 ' 2026-02-17T04:07:51.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:07:51.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:07:51.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj13 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj13 2026-02-17T04:07:51.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj13 remove 2026-02-17T04:07:51.511 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:a61ad63e:::obj13:head# 2026-02-17T04:07:51.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj42 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj42 ' 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:07:51.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj42 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj42 2026-02-17T04:07:51.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj42 remove 2026-02-17T04:07:51.647 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:a25cd2bd:::obj42:head# 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 '' obj_to_pgid rm_object 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=rm_object 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:07:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:08:02.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:08:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:55.356185+0000 18'14 31:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:55.355899+0000 18'14 31:69 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:07:55.355965+0000 18'19 31:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:07:55.356104+0000 18'17 31:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:07.849 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:07.850 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:08:07.850 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:08:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:07.856 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:08:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:08:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:08:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:08:07.914 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:08:07.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:08:07.969 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:07.969 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:08:07.969 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:07.977 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:07.977 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:08:07.977 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:07.984 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:07.985 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:08:07.985 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:07.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:08:08.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:08:08.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301288992351881 2026-02-17T04:08:08.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:08:08.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:08:08.993772084' 2026-02-17T04:08:08.995 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:08:08.993772084 2026-02-17T04:08:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:08:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:08:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:08:09.155 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:08:09.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:08:09.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301289165696564 2026-02-17T04:08:09.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:08:09.167 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:08:09.166721374 (173 ms) 2026-02-17T04:08:09.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:08:09.166721374 (173 ms)' 2026-02-17T04:08:09.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:09.168 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:08:09.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:08:09.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:09.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:08:09.170 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:08:09.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.170 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:08:09.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:09.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:08:09.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:09.172 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:08:09.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:08:09.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:09.172 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:08:09.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:08:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:08:09.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:08:09.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:55.356185+0000 18'14 31:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:55.355899+0000 18'14 31:69 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:07:55.355965+0000 18'19 31:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:07:55.356104+0000 18'17 31:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:09.484 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:09.485 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:08:09.485 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:08:09.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:08:09.544 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:09.544 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:09.544 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.552 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:09.552 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:09.552 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.560 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:09.561 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:09.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:08:09.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301289566254738 2026-02-17T04:08:09.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:09.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:08:09.568 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:08:09.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:08:09.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:09.621 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:08:09.621 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:08:09.621 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:08:09.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:09.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:08:09.625 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:08:09.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:08:09.676 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:09.677 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:08:09.677 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:08:09.677 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:08:09.677 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:09.681 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:08:09.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:08:09.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:08:09.733 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:09.733 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:08:09.733 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:08:09.733 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:08:09.734 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:09.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:09.738 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:08:09.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:08:09.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:08:09.793 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:09.793 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:08:09.793 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:08:09.793 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:08:09.793 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:08:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:08:09.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:08:09.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:08:09.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301289959959085 2026-02-17T04:08:09.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=393 2026-02-17T04:08:09.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:08:10.015 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:10.015 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:10.015 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:10.023 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:10.023 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:10.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:10.030 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:10.030 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:10.030 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:10.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:08:12.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:08:12.196 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:08:12.196 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:07:55.356185+0000 18'14 31:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:07:36.084190+0000 0'0 2026-02-17T04:07:36.084190+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:07:36.084190+0000 0 0 2026-02-17T04:08:12.196 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:08:10.336672+0000 18'14 31:80 [0,1,2] 0 [0,1,2] 0 18'14 2026-02-17T04:08:10.336646+0000 18'14 2026-02-17T04:08:10.336646+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:10.336646+0000 14 0 2026-02-17T04:08:12.196 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean+inconsistent 2026-02-17T04:08:10.120920+0000 18'19 31:70 [2,0,1] 2 [2,0,1] 2 18'19 2026-02-17T04:08:10.120874+0000 18'19 2026-02-17T04:08:10.120874+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:10.120874+0000 18 0 2026-02-17T04:08:12.196 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:08:10.491369+0000 18'17 31:77 [1,0,2] 1 [1,0,2] 1 18'17 2026-02-17T04:08:10.491339+0000 18'17 2026-02-17T04:08:10.491339+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:10.491339+0000 17 0 2026-02-17T04:08:12.197 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:12.197 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:08:12.197 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:08:12.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' rmobj_1 3 4 16 2 2 256 4194304 0 393 2026-02-17T04:08:12.203 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ rmobj_1@ NAUT 3 4 16 2/ 2 256 4194304/ 0 393 2026-02-17T04:08:12.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:12.204 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:08:12.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:08:12.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:08:12.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:08:12.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:08:12.219 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:08:12.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:12.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:08:12.220 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:08:12.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:08:12.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:08:12.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:08:12.236 INFO:tasks.workunit.client.0.trial090.stdout:224 2026-02-17T04:08:12.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:12.237 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:08:12.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:08:12.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:08:12.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:08:12.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:08:12.254 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:08:12.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:12.254 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:08:12.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:08:12.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:08:12.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:08:12.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:08:12.271 INFO:tasks.workunit.client.0.trial090.stdout:78 2026-02-17T04:08:12.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:08:12.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:08:17.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:08:17.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:08:17.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:08:17.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:08:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:08:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:08:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:08:17.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:08:17.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:08:17.978 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:17.979 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:17.979 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:17.986 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:17.987 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:17.987 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:17.994 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:17.994 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:17.994 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:18.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:08:18.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301298001447447 2026-02-17T04:08:18.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:18.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:08:18.156 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:08:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:08:18.323 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:08:18.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:18.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:08:18.485 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:08:18.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:08:18.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:08:18.645 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:08:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:08:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:08:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:08:18.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:08:18.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:08:18.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:08:18.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:08:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:08:18.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:08:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301298820638993 2026-02-17T04:08:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=819 2026-02-17T04:08:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:08:18.876 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:18.876 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:18.876 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:18.884 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:18.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:18.892 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:18.892 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:08:18.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:18.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:08:23.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:08:19.412185+0000 18'14 31:90 [1,2,0] 1 [1,2,0] 1 18'14 2026-02-17T04:08:19.411077+0000 18'14 2026-02-17T04:08:19.411077+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:19.411077+0000 13 0 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:08:19.359717+0000 18'14 31:94 [0,1,2] 0 [0,1,2] 0 18'14 2026-02-17T04:08:19.359685+0000 18'14 2026-02-17T04:08:19.359685+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:19.359685+0000 14 0 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:08:19.277351+0000 18'19 31:97 [2,0,1] 2 [2,0,1] 2 18'19 2026-02-17T04:08:19.274616+0000 18'19 2026-02-17T04:08:19.274616+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:19.274616+0000 18 0 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:08:18.410969+0000 18'17 31:96 [1,0,2] 1 [1,0,2] 1 18'17 2026-02-17T04:08:18.410930+0000 18'17 2026-02-17T04:08:18.410930+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:08:18.410930+0000 17 0 2026-02-17T04:08:24.056 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:24.057 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:08:24.057 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:08:24.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' rmobj_1 3 4 16 2 2 256 4194304 0 819 2026-02-17T04:08:24.064 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ rmobj_1@ REPR 3 4 16 2/ 2 256 4194304/ 0 819 2026-02-17T04:08:24.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:08:24.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:08:24.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:08:24.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0408 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:08:24.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.150 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.151 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.152 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.153 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.154 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.155 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.156 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.157 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "value": 32256 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.007999865, 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999932 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.162 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.165 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.167 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.170 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.171 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.174 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 32256 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.007999865, 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999932 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.182 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.183 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:24.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.198 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 14, 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.199 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.200 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 124 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 124 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 124 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 124 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 124 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 31744 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.015999725, 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999931 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.204 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.205 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.206 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.207 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.208 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:24.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.210 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 14, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.211 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 124 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 124 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 124 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 124 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 124 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 31744 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.015999725, 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999931 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.218 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:24.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.257 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 8, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.258 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.259 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 126 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 32256 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.011999798, 2026-02-17T04:08:24.261 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.005999899 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 8, 2026-02-17T04:08:24.267 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:24.268 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.269 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 126 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 32256 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:24.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.011999798, 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.005999899 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:24.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.273 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:24.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:31.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:08:31.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.909 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.910 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 9, 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.911 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.912 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.913 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.914 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.915 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.916 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "value": 48640 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.917 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.918 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.010999814, 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003666604 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.919 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.920 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.921 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.922 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.923 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.924 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.925 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:31.926 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.927 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.928 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.929 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 9, 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.930 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.931 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.932 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:31.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "value": 48640 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.934 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.010999814, 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003666604 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:31.935 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.936 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.937 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:31.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:31.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:31.952 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:31.952 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 21, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.953 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.954 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 188 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 188 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 188 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 188 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 188 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:31.955 INFO:tasks.workunit.client.0.trial090.stderr: "value": 48128 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.024999571, 2026-02-17T04:08:31.956 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.004166595 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.957 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:31.958 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.959 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.960 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.961 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 21, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.962 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": 188 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": 188 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout: "value": 188 2026-02-17T04:08:31.963 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 188 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 188 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 48128 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:08:31.964 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.024999571, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.004166595 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.965 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.966 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.967 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:31.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:31.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:31.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:32.001 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 12, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:08:32.002 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 190 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 48640 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.017999696, 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.005999898 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.004 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.005 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.008 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 12, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:08:32.009 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 190 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout: "value": 48640 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.010 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.017999696, 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.005999898 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.011 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.012 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:08:32.013 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.014 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:08:32.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:08:42.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:08:42.600 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:08:42.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:08:42.809 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:08:42.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:08:43.013 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:08:43.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:08:43.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:08:43.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 1048576 4 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=1048576 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:08:43.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:08:43.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301323021708406 2026-02-17T04:08:43.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 1048576 2026-02-17T04:08:43.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1048576 2026-02-17T04:08:43.024 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:08:43.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.ndQGmk0K1i bs=1048576 count=1 2026-02-17T04:08:43.028 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:08:43.028 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:08:43.028 INFO:tasks.workunit.client.0.trial090.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00292541 s, 358 MB/s 2026-02-17T04:08:43.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:08:43.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:08:43.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:08:43.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:08:43.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:08:43.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:08:43.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.ndQGmk0K1i 2026-02-17T04:08:43.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:08:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301323863184055 2026-02-17T04:08:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=841 2026-02-17T04:08:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 841 ms' 2026-02-17T04:08:43.865 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 128 objects in pool test in 841 ms 2026-02-17T04:08:43.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:08:43.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:08:43.864347833' 2026-02-17T04:08:43.866 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:08:43.864347833 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:08:43.867 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:08:43.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:08:43.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:08:43.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:08:43.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:08:44.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:08:44.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:08:44.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:08:44.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:08:44.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:08:44.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:08:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672971 2026-02-17T04:08:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672971 2026-02-17T04:08:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672971' 2026-02-17T04:08:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:08:44.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:08:44.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509448 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509448 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672971 2-64424509448' 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:08:44.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:08:44.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:08:44.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:08:44.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:08:44.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:08:44.296 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:08:44.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:08:44.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-17T04:08:44.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:08:45.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:08:45.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:08:45.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:08:45.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:08:45.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672971 2026-02-17T04:08:45.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:08:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:08:45.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672971 2026-02-17T04:08:45.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:08:45.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672971 2026-02-17T04:08:45.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-17T04:08:45.625 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672971 2026-02-17T04:08:45.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:08:45.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672971 -lt 42949672971 2026-02-17T04:08:45.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:08:45.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509448 2026-02-17T04:08:45.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:08:45.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:08:45.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509448 2026-02-17T04:08:45.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:08:45.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509448 2026-02-17T04:08:45.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2026-02-17T04:08:45.796 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509448 2026-02-17T04:08:45.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:08:45.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509448 -lt 64424509448 2026-02-17T04:08:45.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:08:45.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:08:45.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:08:46.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:08:46.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:08:46.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:08:46.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:08:46.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:08:46.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:08:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:08:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:08:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:08:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:08:46.699 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:08:46.699 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:08:46.699 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:46.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:08:46.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:08:51.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:08:51.867 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:08:51.867 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:08:39.100295+0000 22'14 22:36 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-17T04:08:39.100190+0000 22'16 22:38 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-17T04:08:39.000846+0000 22'23 22:44 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:08:39.100121+0000 22'14 22:36 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:08:39.100094+0000 22'14 22:36 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-17T04:08:39.099503+0000 22'12 22:35 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-17T04:08:39.001151+0000 22'11 22:33 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-17T04:08:39.100176+0000 22'24 22:48 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:08:51.868 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:08:51.869 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:08:51.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:08:51.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:08:51.875 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:08:51.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:08:51.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:08:51.933 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:08:51.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:08:51.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:08:51.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:08:51.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:08:51.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:08:51.992653954' 2026-02-17T04:08:51.994 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:08:51.992653954 2026-02-17T04:08:51.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301331993729768 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:08:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:08:51.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:08:54.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:08:54.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301334098402554 2026-02-17T04:08:54.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:08:54.101 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:08:54.099616285 (2104 ms) 2026-02-17T04:08:54.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:08:54.099616285 (2104 ms)' 2026-02-17T04:08:54.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-17T04:08:54.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:08:54.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:08:54.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-17T04:08:54.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-17T04:08:54.103 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 10 2026-02-17T04:08:54.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.103 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj84 2026-02-17T04:08:54.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj84' 2026-02-17T04:08:54.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.104 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 128 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 0 )) 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=0 )) 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj84 2026-02-17T04:08:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.107 INFO:tasks.workunit.client.0.trial090.stdout:Object obj84: acting: 1 0 2 2026-02-17T04:08:54.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj84: acting: 1 0 2' 2026-02-17T04:08:54.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:08:54.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.108 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:08:54.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj84 (0) 0 2 1' 2026-02-17T04:08:54.109 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj84 (0) 0 2 1 2026-02-17T04:08:54.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:08:54.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.110 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj84 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj84' 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj84 ' 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj36 2026-02-17T04:08:54.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.112 INFO:tasks.workunit.client.0.trial090.stdout:Object obj36: acting: 2 0 1 2026-02-17T04:08:54.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj36: acting: 2 0 1' 2026-02-17T04:08:54.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:08:54.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.113 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:08:54.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj36 (1) 0 1 2' 2026-02-17T04:08:54.114 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj36 (1) 0 1 2 2026-02-17T04:08:54.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:08:54.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.115 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj36 2026-02-17T04:08:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj36' 2026-02-17T04:08:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj36 ' 2026-02-17T04:08:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj56 2026-02-17T04:08:54.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj56: acting: 0 1 2' 2026-02-17T04:08:54.117 INFO:tasks.workunit.client.0.trial090.stdout:Object obj56: acting: 0 1 2 2026-02-17T04:08:54.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:08:54.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.118 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:08:54.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.119 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj56 (2) 1 2 0 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj56 (2) 1 2 0' 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj56' 2026-02-17T04:08:54.120 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj56 2026-02-17T04:08:54.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj56 ' 2026-02-17T04:08:54.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj113 2026-02-17T04:08:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj113: acting: 1 2 0' 2026-02-17T04:08:54.122 INFO:tasks.workunit.client.0.trial090.stdout:Object obj113: acting: 1 2 0 2026-02-17T04:08:54.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:08:54.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.123 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:08:54.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj113 (3) 2 0 1' 2026-02-17T04:08:54.124 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj113 (3) 2 0 1 2026-02-17T04:08:54.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:08:54.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.125 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj113 2026-02-17T04:08:54.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj113' 2026-02-17T04:08:54.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj113 ' 2026-02-17T04:08:54.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj29 2026-02-17T04:08:54.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.127 INFO:tasks.workunit.client.0.trial090.stdout:Object obj29: acting: 1 2 0 2026-02-17T04:08:54.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj29: acting: 1 2 0' 2026-02-17T04:08:54.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:08:54.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.128 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:08:54.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj29 (4) 2 0 1' 2026-02-17T04:08:54.129 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj29 (4) 2 0 1 2026-02-17T04:08:54.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:08:54.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.131 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj29 2026-02-17T04:08:54.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj29' 2026-02-17T04:08:54.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj29 ' 2026-02-17T04:08:54.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj115 2026-02-17T04:08:54.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.132 INFO:tasks.workunit.client.0.trial090.stdout:Object obj115: acting: 1 0 2 2026-02-17T04:08:54.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj115: acting: 1 0 2' 2026-02-17T04:08:54.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:08:54.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.134 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:08:54.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj115 (5) 0 2 1' 2026-02-17T04:08:54.135 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj115 (5) 0 2 1 2026-02-17T04:08:54.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:08:54.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.136 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj115 2026-02-17T04:08:54.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj115' 2026-02-17T04:08:54.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj115 ' 2026-02-17T04:08:54.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj76 2026-02-17T04:08:54.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.137 INFO:tasks.workunit.client.0.trial090.stdout:Object obj76: acting: 1 0 2 2026-02-17T04:08:54.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj76: acting: 1 0 2' 2026-02-17T04:08:54.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:08:54.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.138 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:08:54.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj76 (6) 0 2 1' 2026-02-17T04:08:54.139 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj76 (6) 0 2 1 2026-02-17T04:08:54.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:08:54.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.140 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj76 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj76' 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj76 ' 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj123 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.141 INFO:tasks.workunit.client.0.trial090.stdout:Object obj123: acting: 0 1 2 2026-02-17T04:08:54.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj123: acting: 0 1 2' 2026-02-17T04:08:54.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:08:54.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.142 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:08:54.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj123 (7) 1 2 0' 2026-02-17T04:08:54.143 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj123 (7) 1 2 0 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj123' 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj123 2026-02-17T04:08:54.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj123 ' 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj59 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stdout:Object obj59: acting: 2 0 1 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj59: acting: 2 0 1' 2026-02-17T04:08:54.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj59 (8) 0 1 2' 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj59 (8) 0 1 2 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj59' 2026-02-17T04:08:54.147 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj59 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj59 ' 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj77 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj77: acting: 2 0 1' 2026-02-17T04:08:54.148 INFO:tasks.workunit.client.0.trial090.stdout:Object obj77: acting: 2 0 1 2026-02-17T04:08:54.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:08:54.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:08:54.149 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj77 (9) 0 1 2' 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj77 (9) 0 1 2 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:08:54.150 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj77 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj77' 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj77 ' 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:08:54.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:08:54.174 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:08:54.174 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:08:54.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:54.182 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:08:54.182 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:08:54.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:54.189 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:08:54.189 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:08:54.189 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:08:54.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:08:54.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:08:54.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:08:54.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:08:54.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:08:54.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:08:54.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:08:54.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:08:55.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:08:55.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:08:55.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj84 obj113 obj76 obj59 ' 2026-02-17T04:08:55.508 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj84 obj113 obj76 obj59 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:55.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj84 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj84 2026-02-17T04:08:55.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj84 remove 2026-02-17T04:08:55.602 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:3efbd745:::obj84:head# 2026-02-17T04:08:55.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:55.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:55.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:55.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:55.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:55.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj113 2026-02-17T04:08:55.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:55.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-17T04:08:55.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj113 2026-02-17T04:08:55.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj113 remove 2026-02-17T04:08:55.733 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:dc6ed3c7:::obj113:head# 2026-02-17T04:08:55.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:55.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:55.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:55.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:55.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:55.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj76 2026-02-17T04:08:55.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:55.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-17T04:08:55.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj76 2026-02-17T04:08:55.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj76 remove 2026-02-17T04:08:55.861 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:00833431:::obj76:head# 2026-02-17T04:08:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:08:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:08:55.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:55.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj59 2026-02-17T04:08:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:55.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-17T04:08:55.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj59 2026-02-17T04:08:55.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj59 remove 2026-02-17T04:08:56.001 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:b70eecc2:::obj59:head# 2026-02-17T04:08:56.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:08:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:08:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:08:56.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj36 obj56 obj77 ' 2026-02-17T04:08:56.043 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj36 obj56 obj77 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj36 2026-02-17T04:08:56.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-17T04:08:56.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj36 2026-02-17T04:08:56.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj36 remove 2026-02-17T04:08:56.134 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:b33086a8:::obj36:head# 2026-02-17T04:08:56.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:08:56.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:08:56.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj56 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj56 2026-02-17T04:08:56.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj56 remove 2026-02-17T04:08:56.268 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:4987b93a:::obj56:head# 2026-02-17T04:08:56.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:08:56.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:08:56.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj77 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-17T04:08:56.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj77 2026-02-17T04:08:56.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj77 remove 2026-02-17T04:08:56.402 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:8cdc434f:::obj77:head# 2026-02-17T04:08:56.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:08:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:08:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:08:56.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj29 obj115 obj123 ' 2026-02-17T04:08:56.446 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj29 obj115 obj123 2026-02-17T04:08:56.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:08:56.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj29 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-17T04:08:56.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj29 2026-02-17T04:08:56.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj29 remove 2026-02-17T04:08:56.555 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c3ba172d:::obj29:head# 2026-02-17T04:08:56.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:08:56.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:08:56.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj115 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-17T04:08:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj115 2026-02-17T04:08:56.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj115 remove 2026-02-17T04:08:56.685 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:27794e2d:::obj115:head# 2026-02-17T04:08:56.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-17T04:08:56.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:08:56.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-17T04:08:56.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:08:56.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-17T04:08:56.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj123 2026-02-17T04:08:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-17T04:08:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-17T04:08:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj123 2026-02-17T04:08:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj123 remove 2026-02-17T04:08:56.820 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:4fbee9e6:::obj123:head# 2026-02-17T04:08:56.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-17T04:08:56.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:08:56.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:08:56.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:08:56.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:09:07.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:09:12.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:09:13.053 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:09:13.053 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646785+0000 22'14 34:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.053 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-17T04:09:00.646714+0000 22'16 34:60 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.053 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-17T04:09:00.550022+0000 22'23 34:58 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.053 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646849+0000 22'14 34:60 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646961+0000 22'14 34:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-17T04:09:00.646462+0000 22'12 34:69 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-17T04:09:00.550047+0000 22'11 34:50 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-17T04:09:00.646974+0000 22'24 34:75 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:09:13.054 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:09:13.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:13.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:09:13.061 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:09:13.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:09:13.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:09:13.118 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:09:13.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:09:13.174 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:13.175 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:09:13.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:13.183 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:13.183 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:09:13.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:13.190 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:13.190 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:09:13.190 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:13.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:09:14.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:09:14.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301354198220729 2026-02-17T04:09:14.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:09:14.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:09:14.199853620' 2026-02-17T04:09:14.201 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:09:14.199853620 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:09:14.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:09:14.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:09:14.357 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:09:14.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:09:14.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301354367540785 2026-02-17T04:09:14.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:09:14.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:09:14.368582018 (169 ms)' 2026-02-17T04:09:14.370 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:09:14.368582018 (169 ms) 2026-02-17T04:09:14.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.371 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:09:14.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:09:14.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.372 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:09:14.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:09:14.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.373 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:09:14.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:09:14.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.374 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:09:14.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:09:14.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.375 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:09:14.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:09:14.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.376 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:09:14.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:09:14.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.377 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:09:14.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:09:14.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.378 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:09:14.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:09:14.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:14.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:09:14.379 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:09:14.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:09:14.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:09:14.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:09:14.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:09:14.691 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:09:14.691 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646785+0000 22'14 34:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.691 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-17T04:09:00.646714+0000 22'16 34:60 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.691 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-17T04:09:00.550022+0000 22'23 34:59 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.691 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646849+0000 22'14 34:60 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646961+0000 22'14 34:61 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-17T04:09:00.646462+0000 22'12 34:70 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-17T04:09:00.550047+0000 22'11 34:51 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-17T04:09:00.646974+0000 22'24 34:76 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:09:14.692 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:09:14.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:09:14.753 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:14.753 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:14.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.761 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:14.761 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:14.762 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.769 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:14.769 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:14.769 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:09:14.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301354774934533 2026-02-17T04:09:14.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:14.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:09:14.777 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:09:14.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:09:14.829 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:14.829 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:14.829 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:14.829 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:14.829 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:14.833 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:09:14.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:09:14.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:09:14.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:14.885 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:14.885 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:14.885 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:14.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:14.890 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:09:14.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:09:14.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:09:14.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:14.944 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:14.944 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:14.944 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:14.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:14.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:14.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:14.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:09:14.951 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:09:14.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:09:15.003 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:15.003 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:15.003 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:15.003 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:15.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:15.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:15.008 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:09:15.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:09:15.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:09:15.062 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:15.062 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:15.062 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:15.062 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:15.062 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:15.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:15.067 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:09:15.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:09:15.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:09:15.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:15.118 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:15.118 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:15.119 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:15.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:15.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:15.123 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:09:15.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:09:15.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:09:15.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:15.176 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:15.176 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:15.176 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:15.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:15.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:15.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:09:15.181 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:09:15.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:09:15.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:15.234 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:09:15.234 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:09:15.234 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:09:15.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:09:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:09:15.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:09:15.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:09:15.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301355403614723 2026-02-17T04:09:15.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=628 2026-02-17T04:09:15.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:09:15.458 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:15.458 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:15.458 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.466 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:15.466 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:15.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.474 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:15.474 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:15.474 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:15.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:09:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:09:17.636 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646785+0000 22'14 34:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-17T04:09:00.646714+0000 22'16 34:61 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean+inconsistent 2026-02-17T04:09:15.349651+0000 22'23 34:72 [2,0,1] 2 [2,0,1] 2 22'23 2026-02-17T04:09:15.349617+0000 22'23 2026-02-17T04:09:15.349617+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:15.349617+0000 23 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean+inconsistent 2026-02-17T04:09:14.944171+0000 22'14 34:70 [1,0,2] 1 [1,0,2] 1 22'14 2026-02-17T04:09:14.944144+0000 22'14 2026-02-17T04:09:14.944144+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:14.944144+0000 14 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:00.646961+0000 22'14 34:61 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:08:38.889278+0000 0 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean+inconsistent 2026-02-17T04:09:16.126426+0000 22'12 34:80 [0,1,2] 0 [0,1,2] 0 22'12 2026-02-17T04:09:16.126392+0000 22'12 2026-02-17T04:09:16.126392+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:16.126392+0000 12 0 2026-02-17T04:09:17.637 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean+inconsistent 2026-02-17T04:09:16.336230+0000 22'11 34:62 [2,0,1] 2 [2,0,1] 2 22'11 2026-02-17T04:09:16.336193+0000 22'11 2026-02-17T04:09:16.336193+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:16.336193+0000 11 0 2026-02-17T04:09:17.638 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-17T04:09:00.646974+0000 22'24 34:77 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:08:38.889278+0000 0'0 2026-02-17T04:08:38.889278+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:09:17.638 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:17.638 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:09:17.638 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:09:17.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj 3 8 16 0 10 1048576 4194304 0 628 2026-02-17T04:09:17.645 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj@ NAUT 3 8 16 0/ 10 1048576 4194304/ 0 628 2026-02-17T04:09:17.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.645 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:09:17.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:09:17.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:09:17.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.662 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:09:17.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:09:17.663 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:09:17.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:09:17.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.678 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:09:17.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:09:17.679 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:09:17.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:09:17.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.695 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:09:17.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:09:17.697 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:09:17.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:09:17.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.712 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:09:17.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:09:17.714 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:09:17.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:09:17.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.728 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:09:17.728 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:09:17.729 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:09:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:09:17.730 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:09:17.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:09:17.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.746 INFO:tasks.workunit.client.0.trial090.stdout:78 2026-02-17T04:09:17.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:09:17.747 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:09:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:09:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.763 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:09:17.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:17.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:09:17.764 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:09:17.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:09:17.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:09:17.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:09:17.778 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:09:17.779 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:09:17.779 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:09:17.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:09:17.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:09:23.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:09:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:09:23.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:09:23.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:09:23.500 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:23.500 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:23.500 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:23.508 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:23.508 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:23.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:23.516 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:23.516 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:23.516 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:23.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:09:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301363521134617 2026-02-17T04:09:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:09:23.679 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:09:23.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:23.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:09:23.840 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:09:23.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:23.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:09:24.001 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:09:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:09:24.168 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:09:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:09:24.333 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:09:24.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:24.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:09:24.498 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:09:24.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:24.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:09:24.664 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:09:24.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:09:24.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:09:24.825 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:09:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:09:25.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:09:25.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:09:25.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301365000227646 2026-02-17T04:09:25.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1479 2026-02-17T04:09:25.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:09:25.055 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:25.055 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:25.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:25.063 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:25.063 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:25.063 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:25.070 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:25.070 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:09:25.070 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:25.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:09:30.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:09:30.239 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:09:30.239 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:26.027683+0000 22'14 34:80 [1,2,0] 1 [1,2,0] 1 22'14 2026-02-17T04:09:26.027649+0000 22'14 2026-02-17T04:09:26.027649+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:26.027649+0000 14 0 2026-02-17T04:09:30.239 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-17T04:09:24.979030+0000 22'16 34:84 [1,0,2] 1 [1,0,2] 1 22'16 2026-02-17T04:09:24.978990+0000 22'16 2026-02-17T04:09:24.978990+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:24.978990+0000 16 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-17T04:09:24.486022+0000 22'23 34:95 [2,0,1] 2 [2,0,1] 2 22'23 2026-02-17T04:09:24.480513+0000 22'23 2026-02-17T04:09:24.480513+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:24.480513+0000 23 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-17T04:09:24.022201+0000 22'14 34:92 [1,0,2] 1 [1,0,2] 1 22'14 2026-02-17T04:09:24.016271+0000 22'14 2026-02-17T04:09:24.016271+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:24.016271+0000 14 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean+inconsistent 2026-02-17T04:09:18.927905+0000 22'14 34:74 [1,2,0] 1 [1,2,0] 1 22'14 2026-02-17T04:09:18.927875+0000 22'14 2026-02-17T04:09:18.927875+0000 0 1 queued for deep scrub 14 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-17T04:09:25.263840+0000 22'12 34:103 [0,1,2] 0 [0,1,2] 0 22'12 2026-02-17T04:09:25.258012+0000 22'12 2026-02-17T04:09:25.258012+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:25.258012+0000 12 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-17T04:09:25.516209+0000 22'11 34:84 [2,0,1] 2 [2,0,1] 2 22'11 2026-02-17T04:09:25.513311+0000 22'11 2026-02-17T04:09:25.513311+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:25.513311+0000 11 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-17T04:09:27.064196+0000 22'24 34:115 [1,0,2] 1 [1,0,2] 1 22'24 2026-02-17T04:09:27.061252+0000 22'24 2026-02-17T04:09:27.061252+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:09:27.061252+0000 24 0 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:30.240 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:09:30.241 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:09:30.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj 3 8 16 0 10 1048576 4194304 0 1479 2026-02-17T04:09:30.248 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj@ REPR 3 8 16 0/ 10 1048576 4194304/ 0 1479 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0409 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:09:30.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.334 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.335 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.336 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.337 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.338 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.339 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "value": 248 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr: "value": 248 2026-02-17T04:09:30.340 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "value": 248 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr: "value": 248 2026-02-17T04:09:30.341 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "value": 248 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "value": 260046848 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.342 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.343 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:09:30.344 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.032999524, 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.016499762 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.345 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.346 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.347 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.348 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.349 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.350 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.351 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.352 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.354 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.355 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.356 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.357 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout: "value": 248 2026-02-17T04:09:30.358 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": 248 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": 248 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": 248 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 248 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 260046848 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.032999524, 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.016499762 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.367 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:30.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.381 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 36, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.382 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.383 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.384 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 262144000 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.385 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.209996971, 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.020999697 2026-02-17T04:09:30.386 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.387 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.388 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.389 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.390 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.391 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.392 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.393 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 36, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.394 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.395 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 262144000 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.396 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.209996971, 2026-02-17T04:09:30.397 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.020999697 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.398 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.399 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.400 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.401 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.402 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:30.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:30.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:30.439 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.439 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 16, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.440 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.441 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 250 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.442 INFO:tasks.workunit.client.0.trial090.stderr: "value": 262144000 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:09:30.443 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.084998775, 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.021249693 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.444 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.445 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.446 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.447 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.448 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 16, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.449 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:30.450 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 250 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 262144000 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.451 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.084998775, 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.021249693 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.452 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.453 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.454 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.456 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:30.457 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:30.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:30.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:38.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:09:38.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:38.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:38.818 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.818 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.818 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.818 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.819 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.820 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 9, 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.821 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.822 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.823 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: "value": 362 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.824 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "value": 362 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.825 INFO:tasks.workunit.client.0.trial090.stderr: "value": 362 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "value": 362 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "value": 362 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.826 INFO:tasks.workunit.client.0.trial090.stderr: "value": 379584512 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.827 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.828 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.048999294, 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.016333098 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.829 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.830 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.831 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.832 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.833 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.834 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.835 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.836 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.837 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.838 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.839 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.840 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 9, 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.841 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.842 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.843 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "value": 362 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "value": 362 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.844 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 362 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 362 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 362 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 379584512 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.845 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:09:38.846 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.048999294, 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.016333098 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.847 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.848 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.849 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.850 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.851 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.853 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:38.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.867 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 51, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.868 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.869 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.870 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 381681664 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:09:38.871 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 14, 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.297995699, 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.021285407 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.872 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.873 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.874 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.875 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.876 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.877 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 51, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.878 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.879 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.880 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 381681664 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.881 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 14, 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.297995699, 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.021285407 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.882 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.883 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.884 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.885 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.887 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:38.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 24, 2026-02-17T04:09:38.929 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:09:38.930 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 364 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 381681664 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.126998170, 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.021166361 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:09:38.937 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:09:38.938 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 24, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:09:38.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:09:38.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 364 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 381681664 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.126998170, 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.021166361 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:09:38.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:09:38.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:09:38.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:38.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:09:38.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:09:49.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:09:49.516 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:09:49.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:09:49.722 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:09:49.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:09:49.926 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 4194304 4 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:09:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-17T04:09:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=4194304 2026-02-17T04:09:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:09:49.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:09:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301389935485693 2026-02-17T04:09:49.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 4194304 2026-02-17T04:09:49.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=4194304 2026-02-17T04:09:49.938 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:09:49.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.au49Mr7gho bs=4194304 count=1 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00937206 s, 448 MB/s 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:09:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:49.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:49.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:09:50.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:09:50.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:09:50.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:09:50.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:09:50.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.au49Mr7gho 2026-02-17T04:09:50.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:09:50.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301390872101429 2026-02-17T04:09:50.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=936 2026-02-17T04:09:50.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 936 ms' 2026-02-17T04:09:50.874 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 64 objects in pool test in 936 ms 2026-02-17T04:09:50.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:09:50.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:09:50.873154925' 2026-02-17T04:09:50.875 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:09:50.873154925 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:09:50.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:09:50.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:09:50.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:09:50.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:09:51.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:09:51.120 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:09:51.121 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:09:51.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:09:51.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:09:51.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:09:51.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:09:51.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:09:51.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:09:51.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:09:51.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:09:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:09:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:09:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T04:09:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:09:51.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-55834574856' 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:09:51.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:09:51.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:09:51.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:09:51.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:09:51.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:09:51.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:09:51.300 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:09:51.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:09:51.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:09:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:09:51.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:09:51.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:09:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:09:51.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:09:51.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:09:51.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:09:51.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:09:51.467 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T04:09:51.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:09:51.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:09:51.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:09:51.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574856 2026-02-17T04:09:51.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:09:51.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:09:51.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-17T04:09:51.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:09:51.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574856 2026-02-17T04:09:51.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-17T04:09:51.633 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574856 2026-02-17T04:09:51.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:09:51.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-17T04:09:51.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:09:51.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:09:51.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:09:52.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:09:52.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:09:52.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:09:52.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:09:52.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:09:52.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:09:52.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:09:52.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:09:52.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:09:52.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:09:52.530 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:09:52.531 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:09:52.531 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:52.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:09:52.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:09:57.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:09:57.697 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:09:57.697 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:09:45.928204+0000 18'6 18:25 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.697 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:09:45.928282+0000 18'7 18:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.697 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-17T04:09:45.927552+0000 18'16 18:37 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:09:45.928043+0000 18'6 18:25 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-17T04:09:45.928305+0000 18'8 18:27 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:09:45.927566+0000 18'7 18:27 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-17T04:09:45.927417+0000 18'3 18:25 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-17T04:09:45.928042+0000 18'11 18:32 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:09:57.698 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:09:57.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:09:57.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:09:57.705 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:09:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:09:57.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:09:57.763 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:09:57.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:09:57.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:09:57.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:09:57.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:09:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:09:57.821094122' 2026-02-17T04:09:57.822 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:09:57.821094122 2026-02-17T04:09:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:09:57.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301397822226184 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:09:57.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:09:57.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:09:58.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:09:58.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301398906009263 2026-02-17T04:09:58.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:09:58.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:09:58.907103995 (1083 ms)' 2026-02-17T04:09:58.909 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:09:58.907103995 (1083 ms) 2026-02-17T04:09:58.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-17T04:09:58.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:09:58.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-17T04:09:58.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:09:58.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.910 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 40 2026-02-17T04:09:58.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-17T04:09:58.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.911 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj31 2026-02-17T04:09:58.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj31' 2026-02-17T04:09:58.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.912 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 64 2026-02-17T04:09:58.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-17T04:09:58.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:09:58.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:09:58.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:09:58.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.914 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj31 2026-02-17T04:09:58.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj31' 2026-02-17T04:09:58.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj31 2026-02-17T04:09:58.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj31 ' 2026-02-17T04:09:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj26' 2026-02-17T04:09:58.929 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj26 2026-02-17T04:09:58.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj26 2026-02-17T04:09:58.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj26 ' 2026-02-17T04:09:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.944 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj46 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj46' 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj46 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj46 ' 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.946 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj27 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj27' 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj27 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj27 ' 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.948 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj51 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj51' 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj51 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj51 ' 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj49' 2026-02-17T04:09:58.950 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj49 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj49 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj49 ' 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.951 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj19 2026-02-17T04:09:58.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj19' 2026-02-17T04:09:58.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj19 2026-02-17T04:09:58.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj19 ' 2026-02-17T04:09:58.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.954 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj18 2026-02-17T04:09:58.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj18' 2026-02-17T04:09:58.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj18 2026-02-17T04:09:58.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj18 ' 2026-02-17T04:09:58.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.956 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj11 2026-02-17T04:09:58.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj11' 2026-02-17T04:09:58.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj11 2026-02-17T04:09:58.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj11 ' 2026-02-17T04:09:58.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.958 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj6 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj6' 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj6 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj6 ' 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.960 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj39 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj39' 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj39 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj39 ' 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.961 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj16 2026-02-17T04:09:58.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj16' 2026-02-17T04:09:58.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj16 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj16 ' 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.963 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj56 2026-02-17T04:09:58.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj56' 2026-02-17T04:09:58.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj56 2026-02-17T04:09:58.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:09:58.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj56 ' 2026-02-17T04:09:58.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.965 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj55 2026-02-17T04:09:58.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj55' 2026-02-17T04:09:58.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj55 2026-02-17T04:09:58.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj55 ' 2026-02-17T04:09:58.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj50' 2026-02-17T04:09:58.967 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj50 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj50 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj50 ' 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.969 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-17T04:09:58.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-17T04:09:58.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-17T04:09:58.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-17T04:09:58.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj57' 2026-02-17T04:09:58.971 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj57 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj57 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj57 ' 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.973 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj30 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj30' 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj30 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj30 ' 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj8' 2026-02-17T04:09:58.975 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj8 2026-02-17T04:09:58.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj8 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj8 ' 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj12' 2026-02-17T04:09:58.977 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj12 2026-02-17T04:09:58.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj12 2026-02-17T04:09:58.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj12 ' 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj60 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.979 INFO:tasks.workunit.client.0.trial090.stdout:Object obj60: acting: 1 0 2 2026-02-17T04:09:58.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj60: acting: 1 0 2' 2026-02-17T04:09:58.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:58.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.980 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:58.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj60 (20) 0 2 1' 2026-02-17T04:09:58.981 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj60 (20) 0 2 1 2026-02-17T04:09:58.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:58.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.982 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj60 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj60' 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj60 ' 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj42 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj42: acting: 2 0 1' 2026-02-17T04:09:58.983 INFO:tasks.workunit.client.0.trial090.stdout:Object obj42: acting: 2 0 1 2026-02-17T04:09:58.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:58.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.984 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:58.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj42 (21) 0 1 2' 2026-02-17T04:09:58.985 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj42 (21) 0 1 2 2026-02-17T04:09:58.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:09:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.986 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj42 2026-02-17T04:09:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj42' 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj42 ' 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj2 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.987 INFO:tasks.workunit.client.0.trial090.stdout:Object obj2: acting: 1 0 2 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj2: acting: 1 0 2' 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj2 (22) 0 2 1' 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj2 (22) 0 2 1 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.989 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj2 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj2' 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj2 ' 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj22 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj22: acting: 1 2 0' 2026-02-17T04:09:58.991 INFO:tasks.workunit.client.0.trial090.stdout:Object obj22: acting: 1 2 0 2026-02-17T04:09:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:09:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.991 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj22 (23) 2 0 1' 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj22 (23) 2 0 1 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj22 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj22' 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj22 ' 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj47 2026-02-17T04:09:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stdout:Object obj47: acting: 1 0 2 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj47: acting: 1 0 2' 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.994 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj47 (24) 0 2 1' 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj47 (24) 0 2 1 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj47' 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj47 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj47 ' 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj9 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.996 INFO:tasks.workunit.client.0.trial090.stdout:Object obj9: acting: 1 2 0 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj9: acting: 1 2 0' 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj9 (25) 2 0 1' 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj9 (25) 2 0 1 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.998 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj9 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj9' 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj9 ' 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj20 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stdout:Object obj20: acting: 1 0 2 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj20: acting: 1 0 2' 2026-02-17T04:09:58.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj20 (26) 0 2 1' 2026-02-17T04:09:59.000 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj20 (26) 0 2 1 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj20 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj20' 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj20 ' 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj41 2026-02-17T04:09:59.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stdout:Object obj41: acting: 2 0 1 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj41: acting: 2 0 1' 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.002 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj41 (27) 0 1 2' 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj41 (27) 0 1 2 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.003 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj41 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj41' 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj41 ' 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj44 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stdout:Object obj44: acting: 0 1 2 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj44: acting: 0 1 2' 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:09:59.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj44 (28) 1 2 0' 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj44 (28) 1 2 0 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:09:59.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj44 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj44' 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj44 ' 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj38 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.006 INFO:tasks.workunit.client.0.trial090.stdout:Object obj38: acting: 0 1 2 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj38: acting: 0 1 2' 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj38 (29) 1 2 0' 2026-02-17T04:09:59.007 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj38 (29) 1 2 0 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj38 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj38' 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj38 ' 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj36 2026-02-17T04:09:59.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stdout:Object obj36: acting: 2 0 1 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj36: acting: 2 0 1' 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj36 (30) 0 1 2' 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj36 (30) 0 1 2 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj36' 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj36 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj36 ' 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj37 2026-02-17T04:09:59.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stdout:Object obj37: acting: 1 0 2 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj37: acting: 1 0 2' 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj37 (31) 0 2 1' 2026-02-17T04:09:59.011 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj37 (31) 0 2 1 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj37' 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj37 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj37 ' 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj59 2026-02-17T04:09:59.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stdout:Object obj59: acting: 2 0 1 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj59: acting: 2 0 1' 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj59 (32) 0 1 2' 2026-02-17T04:09:59.013 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj59 (32) 0 1 2 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj59 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj59' 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj59 ' 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj25 2026-02-17T04:09:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stdout:Object obj25: acting: 1 0 2 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj25: acting: 1 0 2' 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj25 (33) 0 2 1' 2026-02-17T04:09:59.015 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj25 (33) 0 2 1 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj25 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj25' 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj25 ' 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj35 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.016 INFO:tasks.workunit.client.0.trial090.stdout:Object obj35: acting: 2 0 1 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj35: acting: 2 0 1' 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj35 (34) 0 1 2' 2026-02-17T04:09:59.017 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj35 (34) 0 1 2 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj35 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj35' 2026-02-17T04:09:59.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj35 ' 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj4 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stdout:Object obj4: acting: 1 0 2 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj4: acting: 1 0 2' 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj4 (35) 0 2 1' 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj4 (35) 0 2 1 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj4' 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj4 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj4 ' 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj21 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj21: acting: 1 0 2' 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stdout:Object obj21: acting: 1 0 2 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj21 (36) 0 2 1' 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj21 (36) 0 2 1 2026-02-17T04:09:59.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj21 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj21' 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj21 ' 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj7 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj7: acting: 2 0 1' 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stdout:Object obj7: acting: 2 0 1 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj7 (37) 0 1 2' 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj7 (37) 0 1 2 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.023 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj7 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj7' 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj7 ' 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj28 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stdout:Object obj28: acting: 2 0 1 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj28: acting: 2 0 1' 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj28 (38) 0 1 2' 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj28 (38) 0 1 2 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj28 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj28' 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj28 ' 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.025 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1: acting: 1 2 0 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1: acting: 1 2 0' 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1 (39) 2 0 1' 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj1 (39) 2 0 1 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:09:59.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj1 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj1' 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1 ' 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:09:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:09:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:09:59.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:09:59.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:10:00.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:10:00.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:10:00.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj16 obj56 obj30 ' 2026-02-17T04:10:00.329 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj16 obj56 obj30 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:10:00.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj16 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj16 2026-02-17T04:10:00.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj16 rm-attr _ 2026-02-17T04:10:00.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:00.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:00.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:10:00.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:10:00.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj56 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj56 2026-02-17T04:10:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj56 rm-attr _ 2026-02-17T04:10:00.561 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:00.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:00.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj30 2026-02-17T04:10:00.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj30 2026-02-17T04:10:00.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj30 rm-attr _ 2026-02-17T04:10:00.687 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:00.687 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:00.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj60 obj2 obj22 obj47 obj9 obj20 obj36 obj59 obj35 obj21 obj28 obj1 ' obj_to_pgid delete_oi 2026-02-17T04:10:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj60 obj2 obj22 obj47 obj9 obj20 obj36 obj59 obj35 obj21 obj28 obj1 ' 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj60 obj2 obj22 obj47 obj9 obj20 obj36 obj59 obj35 obj21 obj28 obj1 ]] 2026-02-17T04:10:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:10:00.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj60 obj2 obj22 obj47 obj9 obj20 obj36 obj59 obj35 obj21 obj28 obj1 ' 2026-02-17T04:10:00.730 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj60 obj2 obj22 obj47 obj9 obj20 obj36 obj59 obj35 obj21 obj28 obj1 2026-02-17T04:10:00.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:00.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:00.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:00.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj60 2026-02-17T04:10:00.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-17T04:10:00.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj60 rm-attr _ 2026-02-17T04:10:00.814 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:00.814 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:00.815 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:00.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj2 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-17T04:10:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj2 rm-attr _ 2026-02-17T04:10:00.947 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:00.947 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:00.947 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:00.947 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:00.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:00.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:00.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:00.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:00.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:00.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:00.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj22 2026-02-17T04:10:00.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:00.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:00.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj22 2026-02-17T04:10:00.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj22 rm-attr _ 2026-02-17T04:10:01.082 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.083 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.083 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.083 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.083 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:01.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj47 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-17T04:10:01.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj47 rm-attr _ 2026-02-17T04:10:01.218 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.219 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.219 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.219 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.219 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.219 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj9 2026-02-17T04:10:01.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj9 2026-02-17T04:10:01.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj9 rm-attr _ 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.352 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:01.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:10:01.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:10:01.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj20 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-17T04:10:01.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj20 rm-attr _ 2026-02-17T04:10:01.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:01.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.483 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.483 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.483 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.483 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:01.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:01.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:01.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj36 2026-02-17T04:10:01.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-17T04:10:01.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj36 rm-attr _ 2026-02-17T04:10:01.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:01.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:01.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:01.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj59 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj59 2026-02-17T04:10:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj59 rm-attr _ 2026-02-17T04:10:01.756 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:10:01.756 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:01.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj35 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj35 2026-02-17T04:10:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj35 rm-attr _ 2026-02-17T04:10:01.893 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:10:01.893 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:10:01.893 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:01.893 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:01.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:01.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:01.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:01.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj21 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj21 2026-02-17T04:10:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj21 rm-attr _ 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:02.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:02.033 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:02.033 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:02.033 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:02.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:10:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:10:02.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj28 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj28 2026-02-17T04:10:02.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj28 rm-attr _ 2026-02-17T04:10:02.167 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:10:02.167 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:02.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:02.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:10:02.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj1 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-17T04:10:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj1 rm-attr _ 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:10:02.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:10:02.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:10:02.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:02.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:10:02.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:10:02.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj26 obj46 obj27 obj49 obj19 obj11 obj6 obj39 obj50 obj63 obj57 ' 2026-02-17T04:10:02.336 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj26 obj46 obj27 obj49 obj19 obj11 obj6 obj39 obj50 obj63 obj57 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj26 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-17T04:10:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj26 rm-attr _ 2026-02-17T04:10:02.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:10:02.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:10:02.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj46 2026-02-17T04:10:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:02.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj46 2026-02-17T04:10:02.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj46 rm-attr _ 2026-02-17T04:10:02.559 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:10:02.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj27 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:02.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj27 2026-02-17T04:10:02.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj27 rm-attr _ 2026-02-17T04:10:02.698 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:02.698 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:10:02.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:10:02.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj49 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:02.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj49 2026-02-17T04:10:02.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj49 rm-attr _ 2026-02-17T04:10:02.833 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:02.833 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:02.833 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:02.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:02.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:02.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:02.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:02.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:02.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:02.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj19 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:02.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:02.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj19 2026-02-17T04:10:02.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj19 rm-attr _ 2026-02-17T04:10:02.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:02.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:02.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:02.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:10:03.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:10:03.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj11 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-17T04:10:03.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj11 rm-attr _ 2026-02-17T04:10:03.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:10:03.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:10:03.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj6 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj6 2026-02-17T04:10:03.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj6 rm-attr _ 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:10:03.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:10:03.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj39 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj39 2026-02-17T04:10:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj39 rm-attr _ 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:10:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:10:03.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj50 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj50 2026-02-17T04:10:03.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj50 rm-attr _ 2026-02-17T04:10:03.472 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:03.472 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.472 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:03.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:03.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:03.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-17T04:10:03.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:03.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:10:03.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:10:03.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj57 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj57 2026-02-17T04:10:03.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj57 rm-attr _ 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.731 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj42 obj41 obj44 obj7 ' obj_to_pgid delete_oi 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj42 obj41 obj44 obj7 ' 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:10:03.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:10:03.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:10:03.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj42 obj41 obj44 obj7 ]] 2026-02-17T04:10:03.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:10:03.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj42 obj41 obj44 obj7 ' 2026-02-17T04:10:03.770 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj42 obj41 obj44 obj7 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj42 2026-02-17T04:10:03.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-17T04:10:03.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj42 rm-attr _ 2026-02-17T04:10:03.867 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:03.867 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7135fd38:::obj57:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:03.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:03.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:03.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:03.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj41 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:03.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:03.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj41 2026-02-17T04:10:03.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj41 rm-attr _ 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7135fd38:::obj57:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:04.007 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:04.008 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:04.008 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:04.008 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:10:04.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:10:04.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:10:04.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj44 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-17T04:10:04.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj44 rm-attr _ 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7135fd38:::obj57:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:10:04.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:04.144 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:10:04.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj7 2026-02-17T04:10:04.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:10:04.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-17T04:10:04.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj7 rm-attr _ 2026-02-17T04:10:04.271 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:10:04.271 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:10:04.271 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:10:04.271 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7135fd38:::obj57:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:10:04.272 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:10:04.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:04.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:10:04.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:10:04.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj31 obj51 obj18 obj55 obj8 obj12 ' 2026-02-17T04:10:04.308 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj31 obj51 obj18 obj55 obj8 obj12 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj31 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj31 2026-02-17T04:10:04.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj31 rm-attr _ 2026-02-17T04:10:04.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj51 2026-02-17T04:10:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj51 2026-02-17T04:10:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj51 rm-attr _ 2026-02-17T04:10:04.534 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:04.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj18 2026-02-17T04:10:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj18 2026-02-17T04:10:04.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj18 rm-attr _ 2026-02-17T04:10:04.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:04.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:04.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj55 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-17T04:10:04.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj55 rm-attr _ 2026-02-17T04:10:04.792 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:04.792 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:04.792 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:04.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj8 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj8 2026-02-17T04:10:04.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj8 rm-attr _ 2026-02-17T04:10:04.928 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:04.928 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:04.928 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:04.928 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:04.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:10:04.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:10:04.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:04.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj12 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-17T04:10:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj12 rm-attr _ 2026-02-17T04:10:05.051 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:05.051 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:10:05.051 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:05.051 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:05.051 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:05.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:05.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:05.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:05.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj38 obj37 obj25 obj4 ' obj_to_pgid delete_oi 2026-02-17T04:10:05.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:10:05.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj38 obj37 obj25 obj4 ' 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj38 obj37 obj25 obj4 ]] 2026-02-17T04:10:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:10:05.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj38 obj37 obj25 obj4 ' 2026-02-17T04:10:05.093 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj38 obj37 obj25 obj4 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:10:05.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj38 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj38 2026-02-17T04:10:05.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj38 rm-attr _ 2026-02-17T04:10:05.192 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:05.193 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:10:05.193 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:10:05.193 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:05.193 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:05.193 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:05.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:05.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:05.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:05.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:10:05.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:10:05.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:05.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj37 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj37 2026-02-17T04:10:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj37 rm-attr _ 2026-02-17T04:10:05.326 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:05.326 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:10:05.326 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:10:05.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:05.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:05.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:05.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:10:05.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:05.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:05.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:05.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:10:05.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:10:05.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:05.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:05.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:05.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj25 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj25 2026-02-17T04:10:05.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj25 rm-attr _ 2026-02-17T04:10:05.463 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:10:05.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:10:05.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:05.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:05.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:10:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:10:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:10:05.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:10:05.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj4 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:10:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:10:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-17T04:10:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj4 rm-attr _ 2026-02-17T04:10:05.594 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:10:05.594 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:10:05.594 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:10:05.594 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:10:05.595 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:10:05.595 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:10:05.595 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:10:05.595 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:10:05.595 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:10:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:10:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:10:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:10:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:10:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:10:16.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:10:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:09.313477+0000 18'6 32:52 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:09.313651+0000 18'7 32:53 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-17T04:10:09.312747+0000 18'16 32:52 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:09.313617+0000 18'6 32:53 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-17T04:10:09.313418+0000 18'8 32:56 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.805 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:09.312609+0000 18'7 32:65 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.806 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-17T04:10:09.312592+0000 18'3 32:41 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.806 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-17T04:10:09.313315+0000 18'11 32:63 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:21.806 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:10:21.806 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:10:21.806 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:10:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:10:21.813 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:10:21.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:10:21.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:10:21.871 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:10:21.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:10:21.923 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:10:21.924 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:10:21.924 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:21.931 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:10:21.931 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:10:21.932 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:21.939 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:10:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:10:21.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:10:22.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:10:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301422946347191 2026-02-17T04:10:22.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:10:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:10:22.947787860' 2026-02-17T04:10:22.949 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:10:22.947787860 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:10:22.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:10:22.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:10:22.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:10:22.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:10:22.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:10:22.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:10:23.105 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:10:23.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:10:23.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301423116133668 2026-02-17T04:10:23.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:10:23.118 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:10:23.117420101 (169 ms) 2026-02-17T04:10:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:10:23.117420101 (169 ms)' 2026-02-17T04:10:23.119 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:10:23.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:10:23.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.120 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:10:23.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:10:23.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.121 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:10:23.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:10:23.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.122 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:10:23.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:10:23.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:10:23.124 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:10:23.124 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:10:23.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:10:23.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.125 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:10:23.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:10:23.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.126 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:10:23.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:10:23.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:10:23.127 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:10:23.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:10:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:10:23.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:10:23.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:10:23.441 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:09.313477+0000 18'6 32:52 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:09.313651+0000 18'7 32:53 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-17T04:10:09.312747+0000 18'16 32:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:09.313617+0000 18'6 32:53 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-17T04:10:09.313418+0000 18'8 32:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:09.312609+0000 18'7 32:65 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-17T04:10:09.312592+0000 18'3 32:42 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-17T04:10:09.313315+0000 18'11 32:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:23.442 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:10:23.443 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:10:23.443 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:10:23.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:10:23.505 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:10:23.505 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:23.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.513 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:10:23.513 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:23.513 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.520 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:10:23.521 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:23.521 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:10:23.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301423526380274 2026-02-17T04:10:23.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:10:23.528 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:10:23.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:10:23.581 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.581 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.581 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.581 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.581 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:10:23.586 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:10:23.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:10:23.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.640 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.640 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.640 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.641 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:10:23.647 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:10:23.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:10:23.700 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.701 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.701 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.701 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.701 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.705 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:10:23.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:10:23.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:10:23.757 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.757 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.758 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.758 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.758 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:10:23.763 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:10:23.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:10:23.815 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.815 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.815 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.815 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.815 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.820 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:10:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:10:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:10:23.871 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.871 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.871 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.871 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.872 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:10:23.876 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:10:23.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:10:23.928 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.928 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.928 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.928 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.928 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:23.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:10:23.933 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:10:23.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:10:23.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:10:23.985 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:23.985 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:10:23.985 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:10:23.985 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:10:23.986 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:10:23.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:10:24.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:10:24.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:10:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301424155588956 2026-02-17T04:10:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=629 2026-02-17T04:10:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:10:24.211 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:10:24.211 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:24.211 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:24.219 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:10:24.219 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:24.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:24.226 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:10:24.226 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:24.226 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:24.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:10:26.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:09.313477+0000 18'6 32:53 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean+scrubbing+deep 2026-02-17T04:10:24.669548+0000 18'7 32:58 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 deep scrubbing for 1s 0 0 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean+inconsistent 2026-02-17T04:10:24.354280+0000 18'16 32:64 [2,0,1] 2 [2,0,1] 2 18'16 2026-02-17T04:10:24.354252+0000 18'16 2026-02-17T04:10:24.354252+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:24.354252+0000 16 0 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean+inconsistent 2026-02-17T04:10:23.675471+0000 18'6 32:63 [1,0,2] 1 [1,0,2] 1 18'6 2026-02-17T04:10:23.675445+0000 18'6 2026-02-17T04:10:23.675445+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:23.675445+0000 6 0 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-17T04:10:09.313418+0000 18'8 32:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:09:45.819278+0000 0 0 2026-02-17T04:10:26.397 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean+inconsistent 2026-02-17T04:10:24.082216+0000 18'7 32:75 [0,1,2] 0 [0,1,2] 0 18'7 2026-02-17T04:10:24.082180+0000 18'7 2026-02-17T04:10:24.082180+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:24.082180+0000 7 0 2026-02-17T04:10:26.398 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-17T04:10:09.312592+0000 18'3 32:43 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:10:26.398 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-17T04:10:09.313315+0000 18'11 32:66 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:09:45.819278+0000 0'0 2026-02-17T04:09:45.819278+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:10:26.398 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:10:26.398 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:10:26.398 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:10:26.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2 3 8 8 20 20 4194304 4194304 0 629 2026-02-17T04:10:26.405 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_2@ NAUT 3 8 8 20/ 20 4194304 4194304/ 0 629 2026-02-17T04:10:26.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.406 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:10:26.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:10:26.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:10:26.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.423 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:10:26.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.424 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:10:26.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:10:26.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:10:26.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.440 INFO:tasks.workunit.client.0.trial090.stdout:1611 2026-02-17T04:10:26.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.441 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:10:26.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:10:26.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:10:26.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.457 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:10:26.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:10:26.458 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:10:26.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:10:26.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.474 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:10:26.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:10:26.475 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:10:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:10:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.489 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:10:26.489 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:10:26.490 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:10:26.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:10:26.491 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:10:26.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:10:26.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.508 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:10:26.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:10:26.509 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:10:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:10:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.523 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:10:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:10:26.524 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:10:26.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:10:26.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:10:26.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:10:26.538 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:10:26.538 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:10:26.539 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:10:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:10:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:10:32.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:10:32.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:10:32.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:10:32.254 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:10:32.254 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:32.254 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:32.262 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:10:32.262 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:32.262 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:32.270 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:10:32.270 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:32.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:32.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:10:32.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301432276425849 2026-02-17T04:10:32.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:32.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:10:32.437 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:10:32.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:32.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:10:32.601 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:10:32.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:32.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:10:32.770 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:10:32.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:32.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:10:32.936 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:10:32.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:32.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:10:33.100 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:10:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:10:33.267 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:10:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:10:33.438 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:10:33.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:10:33.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:10:33.603 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:10:33.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:10:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:10:33.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:10:33.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:10:33.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301433782308440 2026-02-17T04:10:33.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1505 2026-02-17T04:10:33.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:10:33.837 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:10:33.837 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:33.837 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:33.845 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:10:33.845 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:33.845 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:33.852 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:10:33.852 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:10:33.852 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:33.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:10:38.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:10:39.014 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:10:39.014 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:34.629926+0000 18'6 32:86 [1,2,0] 1 [1,2,0] 1 18'6 2026-02-17T04:10:34.602955+0000 18'6 2026-02-17T04:10:34.602955+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:34.602955+0000 6 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:33.687310+0000 18'7 32:89 [1,0,2] 1 [1,0,2] 1 18'7 2026-02-17T04:10:33.652085+0000 18'7 2026-02-17T04:10:33.652085+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:33.652085+0000 7 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-17T04:10:33.364316+0000 18'16 32:104 [2,0,1] 2 [2,0,1] 2 18'16 2026-02-17T04:10:33.283605+0000 18'16 2026-02-17T04:10:33.283605+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:33.283605+0000 16 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-17T04:10:32.662120+0000 18'6 32:87 [1,0,2] 1 [1,0,2] 1 18'6 2026-02-17T04:10:32.631074+0000 18'6 2026-02-17T04:10:32.631074+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:32.631074+0000 6 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-17T04:10:36.643832+0000 18'8 32:87 [1,2,0] 1 [1,2,0] 1 18'8 2026-02-17T04:10:36.629773+0000 18'8 2026-02-17T04:10:36.629773+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:36.629773+0000 8 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-17T04:10:33.926570+0000 18'7 32:103 [0,1,2] 0 [0,1,2] 0 18'7 2026-02-17T04:10:33.892779+0000 18'7 2026-02-17T04:10:33.892779+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:33.892779+0000 7 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-17T04:10:34.273451+0000 18'3 32:72 [2,0,1] 2 [2,0,1] 2 18'3 2026-02-17T04:10:34.260302+0000 18'3 2026-02-17T04:10:34.260302+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:34.260302+0000 3 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-17T04:10:35.697099+0000 18'11 32:112 [1,0,2] 1 [1,0,2] 1 18'11 2026-02-17T04:10:35.647403+0000 18'11 2026-02-17T04:10:35.647403+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:10:35.647403+0000 11 0 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:10:39.015 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:10:39.016 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:10:39.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2 3 8 8 20 20 4194304 4194304 0 1505 2026-02-17T04:10:39.023 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_2@ REPR 3 8 8 20/ 20 4194304 4194304/ 0 1505 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:10:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0410 2026-02-17T04:10:39.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:10:39.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:10:39.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.111 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.112 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 4, 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.113 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.114 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.115 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.116 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.117 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.118 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870912 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.119 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.120 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.121 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.055999385, 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.027999692 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.122 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.123 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.127 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.129 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.132 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.133 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.134 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 4, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.136 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870912 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.055999385, 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.027999692 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.144 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.145 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.146 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:39.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 22, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.161 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870912 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.320996476, 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.032099647 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.168 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.169 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.170 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:39.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.172 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 22, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870912 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.175 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.176 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.320996476, 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.032099647 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.177 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.178 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.179 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.180 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.181 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:39.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:39.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:39.218 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 10, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:39.220 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870912 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.157998265, 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.039499566 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.226 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.227 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:39.228 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 10, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.229 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:39.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870912 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:39.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.157998265, 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.039499566 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.237 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:39.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:47.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:10:47.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:47.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:47.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.591 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.592 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.593 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.594 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.595 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805306368 2026-02-17T04:10:47.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:10:47.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.086999045, 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.028999681 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.604 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.608 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.610 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.611 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.612 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.613 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805306368 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.086999045, 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.028999681 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.624 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:47.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.637 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 33, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.638 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.639 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805306368 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.640 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 15, 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.480994724, 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.032066314 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.641 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.642 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.643 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.644 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.645 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.646 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 33, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.647 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.648 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805306368 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.649 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 15, 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.480994724, 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.032066314 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.650 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.651 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.652 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.653 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:47.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 15, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805306368 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.235997408, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.039332901 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.697 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:10:47.700 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 15, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.701 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.702 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805306368 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:10:47.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.235997408, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.039332901 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:10:47.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:10:47.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:10:47.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:10:47.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:10:58.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:10:58.322 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:10:58.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:10:58.526 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:10:58.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:10:58.730 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:10:58.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:10:58.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 4194300 4 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=4194300 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:10:58.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:10:58.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301458738760648 2026-02-17T04:10:58.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 4194300 2026-02-17T04:10:58.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=4194300 2026-02-17T04:10:58.741 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:10:58.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.YO2QLwJlXz bs=4194300 count=1 2026-02-17T04:10:58.753 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:4194300 bytes (4.2 MB, 4.0 MiB) copied, 0.00960926 s, 436 MB/s 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:58.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:58.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:58.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:58.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:58.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:10:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:10:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:10:59.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:10:59.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:10:59.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.YO2QLwJlXz 2026-02-17T04:10:59.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:10:59.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301459677783948 2026-02-17T04:10:59.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=939 2026-02-17T04:10:59.679 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 64 objects in pool test in 939 ms 2026-02-17T04:10:59.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 939 ms' 2026-02-17T04:10:59.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:10:59.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:10:59.679039172' 2026-02-17T04:10:59.680 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:10:59.679039172 2026-02-17T04:10:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:10:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:10:59.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:10:59.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:10:59.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:10:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:10:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:10:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:10:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:10:59.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:11:00.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:11:00.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:11:00.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T04:11:00.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:11:00.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:11:00.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-17T04:11:00.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-17T04:11:00.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-55834574856' 2026-02-17T04:11:00.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:11:00.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:11:00.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:11:00.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:11:00.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:11:00.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:11:00.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:11:00.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:11:00.109 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:11:00.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:11:00.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:11:00.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:11:00.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:11:00.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:11:00.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:11:00.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:11:00.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:11:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:11:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:11:00.277 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T04:11:00.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:11:00.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:11:00.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:11:00.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574856 2026-02-17T04:11:00.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:11:00.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:11:00.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-17T04:11:00.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:11:00.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574856 2026-02-17T04:11:00.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-17T04:11:00.444 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574856 2026-02-17T04:11:00.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:11:00.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-17T04:11:00.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:11:00.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:11:00.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:11:00.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:11:00.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:11:00.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:11:00.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:11:00.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:11:01.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:11:01.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:11:01.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:11:01.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:11:01.348 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:11:01.348 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:11:01.349 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:01.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:11:01.356 INFO:tasks.workunit.client.0.trial090.stdout:Setting osd_deep_scrub_stride to 4194304 2026-02-17T04:11:01.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:423: corrupt_and_measure: echo 'Setting osd_deep_scrub_stride to 4194304' 2026-02-17T04:11:01.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:424: corrupt_and_measure: ceph tell 'osd.*' config set osd_deep_scrub_stride 4194304 2026-02-17T04:11:01.411 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:01.411 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:01.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:01.419 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:01.419 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:01.420 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:01.427 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:01.427 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:01.427 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:01.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:11:06.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:11:06.592 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:11:06.592 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:10:54.726612+0000 18'6 18:27 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.592 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:10:54.726707+0000 18'7 18:28 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-17T04:10:54.725301+0000 18'16 18:35 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:10:54.726659+0000 18'6 18:27 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-17T04:10:54.726387+0000 18'8 18:29 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:10:54.725257+0000 18'7 18:27 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-17T04:10:54.725437+0000 18'3 18:23 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-17T04:10:54.726608+0000 18'11 18:34 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:06.593 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:11:06.594 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:11:06.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:06.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:11:06.601 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:11:06.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:11:06.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:11:06.659 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:11:06.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:11:06.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:11:06.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:11:06.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:11:06.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:11:06.718598447' 2026-02-17T04:11:06.720 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:11:06.718598447 2026-02-17T04:11:06.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301466719649111 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:11:06.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-17T04:11:06.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:11:06.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:11:06.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:11:06.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:11:06.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:11:07.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:11:07.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301467811640068 2026-02-17T04:11:07.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:11:07.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:11:07.813028359 (1091 ms)' 2026-02-17T04:11:07.814 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:11:07.813028359 (1091 ms) 2026-02-17T04:11:07.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-17T04:11:07.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:11:07.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:11:07.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-17T04:11:07.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.816 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 40 2026-02-17T04:11:07.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-17T04:11:07.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.817 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj28 2026-02-17T04:11:07.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj28' 2026-02-17T04:11:07.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.818 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 64 2026-02-17T04:11:07.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.819 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj28 2026-02-17T04:11:07.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj28' 2026-02-17T04:11:07.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj28 2026-02-17T04:11:07.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:11:07.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj28 ' 2026-02-17T04:11:07.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.821 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj62 2026-02-17T04:11:07.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj62' 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj62 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj62 ' 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.822 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj60 2026-02-17T04:11:07.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj60' 2026-02-17T04:11:07.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj60 2026-02-17T04:11:07.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj60 ' 2026-02-17T04:11:07.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.824 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj24 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj24' 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj24 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj24 ' 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj48' 2026-02-17T04:11:07.826 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj48 2026-02-17T04:11:07.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj48 2026-02-17T04:11:07.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj48 ' 2026-02-17T04:11:07.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.827 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj14 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj14' 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj14 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj14 ' 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.829 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj9 2026-02-17T04:11:07.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj9' 2026-02-17T04:11:07.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj9 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj9 ' 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj17' 2026-02-17T04:11:07.830 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj17 2026-02-17T04:11:07.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj17 2026-02-17T04:11:07.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj17 ' 2026-02-17T04:11:07.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.832 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1' 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1 ' 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.833 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj52 2026-02-17T04:11:07.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj52' 2026-02-17T04:11:07.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj52 2026-02-17T04:11:07.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:11:07.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj52 ' 2026-02-17T04:11:07.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.835 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj49 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj49' 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj49 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj49 ' 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.837 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-17T04:11:07.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.838 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj44 2026-02-17T04:11:07.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj44' 2026-02-17T04:11:07.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj44 2026-02-17T04:11:07.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:11:07.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj44 ' 2026-02-17T04:11:07.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.842 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj36 2026-02-17T04:11:07.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj36' 2026-02-17T04:11:07.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj36 2026-02-17T04:11:07.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:11:07.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj36 ' 2026-02-17T04:11:07.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj18' 2026-02-17T04:11:07.845 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj18 2026-02-17T04:11:07.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj18 2026-02-17T04:11:07.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:11:07.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj18 ' 2026-02-17T04:11:07.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.848 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj34 2026-02-17T04:11:07.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj34' 2026-02-17T04:11:07.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj34 2026-02-17T04:11:07.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj34 ' 2026-02-17T04:11:07.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.851 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj32 2026-02-17T04:11:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj32' 2026-02-17T04:11:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj32 2026-02-17T04:11:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj32 ' 2026-02-17T04:11:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj58' 2026-02-17T04:11:07.853 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj58 2026-02-17T04:11:07.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj58 2026-02-17T04:11:07.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj58 ' 2026-02-17T04:11:07.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.855 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj16 2026-02-17T04:11:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj16' 2026-02-17T04:11:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj16 2026-02-17T04:11:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:11:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj16 ' 2026-02-17T04:11:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.857 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj37 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj37' 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj37 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj37 ' 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:11:07.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-17T04:11:07.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj35 2026-02-17T04:11:07.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.860 INFO:tasks.workunit.client.0.trial090.stdout:Object obj35: acting: 2 0 1 2026-02-17T04:11:07.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj35: acting: 2 0 1' 2026-02-17T04:11:07.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.862 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj35 (20) 0 1 2' 2026-02-17T04:11:07.863 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj35 (20) 0 1 2 2026-02-17T04:11:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj35' 2026-02-17T04:11:07.864 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj35 2026-02-17T04:11:07.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj35 ' 2026-02-17T04:11:07.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj50 2026-02-17T04:11:07.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.866 INFO:tasks.workunit.client.0.trial090.stdout:Object obj50: acting: 1 0 2 2026-02-17T04:11:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj50: acting: 1 0 2' 2026-02-17T04:11:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.867 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj50 (21) 0 2 1' 2026-02-17T04:11:07.868 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj50 (21) 0 2 1 2026-02-17T04:11:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.869 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj50 2026-02-17T04:11:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj50' 2026-02-17T04:11:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj50 ' 2026-02-17T04:11:07.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj19 2026-02-17T04:11:07.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.871 INFO:tasks.workunit.client.0.trial090.stdout:Object obj19: acting: 1 0 2 2026-02-17T04:11:07.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj19: acting: 1 0 2' 2026-02-17T04:11:07.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.872 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj19 (22) 0 2 1' 2026-02-17T04:11:07.873 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj19 (22) 0 2 1 2026-02-17T04:11:07.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj19' 2026-02-17T04:11:07.875 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj19 2026-02-17T04:11:07.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj19 ' 2026-02-17T04:11:07.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj2 2026-02-17T04:11:07.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.876 INFO:tasks.workunit.client.0.trial090.stdout:Object obj2: acting: 1 0 2 2026-02-17T04:11:07.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj2: acting: 1 0 2' 2026-02-17T04:11:07.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.877 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj2 (23) 0 2 1' 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj2 (23) 0 2 1 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.879 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj2 2026-02-17T04:11:07.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj2' 2026-02-17T04:11:07.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj2 ' 2026-02-17T04:11:07.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj38 2026-02-17T04:11:07.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.880 INFO:tasks.workunit.client.0.trial090.stdout:Object obj38: acting: 0 1 2 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj38: acting: 0 1 2' 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj38 (24) 1 2 0' 2026-02-17T04:11:07.881 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj38 (24) 1 2 0 2026-02-17T04:11:07.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:11:07.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj38' 2026-02-17T04:11:07.882 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj38 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj38 ' 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj25 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj25: acting: 1 0 2' 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stdout:Object obj25: acting: 1 0 2 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.883 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj25 (25) 0 2 1' 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj25 (25) 0 2 1 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj25' 2026-02-17T04:11:07.884 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj25 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj25 ' 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj12 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stdout:Object obj12: acting: 2 0 1 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj12: acting: 2 0 1' 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.885 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj12 (26) 0 1 2' 2026-02-17T04:11:07.886 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj12 (26) 0 1 2 2026-02-17T04:11:07.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj12' 2026-02-17T04:11:07.887 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj12 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj12 ' 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj33 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj33: acting: 0 1 2' 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stdout:Object obj33: acting: 0 1 2 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.888 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj33 (27) 1 2 0' 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj33 (27) 1 2 0 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj33 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj33' 2026-02-17T04:11:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj33 ' 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj39 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stdout:Object obj39: acting: 1 0 2 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj39: acting: 1 0 2' 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj39 (28) 0 2 1' 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj39 (28) 0 2 1 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj39' 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj39 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj39 ' 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj43 2026-02-17T04:11:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stdout:Object obj43: acting: 1 0 2 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj43: acting: 1 0 2' 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj43 (29) 0 2 1' 2026-02-17T04:11:07.892 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj43 (29) 0 2 1 2026-02-17T04:11:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.893 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj43 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj43' 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj43 ' 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj54 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj54: acting: 2 0 1' 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stdout:Object obj54: acting: 2 0 1 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.894 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj54 (30) 0 1 2' 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj54 (30) 0 1 2 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.895 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj54 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj54' 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj54 ' 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj7 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stdout:Object obj7: acting: 2 0 1 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj7: acting: 2 0 1' 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj7 (31) 0 1 2' 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj7 (31) 0 1 2 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj7 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj7' 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj7 ' 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj29 2026-02-17T04:11:07.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stdout:Object obj29: acting: 1 2 0 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj29: acting: 1 2 0' 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj29 (32) 2 0 1' 2026-02-17T04:11:07.898 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj29 (32) 2 0 1 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj29' 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj29 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj29 ' 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj23 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stdout:Object obj23: acting: 1 0 2 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj23: acting: 1 0 2' 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj23 (33) 0 2 1 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj23 (33) 0 2 1' 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.900 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj23 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj23' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj23 ' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj13 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stdout:Object obj13: acting: 2 0 1 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj13: acting: 2 0 1' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj13 (34) 0 1 2' 2026-02-17T04:11:07.901 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj13 (34) 0 1 2 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj13 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj13' 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj13 ' 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj57 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stdout:Object obj57: acting: 1 0 2 2026-02-17T04:11:07.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj57: acting: 1 0 2' 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj57 (35) 0 2 1' 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj57 (35) 0 2 1 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj57' 2026-02-17T04:11:07.903 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj57 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj57 ' 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj51 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj51: acting: 2 0 1' 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stdout:Object obj51: acting: 2 0 1 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj51 (36) 0 1 2' 2026-02-17T04:11:07.904 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj51 (36) 0 1 2 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj51 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj51' 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj51 ' 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj42 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj42: acting: 2 0 1' 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stdout:Object obj42: acting: 2 0 1 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj42 (37) 0 1 2' 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj42 (37) 0 1 2 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj42 2026-02-17T04:11:07.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj42' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj42 ' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj15 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj15: acting: 2 0 1' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stdout:Object obj15: acting: 2 0 1 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj15 (38) 0 1 2' 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj15 (38) 0 1 2 2026-02-17T04:11:07.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj15' 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj15 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj15 ' 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj11 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stdout:Object obj11: acting: 1 2 0 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj11: acting: 1 2 0' 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:11:07.908 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj11 (39) 2 0 1' 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj11 (39) 2 0 1 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj11 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj11' 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj11 ' 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:11:07.909 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:07.910 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:11:07.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:07.913 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:07.913 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:11:07.913 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:07.921 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:07.921 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:11:07.921 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:07.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:11:07.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:11:07.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:11:07.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:11:07.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:11:07.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:11:08.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:11:08.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:11:09.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:11:09.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:11:09.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj44 obj16 ' 2026-02-17T04:11:09.237 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj44 obj16 2026-02-17T04:11:09.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:09.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj44 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-17T04:11:09.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj44 rm-attr _ 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:11:09.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:11:09.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj16 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj16 2026-02-17T04:11:09.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj16 rm-attr _ 2026-02-17T04:11:09.476 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:09.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:09.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj35 obj19 obj12 obj39 obj54 obj13 obj51 obj15 obj11 ' obj_to_pgid delete_oi 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj35 obj19 obj12 obj39 obj54 obj13 obj51 obj15 obj11 ' 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj35 obj19 obj12 obj39 obj54 obj13 obj51 obj15 obj11 ]] 2026-02-17T04:11:09.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:11:09.520 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj35 obj19 obj12 obj39 obj54 obj13 obj51 obj15 obj11 2026-02-17T04:11:09.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj35 obj19 obj12 obj39 obj54 obj13 obj51 obj15 obj11 ' 2026-02-17T04:11:09.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj35 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj35 2026-02-17T04:11:09.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj35 rm-attr _ 2026-02-17T04:11:09.608 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:09.608 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:09.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:09.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj19 2026-02-17T04:11:09.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj19 2026-02-17T04:11:09.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj19 rm-attr _ 2026-02-17T04:11:09.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:09.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:09.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:09.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:09.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:09.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:09.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:09.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj12 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-17T04:11:09.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj12 rm-attr _ 2026-02-17T04:11:09.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:09.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:09.868 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:09.869 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:09.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:09.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj39 2026-02-17T04:11:09.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:09.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:09.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj39 2026-02-17T04:11:09.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj39 rm-attr _ 2026-02-17T04:11:09.999 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.000 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.000 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.000 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.000 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:10.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:10.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj54 2026-02-17T04:11:10.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:10.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj54 2026-02-17T04:11:10.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj54 rm-attr _ 2026-02-17T04:11:10.135 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:11:10.135 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.136 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.136 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.136 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.136 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj13 2026-02-17T04:11:10.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:10.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj13 2026-02-17T04:11:10.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj13 rm-attr _ 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bb038e88:::obj54:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.266 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:10.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:10.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj51 2026-02-17T04:11:10.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:10.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj51 2026-02-17T04:11:10.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj51 rm-attr _ 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bb038e88:::obj54:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.398 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:10.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj15 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-17T04:11:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj15 rm-attr _ 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bb038e88:::obj54:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:11:10.533 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.534 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.534 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:11:10.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj11 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-17T04:11:10.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj11 rm-attr _ 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bb038e88:::obj54:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:11:10.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-17T04:11:10.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-17T04:11:10.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:11:10.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:10.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:11:10.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:11:10.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj62 obj60 obj24 obj48 obj14 obj9 obj17 obj1 obj49 obj63 obj34 obj32 obj58 obj37 ' 2026-02-17T04:11:10.715 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj62 obj60 obj24 obj48 obj14 obj9 obj17 obj1 obj49 obj63 obj34 obj32 obj58 obj37 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj62 2026-02-17T04:11:10.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:10.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj62 2026-02-17T04:11:10.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj62 rm-attr _ 2026-02-17T04:11:10.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj60 2026-02-17T04:11:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:10.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-17T04:11:10.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj60 rm-attr _ 2026-02-17T04:11:10.934 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:10.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:10.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj24 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj24 2026-02-17T04:11:10.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj24 rm-attr _ 2026-02-17T04:11:11.062 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.062 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:11.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:11.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj48 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj48 2026-02-17T04:11:11.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj48 rm-attr _ 2026-02-17T04:11:11.210 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.211 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.211 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:11:11.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:11:11.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj14 2026-02-17T04:11:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj14 2026-02-17T04:11:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj14 rm-attr _ 2026-02-17T04:11:11.332 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.333 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.333 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.333 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:11.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:11:11.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:11:11.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj9 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj9 2026-02-17T04:11:11.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj9 rm-attr _ 2026-02-17T04:11:11.458 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.458 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:11.458 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.458 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.458 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj17 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj17 2026-02-17T04:11:11.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj17 rm-attr _ 2026-02-17T04:11:11.585 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.585 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:11.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:11.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:11:11.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:11:11.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-17T04:11:11.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1 rm-attr _ 2026-02-17T04:11:11.718 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.719 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:11.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj49 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj49 2026-02-17T04:11:11.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj49 rm-attr _ 2026-02-17T04:11:11.852 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.852 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:11.852 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:11.852 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:11.854 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:11.854 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.854 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.854 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:11.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:11.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-17T04:11:11.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-17T04:11:11.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:11.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:11.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:11.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:11.984 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:11.984 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:11.984 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:11.984 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:11.984 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:11:12.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:11:12.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj34 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj34 2026-02-17T04:11:12.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj34 rm-attr _ 2026-02-17T04:11:12.109 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.109 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.109 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.109 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj32 2026-02-17T04:11:12.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-17T04:11:12.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj32 rm-attr _ 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.239 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj58 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj58 2026-02-17T04:11:12.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj58 rm-attr _ 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.371 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.372 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.372 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.372 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.372 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:11:12.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj37 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj37 2026-02-17T04:11:12.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj37 rm-attr _ 2026-02-17T04:11:12.500 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.501 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.502 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.502 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj38 obj7 obj42 ' obj_to_pgid delete_oi 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj38 obj7 obj42 ' 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:11:12.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:11:12.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj38 obj7 obj42 ]] 2026-02-17T04:11:12.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:11:12.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj38 obj7 obj42 ' 2026-02-17T04:11:12.541 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj38 obj7 obj42 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj38 2026-02-17T04:11:12.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj38 2026-02-17T04:11:12.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj38 rm-attr _ 2026-02-17T04:11:12.643 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.643 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.643 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:11:12.643 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.644 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:11:12.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:11:12.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj7 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-17T04:11:12.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj7 rm-attr _ 2026-02-17T04:11:12.773 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.775 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.775 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:12.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj42 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-17T04:11:12.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj42 rm-attr _ 2026-02-17T04:11:12.906 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:11:12.907 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:11:12.908 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-17T04:11:12.908 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-17T04:11:12.908 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:11:12.908 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:11:12.908 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-17T04:11:12.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:12.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:12.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:12.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:11:12.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:11:12.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj28 obj52 obj36 obj18 ' 2026-02-17T04:11:12.944 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj28 obj52 obj36 obj18 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj28 2026-02-17T04:11:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj28 2026-02-17T04:11:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj28 rm-attr _ 2026-02-17T04:11:13.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:13.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:13.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj52 2026-02-17T04:11:13.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj52 2026-02-17T04:11:13.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj52 rm-attr _ 2026-02-17T04:11:13.175 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:13.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:13.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj36 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-17T04:11:13.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj36 rm-attr _ 2026-02-17T04:11:13.305 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.305 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:11:13.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:11:13.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj18 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj18 2026-02-17T04:11:13.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj18 rm-attr _ 2026-02-17T04:11:13.444 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:13.444 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.444 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj50 obj2 obj25 obj33 obj43 obj29 obj23 obj57 ' obj_to_pgid delete_oi 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj50 obj2 obj25 obj33 obj43 obj29 obj23 obj57 ' 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj50 obj2 obj25 obj33 obj43 obj29 obj23 obj57 ]] 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj50 obj2 obj25 obj33 obj43 obj29 obj23 obj57 ' 2026-02-17T04:11:13.483 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj50 obj2 obj25 obj33 obj43 obj29 obj23 obj57 2026-02-17T04:11:13.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:11:13.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:13.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj50 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj50 2026-02-17T04:11:13.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj50 rm-attr _ 2026-02-17T04:11:13.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:13.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:13.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:13.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj2 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-17T04:11:13.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj2 rm-attr _ 2026-02-17T04:11:13.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:13.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:13.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:13.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:13.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:13.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj25 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj25 2026-02-17T04:11:13.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj25 rm-attr _ 2026-02-17T04:11:13.836 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:13.836 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:13.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:13.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:13.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:13.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:13.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:13.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:11:13.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:11:13.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:13.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj33 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:13.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj33 2026-02-17T04:11:13.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj33 rm-attr _ 2026-02-17T04:11:13.965 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:13.965 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:11:13.966 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:13.966 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:13.966 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:13.966 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:13.966 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:11:14.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:11:14.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj43 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:14.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj43 2026-02-17T04:11:14.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj43 rm-attr _ 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:14.103 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-17T04:11:14.104 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:14.104 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:14.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:14.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:14.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:14.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:11:14.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:11:14.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:14.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj29 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:14.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj29 2026-02-17T04:11:14.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj29 rm-attr _ 2026-02-17T04:11:14.224 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:14.224 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:11:14.224 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:14.224 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:14.224 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:14.225 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-17T04:11:14.225 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:14.225 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:14.225 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-17T04:11:14.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:14.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:14.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:14.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:11:14.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:11:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj23 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj23 2026-02-17T04:11:14.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj23 rm-attr _ 2026-02-17T04:11:14.353 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:14.354 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:11:14.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj57 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj57 2026-02-17T04:11:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj57 rm-attr _ 2026-02-17T04:11:14.489 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:11:14.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-17T04:11:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:11:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:11:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:11:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:11:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:11:25.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:516: corrupt_and_measure: echo 'Setting osd_deep_scrub_stride to 4194304' 2026-02-17T04:11:25.558 INFO:tasks.workunit.client.0.trial090.stdout:Setting osd_deep_scrub_stride to 4194304 2026-02-17T04:11:25.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:517: corrupt_and_measure: ceph tell 'osd.*' config set osd_deep_scrub_stride 4194304 2026-02-17T04:11:25.610 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:25.610 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:25.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:25.619 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:25.619 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:25.620 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:25.627 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:25.627 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-17T04:11:25.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:25.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:11:30.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:11:30.791 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:18.213491+0000 18'6 32:54 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:18.213462+0000 18'7 32:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-17T04:11:18.213140+0000 18'16 32:50 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:18.213442+0000 18'6 32:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-17T04:11:18.213263+0000 18'8 32:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:18.212858+0000 18'7 32:65 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-17T04:11:18.213056+0000 18'3 32:40 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-17T04:11:18.213465+0000 18'11 32:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:30.792 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:30.793 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:11:30.793 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:11:30.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:30.800 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:11:30.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:11:30.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:11:30.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:11:30.858 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:11:30.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:11:30.912 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:30.912 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:11:30.912 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:30.920 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:30.921 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:11:30.921 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:30.928 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:30.928 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:11:30.928 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:30.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:11:31.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:11:31.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301491934066845 2026-02-17T04:11:31.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:11:31.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:11:31.935530329' 2026-02-17T04:11:31.936 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:11:31.935530329 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:11:31.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:11:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:11:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:11:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:11:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:11:32.092 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:11:32.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:11:32.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301492103179197 2026-02-17T04:11:32.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:11:32.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:11:32.104428462 (169 ms)' 2026-02-17T04:11:32.105 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:11:32.104428462 (169 ms) 2026-02-17T04:11:32.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.106 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:11:32.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:11:32.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.107 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:11:32.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:11:32.109 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:11:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.109 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:11:32.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:11:32.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:11:32.110 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:11:32.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.111 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:11:32.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:11:32.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.112 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:11:32.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:11:32.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:11:32.113 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:11:32.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:11:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:11:32.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:11:32.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:18.213491+0000 18'6 32:54 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:18.213462+0000 18'7 32:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-17T04:11:18.213140+0000 18'16 32:51 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:18.213442+0000 18'6 32:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-17T04:11:18.213263+0000 18'8 32:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:18.212858+0000 18'7 32:65 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.429 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-17T04:11:18.213056+0000 18'3 32:40 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.430 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-17T04:11:18.213465+0000 18'11 32:67 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:32.430 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:32.430 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:11:32.430 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:11:32.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:11:32.491 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:32.491 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:32.492 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.499 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:32.499 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:32.500 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.507 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:32.507 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:32.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:11:32.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301492513220401 2026-02-17T04:11:32.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:11:32.515 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:11:32.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:11:32.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.568 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.568 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.568 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.574 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:11:32.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:11:32.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:11:32.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.626 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.626 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.626 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.630 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:11:32.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:11:32.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:11:32.683 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.683 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.684 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.684 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.684 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.688 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:11:32.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:11:32.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:11:32.741 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.741 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.741 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.741 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.741 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.746 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:11:32.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:11:32.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:11:32.799 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.799 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.799 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.799 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.799 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.803 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:11:32.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:11:32.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:11:32.855 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.855 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.855 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.855 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.856 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.859 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:11:32.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:11:32.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:11:32.912 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.912 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.912 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.913 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.913 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:32.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:11:32.917 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:11:32.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:11:32.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:11:32.970 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:32.970 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:11:32.970 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:11:32.970 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:11:32.970 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:11:32.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:11:33.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:11:33.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:11:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301493140195062 2026-02-17T04:11:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=626 2026-02-17T04:11:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:11:33.197 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:33.197 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:33.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:33.205 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:33.205 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:33.205 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:33.212 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:33.212 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:33.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:11:35.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:18.213491+0000 18'6 32:55 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:18.213462+0000 18'7 32:56 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean+inconsistent 2026-02-17T04:11:33.163036+0000 18'16 32:62 [2,0,1] 2 [2,0,1] 2 18'16 2026-02-17T04:11:33.162993+0000 18'16 2026-02-17T04:11:33.162993+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:33.162993+0000 16 0 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean+inconsistent 2026-02-17T04:11:33.338167+0000 18'6 32:64 [1,0,2] 1 [1,0,2] 1 18'6 2026-02-17T04:11:33.338133+0000 18'6 2026-02-17T04:11:33.338133+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:33.338133+0000 6 0 2026-02-17T04:11:35.377 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-17T04:11:18.213263+0000 18'8 32:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:10:54.616963+0000 0 0 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean+inconsistent 2026-02-17T04:11:33.804544+0000 18'7 32:75 [0,1,2] 0 [0,1,2] 0 18'7 2026-02-17T04:11:33.804519+0000 18'7 2026-02-17T04:11:33.804519+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:33.804519+0000 7 0 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-17T04:11:18.213056+0000 18'3 32:41 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-17T04:11:18.213465+0000 18'11 32:68 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:10:54.616963+0000 0'0 2026-02-17T04:10:54.616963+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:11:35.378 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:11:35.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2b 3 8 8 20 20 4194300 4194304 4194304 626 2026-02-17T04:11:35.386 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_2b@ NAUT 3 8 8 20/ 20 4194300 4194304/4194304 626 2026-02-17T04:11:35.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.387 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:11:35.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:11:35.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:11:35.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.405 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:11:35.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:11:35.406 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:11:35.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:11:35.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.422 INFO:tasks.workunit.client.0.trial090.stdout:1465 2026-02-17T04:11:35.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:11:35.423 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:11:35.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:11:35.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.440 INFO:tasks.workunit.client.0.trial090.stdout:881 2026-02-17T04:11:35.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:11:35.441 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:11:35.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:11:35.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.457 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:11:35.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:11:35.458 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:11:35.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:11:35.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.472 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:11:35.472 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:11:35.473 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:11:35.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:11:35.474 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:11:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:11:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.489 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:11:35.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:11:35.490 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:11:35.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:11:35.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.506 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:11:35.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:35.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:11:35.507 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:11:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:11:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:11:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:11:35.523 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:11:35.523 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:11:35.524 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:11:35.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:11:35.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:11:41.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:11:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:11:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:11:41.248 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:41.249 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:41.249 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:41.256 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:41.257 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:41.257 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:41.264 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:41.264 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:41.264 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:41.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:11:41.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301501270192624 2026-02-17T04:11:41.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:41.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:11:41.427 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:11:41.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:41.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:11:41.588 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:11:41.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:41.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:11:41.749 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:11:41.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:41.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:11:41.912 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:11:41.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:41.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:11:42.075 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:11:42.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:42.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:11:42.242 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:11:42.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:42.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:11:42.410 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:11:42.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:11:42.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:11:42.571 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:11:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:11:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:11:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:11:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:11:42.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:11:42.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:11:42.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:11:42.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:11:42.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:11:42.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301502742502738 2026-02-17T04:11:42.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1472 2026-02-17T04:11:42.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:11:42.801 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:11:42.801 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:42.801 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:42.809 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:11:42.809 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:42.809 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:42.816 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:11:42.816 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:11:42.816 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:42.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:11:47.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:44.428083+0000 18'6 32:89 [1,2,0] 1 [1,2,0] 1 18'6 2026-02-17T04:11:44.389744+0000 18'6 2026-02-17T04:11:44.389744+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:44.389744+0000 6 0 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:43.386796+0000 18'7 32:92 [1,0,2] 1 [1,0,2] 1 18'7 2026-02-17T04:11:43.344347+0000 18'7 2026-02-17T04:11:43.344347+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:43.344347+0000 7 0 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-17T04:11:42.290218+0000 18'16 32:100 [2,0,1] 2 [2,0,1] 2 18'16 2026-02-17T04:11:42.216909+0000 18'16 2026-02-17T04:11:42.216909+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:42.216909+0000 16 0 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-17T04:11:42.357550+0000 18'6 32:87 [1,0,2] 1 [1,0,2] 1 18'6 2026-02-17T04:11:42.335995+0000 18'6 2026-02-17T04:11:42.335995+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:42.335995+0000 6 0 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean+inconsistent 2026-02-17T04:11:37.397697+0000 18'8 32:71 [1,2,0] 1 [1,2,0] 1 18'8 2026-02-17T04:11:37.397666+0000 18'8 2026-02-17T04:11:37.397666+0000 0 1 queued for deep scrub 8 0 2026-02-17T04:11:47.979 INFO:tasks.workunit.client.0.trial090.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-17T04:11:42.796363+0000 18'7 32:101 [0,1,2] 0 [0,1,2] 0 18'7 2026-02-17T04:11:42.767931+0000 18'7 2026-02-17T04:11:42.767931+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:42.767931+0000 7 0 2026-02-17T04:11:47.980 INFO:tasks.workunit.client.0.trial090.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-17T04:11:43.177399+0000 18'3 32:71 [2,0,1] 2 [2,0,1] 2 18'3 2026-02-17T04:11:43.163591+0000 18'3 2026-02-17T04:11:43.163591+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:43.163591+0000 3 0 2026-02-17T04:11:47.980 INFO:tasks.workunit.client.0.trial090.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-17T04:11:45.478358+0000 18'11 32:114 [1,0,2] 1 [1,0,2] 1 18'11 2026-02-17T04:11:45.428947+0000 18'11 2026-02-17T04:11:45.428947+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:11:45.428947+0000 11 0 2026-02-17T04:11:47.980 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:11:47.980 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:11:47.980 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:11:47.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2b 3 8 8 20 20 4194300 4194304 4194304 1472 2026-02-17T04:11:47.987 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_2b@ REPR 3 8 8 20/ 20 4194300 4194304/4194304 1472 2026-02-17T04:11:47.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:11:47.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:11:47.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:11:47.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:11:47.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:11:47.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:11:47.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0411 2026-02-17T04:11:47.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:11:47.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:11:47.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.073 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.074 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 4, 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.075 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.076 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.077 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.078 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.079 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.080 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870400 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.081 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.082 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.056999441, 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.028499720 2026-02-17T04:11:48.083 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.084 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.085 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.086 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.087 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.088 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.089 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.090 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.091 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.092 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.093 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.094 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 4, 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.095 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.096 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.097 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.098 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870400 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.099 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.100 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.056999441, 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.028499720 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.101 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.102 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.103 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.104 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.105 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.106 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.107 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:48.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.121 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 22, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.122 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.123 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.124 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870400 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.125 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.126 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.317996878, 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.031799687 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.127 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.128 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.129 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.130 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.131 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.132 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.133 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 22, 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.134 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.135 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.136 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870400 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.137 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.317996878, 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.031799687 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.138 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.140 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.141 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.142 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.143 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:48.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.180 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 10, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.181 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.182 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 536870400 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.154998483, 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.038749620 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.185 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.187 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.189 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 10, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:48.190 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.191 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 536870400 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.154998483, 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.038749620 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.193 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:48.194 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.195 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:48.196 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.197 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:48.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:48.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:56.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:11:56.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:56.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:56.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.553 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.554 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.555 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.556 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.557 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.560 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805305600 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.561 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:11:56.562 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.088999125, 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.029666375 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.563 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.564 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.565 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.566 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.567 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.568 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.569 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.570 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.571 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.572 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.573 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.574 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.575 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.576 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.577 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.578 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805305600 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.579 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.088999125, 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.029666375 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.580 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.581 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.582 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.583 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.584 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.585 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.586 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.587 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:56.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.599 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 33, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.600 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.601 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805305600 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 15, 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.474995342, 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.031666356 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.607 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 33, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.608 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805305600 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 15, 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.474995342, 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.031666356 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:56.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.658 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 15, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.659 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.660 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 805305600 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.234997698, 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.039166283 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.661 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:11:56.662 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.663 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.664 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.665 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 15, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:11:56.666 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.667 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 805305600 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.234997698, 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.039166283 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.668 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.669 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.670 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.671 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:11:56.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:12:07.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:12:07.276 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:12:07.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:12:07.482 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:12:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:12:07.687 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 12582912 4 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:12:07.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-17T04:12:07.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=12582912 2026-02-17T04:12:07.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:12:07.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:12:07.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301527697982636 2026-02-17T04:12:07.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 12582912 2026-02-17T04:12:07.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=12582912 2026-02-17T04:12:07.700 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:12:07.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.LQz0CJoTZw bs=12582912 count=1 2026-02-17T04:12:07.731 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:12582912 bytes (13 MB, 12 MiB) copied, 0.0286879 s, 439 MB/s 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:07.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:07.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:09.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:09.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:09.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:10.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:10.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:10.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:10.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:12:11.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:12:11.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:12:11.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:12:11.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.LQz0CJoTZw 2026-02-17T04:12:11.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:12:11.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301531942070029 2026-02-17T04:12:11.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=4244 2026-02-17T04:12:11.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 4244 ms' 2026-02-17T04:12:11.943 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 128 objects in pool test in 4244 ms 2026-02-17T04:12:11.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:12:11.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:12:11.943383323' 2026-02-17T04:12:11.944 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:12:11.943383323 2026-02-17T04:12:11.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:12:11.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:12:11.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:12:12.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:12:12.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:12:12.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-17T04:12:12.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-17T04:12:12.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T04:12:12.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:12:12.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:12:12.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672974 2026-02-17T04:12:12.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672974 2026-02-17T04:12:12.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-42949672974' 2026-02-17T04:12:12.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:12:12.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:12:12.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509451 2026-02-17T04:12:12.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509451 2026-02-17T04:12:12.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509451' 2026-02-17T04:12:12.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:12:12.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-17T04:12:12.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:12:12.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:12:12.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-17T04:12:12.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:12:12.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-17T04:12:12.380 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836496 2026-02-17T04:12:12.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T04:12:12.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:12:12.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836496 2026-02-17T04:12:12.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:12:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:12:13.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:12:13.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-17T04:12:13.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:12:13.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672974 2026-02-17T04:12:13.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:12:13.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:12:13.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672974 2026-02-17T04:12:13.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:12:13.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672974 2026-02-17T04:12:13.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2026-02-17T04:12:13.717 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672974 2026-02-17T04:12:13.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:12:13.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672974 2026-02-17T04:12:13.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:12:13.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509451 2026-02-17T04:12:13.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:12:13.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:12:13.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509451 2026-02-17T04:12:13.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:12:13.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509451 2026-02-17T04:12:13.886 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509451 2026-02-17T04:12:13.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509451' 2026-02-17T04:12:13.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:12:14.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509452 -lt 64424509451 2026-02-17T04:12:14.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:12:14.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:12:14.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:12:14.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:12:14.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:12:14.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:12:14.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:12:14.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:12:14.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:12:14.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:12:14.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:12:14.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:12:14.792 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:12:14.792 INFO:tasks.workunit.client.0.trial090.stdout: client io 339 MiB/s wr, 0 op/s rd, 84 op/s wr 2026-02-17T04:12:14.792 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:12:14.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:12:14.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:12:19.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:12:19.957 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:12:19.957 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:03.760058+0000 22'42 22:62 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-17T04:12:03.760076+0000 22'48 22:68 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-17T04:12:03.657916+0000 22'69 22:90 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:03.759197+0000 22'42 22:63 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:03.760010+0000 22'42 22:63 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-17T04:12:03.758791+0000 22'36 22:59 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-17T04:12:03.658101+0000 22'33 22:56 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-17T04:12:03.759473+0000 22'72 22:95 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:12:19.958 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:12:19.959 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:12:19.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:19.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:12:19.966 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:12:19.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:12:19.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:12:20.023 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:12:20.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:12:20.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:12:20.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:12:20.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:12:20.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:12:20.081646621' 2026-02-17T04:12:20.083 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:12:20.081646621 2026-02-17T04:12:20.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301540082749140 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:12:20.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:12:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:12:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:12:22.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:12:22.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301542166871891 2026-02-17T04:12:22.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:12:22.168 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:12:22.168033881 (2084 ms) 2026-02-17T04:12:22.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:12:22.168033881 (2084 ms)' 2026-02-17T04:12:22.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-17T04:12:22.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:12:22.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:12:22.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-17T04:12:22.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-17T04:12:22.171 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 40 2026-02-17T04:12:22.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.172 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj36 2026-02-17T04:12:22.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj36' 2026-02-17T04:12:22.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.173 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 128 2026-02-17T04:12:22.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-17T04:12:22.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:12:22.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:12:22.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:12:22.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.175 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj36 2026-02-17T04:12:22.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj36' 2026-02-17T04:12:22.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj36 2026-02-17T04:12:22.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:12:22.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj36 ' 2026-02-17T04:12:22.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.177 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj119 2026-02-17T04:12:22.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj119' 2026-02-17T04:12:22.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj119 2026-02-17T04:12:22.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:12:22.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj119 ' 2026-02-17T04:12:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.179 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj64 2026-02-17T04:12:22.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj64' 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj64 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj64 ' 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.183 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj37 2026-02-17T04:12:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj37' 2026-02-17T04:12:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj37 2026-02-17T04:12:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj37 ' 2026-02-17T04:12:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.185 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj99 2026-02-17T04:12:22.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj99' 2026-02-17T04:12:22.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj99 2026-02-17T04:12:22.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:12:22.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj99 ' 2026-02-17T04:12:22.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.189 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj53 2026-02-17T04:12:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj53' 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj53 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj53 ' 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.190 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj61 2026-02-17T04:12:22.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj61' 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj61 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj61 ' 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.192 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj11 2026-02-17T04:12:22.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj11' 2026-02-17T04:12:22.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj11 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj11 ' 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.194 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj106 2026-02-17T04:12:22.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj106' 2026-02-17T04:12:22.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj106 2026-02-17T04:12:22.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj106 ' 2026-02-17T04:12:22.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.196 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj103 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj103' 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj103 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj103 ' 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.198 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj79 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj79' 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj79 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj79 ' 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.200 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj55 2026-02-17T04:12:22.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj55' 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj55 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj55 ' 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.201 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj58 2026-02-17T04:12:22.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj58' 2026-02-17T04:12:22.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj58 2026-02-17T04:12:22.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj58 ' 2026-02-17T04:12:22.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.203 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj120 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj120' 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj120 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj120 ' 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.205 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj122 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj122' 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj122 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj122 ' 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.206 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj27 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj27' 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj27 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj27 ' 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.208 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj104 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj104' 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj104 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj104 ' 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj4' 2026-02-17T04:12:22.209 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj4 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj4 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj4 ' 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.211 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj88 2026-02-17T04:12:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj88' 2026-02-17T04:12:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj88 2026-02-17T04:12:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj88 ' 2026-02-17T04:12:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.212 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj32 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj32' 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj32 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj32 ' 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj127 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj127: acting: 1 2 0' 2026-02-17T04:12:22.214 INFO:tasks.workunit.client.0.trial090.stdout:Object obj127: acting: 1 2 0 2026-02-17T04:12:22.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:12:22.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.214 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj127 (20) 2 0 1' 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj127 (20) 2 0 1 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj127 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj127' 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj127 ' 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj98 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stdout:Object obj98: acting: 1 0 2 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj98: acting: 1 0 2' 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.218 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj98 (21) 0 2 1' 2026-02-17T04:12:22.218 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj98 (21) 0 2 1 2026-02-17T04:12:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj98' 2026-02-17T04:12:22.219 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj98 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj98 ' 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj114 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stdout:Object obj114: acting: 2 0 1 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj114: acting: 2 0 1' 2026-02-17T04:12:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj114 (22) 0 1 2' 2026-02-17T04:12:22.221 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj114 (22) 0 1 2 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj114 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj114' 2026-02-17T04:12:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj114 ' 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj45 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stdout:Object obj45: acting: 1 2 0 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj45: acting: 1 2 0' 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:12:22.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj45 (23) 2 0 1' 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj45 (23) 2 0 1 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj45 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj45' 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj45 ' 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj47 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj47: acting: 1 0 2' 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stdout:Object obj47: acting: 1 0 2 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj47 (24) 0 2 1' 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj47 (24) 0 2 1 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj47' 2026-02-17T04:12:22.227 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj47 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj47 ' 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj8 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stdout:Object obj8: acting: 2 0 1 2026-02-17T04:12:22.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj8: acting: 2 0 1' 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj8 (25) 0 1 2' 2026-02-17T04:12:22.229 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj8 (25) 0 1 2 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj8 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj8' 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj8 ' 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj60 2026-02-17T04:12:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stdout:Object obj60: acting: 1 0 2 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj60: acting: 1 0 2' 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj60 (26) 0 2 1' 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj60 (26) 0 2 1 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.232 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj60 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj60' 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj60 ' 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj92 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stdout:Object obj92: acting: 1 0 2 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj92: acting: 1 0 2' 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.233 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj92 (27) 0 2 1' 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj92 (27) 0 2 1 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.234 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj92 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj92' 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj92 ' 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj74 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stdout:Object obj74: acting: 2 0 1 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj74: acting: 2 0 1' 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj74 (28) 0 1 2 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj74 (28) 0 1 2' 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.236 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj74 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj74' 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj74 ' 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj26 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj26: acting: 1 2 0' 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stdout:Object obj26: acting: 1 2 0 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:12:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj26 (29) 2 0 1' 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj26 (29) 2 0 1 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.238 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj26 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj26' 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj26 ' 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj41 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj41: acting: 2 0 1' 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stdout:Object obj41: acting: 2 0 1 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj41 (30) 0 1 2' 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj41 (30) 0 1 2 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.240 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj41 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj41' 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj41 ' 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj71 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stdout:Object obj71: acting: 1 0 2 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj71: acting: 1 0 2' 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.241 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj71 (31) 0 2 1' 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj71 (31) 0 2 1 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.242 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj71 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj71' 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj71 ' 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj82 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stdout:Object obj82: acting: 1 2 0 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj82: acting: 1 2 0' 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.243 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj82 (32) 2 0 1' 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj82 (32) 2 0 1 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj82 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj82' 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj82 ' 2026-02-17T04:12:22.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj67 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stdout:Object obj67: acting: 1 2 0 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj67: acting: 1 2 0' 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj67 (33) 2 0 1' 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj67 (33) 2 0 1 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj67 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj67' 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj67 ' 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj33 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.246 INFO:tasks.workunit.client.0.trial090.stdout:Object obj33: acting: 0 1 2 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj33: acting: 0 1 2' 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj33 (34) 1 2 0' 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj33 (34) 1 2 0 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj33 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj33' 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj33 ' 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj17 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj17: acting: 1 0 2' 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stdout:Object obj17: acting: 1 0 2 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj17 (35) 0 2 1' 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj17 (35) 0 2 1 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.249 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj17 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj17' 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj17 ' 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj43 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stdout:Object obj43: acting: 1 0 2 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj43: acting: 1 0 2' 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj43 (36) 0 2 1' 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj43 (36) 0 2 1 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj43 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj43' 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj43 ' 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj42 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj42: acting: 2 0 1' 2026-02-17T04:12:22.251 INFO:tasks.workunit.client.0.trial090.stdout:Object obj42: acting: 2 0 1 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj42 (37) 0 1 2' 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj42 (37) 0 1 2 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj42' 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj42 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj42 ' 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj90 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj90: acting: 2 0 1' 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stdout:Object obj90: acting: 2 0 1 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj90 (38) 0 1 2' 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj90 (38) 0 1 2 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.254 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj90 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj90' 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj90 ' 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj86 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stdout:Object obj86: acting: 0 1 2 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj86: acting: 0 1 2' 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj86 (39) 1 2 0' 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj86 (39) 1 2 0 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj86 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj86' 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj86 ' 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:12:22.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:12:22.260 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:22.260 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:12:22.260 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:22.269 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:22.269 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:12:22.269 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:22.277 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:22.277 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:12:22.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:22.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:12:22.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:12:22.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:12:22.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:12:22.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:12:22.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:12:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:12:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:12:23.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:12:23.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:12:23.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj64 ' 2026-02-17T04:12:23.596 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj64 2026-02-17T04:12:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj64 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:23.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj64 2026-02-17T04:12:23.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj64 rm-attr _ 2026-02-17T04:12:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj114 obj45 obj47 obj60 obj74 obj26 obj41 obj67 obj43 obj90 ' obj_to_pgid delete_oi 2026-02-17T04:12:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj114 obj45 obj47 obj60 obj74 obj26 obj41 obj67 obj43 obj90 ' 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj114 obj45 obj47 obj60 obj74 obj26 obj41 obj67 obj43 obj90 ]] 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj114 obj45 obj47 obj60 obj74 obj26 obj41 obj67 obj43 obj90 ' 2026-02-17T04:12:23.739 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj114 obj45 obj47 obj60 obj74 obj26 obj41 obj67 obj43 obj90 2026-02-17T04:12:23.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:23.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:23.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj114 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj114 2026-02-17T04:12:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj114 rm-attr _ 2026-02-17T04:12:23.836 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:23.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:23.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:23.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:23.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:23.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj45 2026-02-17T04:12:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj45 2026-02-17T04:12:23.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj45 rm-attr _ 2026-02-17T04:12:23.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:23.968 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj47 2026-02-17T04:12:24.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-17T04:12:24.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj47 rm-attr _ 2026-02-17T04:12:24.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.096 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.096 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj60 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-17T04:12:24.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj60 rm-attr _ 2026-02-17T04:12:24.250 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj74 2026-02-17T04:12:24.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj74 2026-02-17T04:12:24.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj74 rm-attr _ 2026-02-17T04:12:24.386 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.388 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.388 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.388 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:24.388 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:24.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:24.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj26 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-17T04:12:24.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj26 rm-attr _ 2026-02-17T04:12:24.528 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:acfc8dd9:::obj74:head#, (61) No data available 2026-02-17T04:12:24.528 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.529 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.530 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.530 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:24.530 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:24.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:24.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj41 2026-02-17T04:12:24.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj41 2026-02-17T04:12:24.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj41 rm-attr _ 2026-02-17T04:12:24.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:acfc8dd9:::obj74:head#, (61) No data available 2026-02-17T04:12:24.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:12:24.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:24.667 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:12:24.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:12:24.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj67 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj67 2026-02-17T04:12:24.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj67 rm-attr _ 2026-02-17T04:12:24.819 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:12:24.819 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:acfc8dd9:::obj74:head#, (61) No data available 2026-02-17T04:12:24.819 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.819 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:12:24.820 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.820 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:24.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:24.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj43 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj43 2026-02-17T04:12:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj43 rm-attr _ 2026-02-17T04:12:24.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:12:24.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:acfc8dd9:::obj74:head#, (61) No data available 2026-02-17T04:12:24.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:24.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-17T04:12:24.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:12:24.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:24.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:24.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:24.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:24.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:24.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:24.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:24.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:12:24.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:12:24.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:24.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj90 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:12:24.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj90 2026-02-17T04:12:24.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj90 rm-attr _ 2026-02-17T04:12:25.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:12:25.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:acfc8dd9:::obj74:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:12:25.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:12:25.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:25.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:12:25.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:12:25.133 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj37 obj53 obj61 obj11 obj106 obj103 obj79 obj58 obj120 obj122 obj27 obj104 obj4 obj88 obj32 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj37 obj53 obj61 obj11 obj106 obj103 obj79 obj58 obj120 obj122 obj27 obj104 obj4 obj88 obj32 ' 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:12:25.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj37 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj37 2026-02-17T04:12:25.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj37 rm-attr _ 2026-02-17T04:12:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:12:25.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:12:25.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj53 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj53 2026-02-17T04:12:25.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj53 rm-attr _ 2026-02-17T04:12:25.378 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:25.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:25.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj61 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj61 2026-02-17T04:12:25.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj61 rm-attr _ 2026-02-17T04:12:25.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:25.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:25.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj11 2026-02-17T04:12:25.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-17T04:12:25.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj11 rm-attr _ 2026-02-17T04:12:25.656 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:25.658 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:25.658 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:12:25.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj106 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj106 2026-02-17T04:12:25.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj106 rm-attr _ 2026-02-17T04:12:25.783 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:25.785 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:25.785 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:25.786 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:25.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj103 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj103 2026-02-17T04:12:25.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj103 rm-attr _ 2026-02-17T04:12:25.918 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:25.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:25.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:25.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:25.921 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:25.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:25.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:25.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:25.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj79 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj79 2026-02-17T04:12:25.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj79 rm-attr _ 2026-02-17T04:12:26.063 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.064 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.064 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.065 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.066 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.066 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:26.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:26.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj58 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj58 2026-02-17T04:12:26.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj58 rm-attr _ 2026-02-17T04:12:26.207 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.208 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.208 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.208 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.210 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.210 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.210 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:26.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj120 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj120 2026-02-17T04:12:26.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj120 rm-attr _ 2026-02-17T04:12:26.340 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.342 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.342 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.342 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:26.342 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.343 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.344 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.344 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:26.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:26.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj122 2026-02-17T04:12:26.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj122 2026-02-17T04:12:26.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj122 rm-attr _ 2026-02-17T04:12:26.466 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:26.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.470 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.470 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.470 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.470 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:12:26.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:12:26.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj27 2026-02-17T04:12:26.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj27 2026-02-17T04:12:26.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj27 rm-attr _ 2026-02-17T04:12:26.599 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:26.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:26.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:26.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:26.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj104 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj104 2026-02-17T04:12:26.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj104 rm-attr _ 2026-02-17T04:12:26.730 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:26.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:26.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:26.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj4 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-17T04:12:26.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj4 rm-attr _ 2026-02-17T04:12:26.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:26.883 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:26.884 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:26.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:26.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:26.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:26.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:26.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:26.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj88 2026-02-17T04:12:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj88 2026-02-17T04:12:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj88 rm-attr _ 2026-02-17T04:12:27.027 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:27.031 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:27.031 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:27.032 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:27.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj32 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-17T04:12:27.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj32 rm-attr _ 2026-02-17T04:12:27.166 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:27.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:12:27.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-17T04:12:27.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:27.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:27.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:27.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj8 obj33 obj42 ' obj_to_pgid delete_oi 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj8 obj33 obj42 ' 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:12:27.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:12:27.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:12:27.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj8 obj33 obj42 ]] 2026-02-17T04:12:27.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:12:27.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj8 obj33 obj42 ' 2026-02-17T04:12:27.207 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj8 obj33 obj42 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj8 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj8 2026-02-17T04:12:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj8 rm-attr _ 2026-02-17T04:12:27.303 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:27.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:27.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj33 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj33 2026-02-17T04:12:27.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj33 rm-attr _ 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:27.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:27.433 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj42 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-17T04:12:27.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj42 rm-attr _ 2026-02-17T04:12:27.565 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:12:27.570 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:12:27.570 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7eaa9b8:::obj104:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-17T04:12:27.571 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-17T04:12:27.572 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:12:27.572 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:12:27.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:27.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:12:27.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:12:27.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj36 obj119 obj99 obj55 ' 2026-02-17T04:12:27.607 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj36 obj119 obj99 obj55 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj36 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-17T04:12:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj36 rm-attr _ 2026-02-17T04:12:27.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:12:27.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:12:27.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj119 2026-02-17T04:12:27.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:27.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj119 2026-02-17T04:12:27.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj119 rm-attr _ 2026-02-17T04:12:27.865 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:12:27.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:27.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj99 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj99 2026-02-17T04:12:27.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj99 rm-attr _ 2026-02-17T04:12:28.003 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.005 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:12:28.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj55 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-17T04:12:28.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj55 rm-attr _ 2026-02-17T04:12:28.141 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.143 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:28.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj127 obj98 obj92 obj71 obj82 obj17 obj86 ' obj_to_pgid delete_oi 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj127 obj98 obj92 obj71 obj82 obj17 obj86 ' 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj127 obj98 obj92 obj71 obj82 obj17 obj86 ]] 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj127 obj98 obj92 obj71 obj82 obj17 obj86 ' 2026-02-17T04:12:28.185 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj127 obj98 obj92 obj71 obj82 obj17 obj86 2026-02-17T04:12:28.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:12:28.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:28.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj127 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj127 2026-02-17T04:12:28.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj127 rm-attr _ 2026-02-17T04:12:28.276 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.276 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.277 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.277 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:12:28.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:12:28.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj98 2026-02-17T04:12:28.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj98 2026-02-17T04:12:28.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj98 rm-attr _ 2026-02-17T04:12:28.415 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.415 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.416 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:28.416 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.417 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:12:28.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj92 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj92 2026-02-17T04:12:28.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj92 rm-attr _ 2026-02-17T04:12:28.545 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:12:28.545 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.545 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.546 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:28.546 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.547 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj71 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj71 2026-02-17T04:12:28.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj71 rm-attr _ 2026-02-17T04:12:28.672 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:12:28.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:12:28.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:28.674 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.674 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj82 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj82 2026-02-17T04:12:28.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj82 rm-attr _ 2026-02-17T04:12:28.810 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:12:28.811 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:12:28.811 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:12:28.811 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.811 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.811 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:28.812 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.812 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj17 2026-02-17T04:12:28.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj17 2026-02-17T04:12:28.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj17 rm-attr _ 2026-02-17T04:12:28.940 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:12:28.940 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:12:28.940 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7c5b032:::obj82:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:28.941 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:12:28.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj86 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj86 2026-02-17T04:12:28.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj86 rm-attr _ 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-17T04:12:29.086 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-17T04:12:29.087 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f7c5b032:::obj82:head#, (61) No data available 2026-02-17T04:12:29.087 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:12:29.087 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:88e6b0fd:::obj99:head#, (61) No data available 2026-02-17T04:12:29.087 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:12:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:12:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:12:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:12:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:12:29.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:12:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:12:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:12:45.339 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:12:45.339 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927419+0000 22'42 34:81 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.339 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-17T04:12:32.927570+0000 22'48 34:91 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-17T04:12:32.829702+0000 22'69 34:104 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927508+0000 22'42 34:86 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927650+0000 22'42 34:87 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-17T04:12:32.926953+0000 22'36 34:94 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-17T04:12:32.829530+0000 22'33 34:73 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-17T04:12:32.927458+0000 22'72 34:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:12:45.340 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:12:45.341 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:12:45.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:45.347 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:12:45.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:12:45.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:12:45.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:12:45.405 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:12:45.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:12:45.459 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:45.459 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:12:45.459 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:45.467 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:45.467 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:12:45.467 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:45.475 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:45.475 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:12:45.475 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:45.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:12:46.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:12:46.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301566482356712 2026-02-17T04:12:46.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:12:46.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:12:46.483958730' 2026-02-17T04:12:46.485 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:12:46.483958730 2026-02-17T04:12:46.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:12:46.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:12:46.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:12:46.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:12:46.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:12:46.640 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:12:46.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:12:46.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301566651033923 2026-02-17T04:12:46.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:12:46.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:12:46.652056744 (168 ms)' 2026-02-17T04:12:46.653 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:12:46.652056744 (168 ms) 2026-02-17T04:12:46.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.653 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:12:46.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:12:46.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.655 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:12:46.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:12:46.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.656 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:12:46.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:12:46.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.657 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:12:46.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:12:46.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:12:46.658 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:12:46.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.659 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:12:46.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:12:46.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.660 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:12:46.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:12:46.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:12:46.662 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:12:46.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:46.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:12:46.662 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:12:46.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:12:46.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:12:46.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:12:46.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:12:46.978 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:12:46.978 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927419+0000 22'42 34:81 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-17T04:12:32.927570+0000 22'48 34:91 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-17T04:12:32.829702+0000 22'69 34:104 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927508+0000 22'42 34:86 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927650+0000 22'42 34:87 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-17T04:12:32.926953+0000 22'36 34:94 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-17T04:12:32.829530+0000 22'33 34:73 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-17T04:12:32.927458+0000 22'72 34:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:12:46.979 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:12:46.980 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:12:46.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:12:47.041 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:47.041 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.041 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.050 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:47.050 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.050 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.058 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:47.058 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.058 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:12:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301567063740365 2026-02-17T04:12:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:12:47.065 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:12:47.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:12:47.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.118 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.118 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.118 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:12:47.123 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:12:47.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:12:47.175 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.175 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.175 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.175 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.176 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:12:47.180 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:12:47.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:12:47.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.233 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.233 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.233 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:12:47.238 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:12:47.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:12:47.289 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.290 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.290 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.290 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.290 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:12:47.294 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:12:47.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:12:47.347 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.347 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.347 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.347 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.347 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.351 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:12:47.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:12:47.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:12:47.403 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.403 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.404 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.404 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.404 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:12:47.408 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:12:47.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:12:47.460 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.461 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:47.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:12:47.465 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:12:47.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:12:47.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:12:47.522 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:12:47.522 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:12:47.522 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:12:47.522 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:12:47.522 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:12:47.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:12:47.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:12:47.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:12:47.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301567704740917 2026-02-17T04:12:47.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=641 2026-02-17T04:12:47.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:12:47.761 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:47.761 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.761 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.770 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:47.770 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.770 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.777 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:47.777 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:47.777 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:47.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:12:49.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:12:49.941 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:12:49.941 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927419+0000 22'42 34:82 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:12:49.941 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-17T04:12:32.927570+0000 22'48 34:92 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:49.941 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean+inconsistent 2026-02-17T04:12:47.830485+0000 22'69 34:118 [2,0,1] 2 [2,0,1] 2 22'69 2026-02-17T04:12:47.830447+0000 22'69 2026-02-17T04:12:47.830447+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:47.830447+0000 23 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean+scrubbing+deep 2026-02-17T04:12:48.057008+0000 22'42 34:91 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 deep scrubbing for 1s 5 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:32.927650+0000 22'42 34:88 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:12:03.547143+0000 0 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean+inconsistent 2026-02-17T04:12:47.793275+0000 22'36 34:106 [0,1,2] 0 [0,1,2] 0 22'36 2026-02-17T04:12:47.793242+0000 22'36 2026-02-17T04:12:47.793242+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:47.793242+0000 12 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean+inconsistent 2026-02-17T04:12:48.608686+0000 22'33 34:84 [2,0,1] 2 [2,0,1] 2 22'33 2026-02-17T04:12:48.608659+0000 22'33 2026-02-17T04:12:48.608659+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:48.608659+0000 11 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-17T04:12:32.927458+0000 22'72 34:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:12:03.547143+0000 0'0 2026-02-17T04:12:03.547143+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:12:49.942 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:12:49.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_3 3 8 16 20 20 12582912 4194304 0 641 2026-02-17T04:12:49.948 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_3@ NAUT 3 8 16 20/ 20 12582912 4194304/ 0 641 2026-02-17T04:12:49.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:49.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:12:49.949 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:12:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:12:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:49.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:49.966 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:12:49.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:49.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:12:49.967 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:12:49.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:12:49.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:49.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:49.982 INFO:tasks.workunit.client.0.trial090.stdout:881 2026-02-17T04:12:49.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:49.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:12:49.983 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:12:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:12:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:49.999 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:12:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:12:50.001 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:12:50.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:12:50.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:50.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:50.016 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.7 2026-02-17T04:12:50.016 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:12:50.017 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:50.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:50.018 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:12:50.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:12:50.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:12:50.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:50.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:50.033 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:12:50.033 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:12:50.033 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:12:50.034 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:12:50.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:12:50.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:50.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:50.051 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:12:50.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:50.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:12:50.052 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:12:50.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:12:50.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:50.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:50.068 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:12:50.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:50.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:12:50.069 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:12:50.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:12:50.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:12:50.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:12:50.085 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:12:50.085 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:12:50.086 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:12:50.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:12:50.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:12:55.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:12:55.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:12:55.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:12:55.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:12:55.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:12:55.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:12:55.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:12:55.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:12:55.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:12:55.809 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:55.809 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:55.809 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:55.817 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:55.817 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:55.817 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:55.824 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:55.824 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:55.824 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:55.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:12:55.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301575831884056 2026-02-17T04:12:55.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:55.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:12:55.987 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:12:55.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:55.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:12:56.152 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:12:56.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:56.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:12:56.324 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:12:56.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:56.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:12:56.487 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:12:56.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:56.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:12:56.655 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:12:56.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:56.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:12:56.823 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:12:56.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:56.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:12:56.993 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:12:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:12:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:12:57.160 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:12:57.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:12:57.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:12:57.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:12:57.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301577345730678 2026-02-17T04:12:57.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1513 2026-02-17T04:12:57.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:12:57.402 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:12:57.403 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:57.403 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:57.410 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:12:57.410 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:57.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:57.418 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:12:57.418 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:12:57.418 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:12:57.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:13:02.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:13:02.585 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:13:02.585 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:58.372814+0000 22'42 34:121 [1,2,0] 1 [1,2,0] 1 22'42 2026-02-17T04:12:58.243493+0000 22'42 2026-02-17T04:12:58.243493+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:58.243493+0000 14 0 2026-02-17T04:13:02.585 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-17T04:12:57.382664+0000 22'48 34:130 [1,0,2] 1 [1,0,2] 1 22'48 2026-02-17T04:12:57.289554+0000 22'48 2026-02-17T04:12:57.289554+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:57.289554+0000 16 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-17T04:12:56.937559+0000 22'69 34:149 [2,0,1] 2 [2,0,1] 2 22'69 2026-02-17T04:12:56.797584+0000 22'69 2026-02-17T04:12:56.797584+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:56.797584+0000 23 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-17T04:12:56.298666+0000 22'42 34:118 [1,0,2] 1 [1,0,2] 1 22'42 2026-02-17T04:12:56.251545+0000 22'42 2026-02-17T04:12:56.251545+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:56.251545+0000 14 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean+scrubbing+deep+inconsistent+repair 2026-02-17T04:13:00.114850+0000 22'42 34:107 [1,2,0] 1 [1,2,0] 1 22'42 2026-02-17T04:12:52.196328+0000 22'42 2026-02-17T04:12:52.196328+0000 0 1 deep scrubbing for 1s 10 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-17T04:12:57.915481+0000 22'36 34:132 [0,1,2] 0 [0,1,2] 0 22'36 2026-02-17T04:12:57.849993+0000 22'36 2026-02-17T04:12:57.849993+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:57.849993+0000 12 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-17T04:12:57.937669+0000 22'33 34:116 [2,0,1] 2 [2,0,1] 2 22'33 2026-02-17T04:12:57.751401+0000 22'33 2026-02-17T04:12:57.751401+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:57.751401+0000 11 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-17T04:12:59.602564+0000 22'72 34:184 [1,0,2] 1 [1,0,2] 1 22'72 2026-02-17T04:12:59.392830+0000 22'72 2026-02-17T04:12:59.392830+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:59.392830+0000 24 0 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:13:02.586 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:13:02.587 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:13:02.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_3 3 8 16 20 20 12582912 4194304 0 1513 2026-02-17T04:13:02.594 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ large_obj_3@ REPR 3 8 16 20/ 20 12582912 4194304/ 0 1513 2026-02-17T04:13:02.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:13:02.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:13:02.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:13:02.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0413 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:13:02.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:02.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:02.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.685 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.686 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.687 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.688 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "value": 768 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.691 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3221225472 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.692 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.693 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.453994409, 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.226997204 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.694 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.695 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.696 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.697 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.698 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.699 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.700 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.701 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.702 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.703 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:02.704 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.704 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.704 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.704 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.704 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.705 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.706 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.707 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.708 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.709 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "value": 768 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3221225472 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.710 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.711 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.453994409, 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.226997204 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.712 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.713 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.714 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.715 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.716 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.717 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.718 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:02.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.733 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 36, 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.734 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.735 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.736 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 768 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3221225472 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.737 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 1.753978406, 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.175397840 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.738 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.739 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.740 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.741 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.742 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.743 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.744 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.745 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 36, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.746 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.747 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "value": 768 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.748 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3221225472 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.749 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 1.753978406, 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.175397840 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.750 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.751 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.752 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.753 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.754 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.790 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 16, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.791 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.792 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 768 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3221225472 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.793 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.901988893, 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.225497223 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.794 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.795 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.796 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.797 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:02.798 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:02.799 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 16, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.800 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:02.801 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:13:02.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 768 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3221225472 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.803 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.901988893, 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.225497223 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.804 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.805 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.806 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.807 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:02.808 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:02.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:02.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:11.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:13:11.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.181 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.182 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 9, 2026-02-17T04:13:11.183 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.184 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.185 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.186 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.187 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.188 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.189 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1110 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4655677440 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.190 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.191 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.192 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.697991404, 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.232663801 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.193 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.194 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.195 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:13:11.196 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.197 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.198 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.199 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.200 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.201 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.202 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.203 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.204 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 9, 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.205 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.206 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.207 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.208 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1110 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4655677440 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.209 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:13:11.210 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.697991404, 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.232663801 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.211 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.213 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.215 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.217 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.229 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 51, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.230 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.231 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1110 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4655677440 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.232 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 14, 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 2.486969375, 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.177640669 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.233 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.234 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.235 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.236 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.237 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 51, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.238 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.239 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1110 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4655677440 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.240 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 14, 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 2.486969375, 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.177640669 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.241 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.242 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.243 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.244 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:11.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.284 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 24, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:13:11.285 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 374 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 374 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 375 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 375 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1124 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4710203392 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 1.382982970, 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.230497161 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.289 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.290 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.291 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 24, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 374 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 374 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 375 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 375 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1124 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4710203392 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 1.382982970, 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.230497161 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:13:11.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.296 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.297 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:13:11.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:13:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:13:21.907 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:13:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:13:22.114 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:13:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:13:22.320 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:13:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:13:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:13:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 256 4 2026-02-17T04:13:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:13:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:13:22.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-17T04:13:22.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:13:22.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:13:22.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:13:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301602332442089 2026-02-17T04:13:22.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:13:22.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:13:22.334 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:13:22.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.QEXozUqFcj bs=256 count=1 2026-02-17T04:13:22.335 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:13:22.335 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:13:22.335 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 5.6255e-05 s, 4.6 MB/s 2026-02-17T04:13:22.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:13:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:13:22.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:13:22.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:13:22.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.QEXozUqFcj 2026-02-17T04:13:22.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:13:22.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301602956870217 2026-02-17T04:13:22.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=624 2026-02-17T04:13:22.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 624 ms' 2026-02-17T04:13:22.958 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 128 objects in pool test in 624 ms 2026-02-17T04:13:22.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:13:22.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:13:22.958048907' 2026-02-17T04:13:22.959 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:13:22.958048907 2026-02-17T04:13:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:13:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:13:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:13:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:13:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:13:23.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:13:23.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:13:23.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:13:23.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:13:23.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:13:23.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:13:23.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:13:23.210 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:13:23.210 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:13:23.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:13:23.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:13:23.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:13:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:13:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:13:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:13:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:13:23.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:13:23.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-17T04:13:23.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-17T04:13:23.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672970' 2026-02-17T04:13:23.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:13:23.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:13:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T04:13:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T04:13:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-42949672970 2-60129542153' 2026-02-17T04:13:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:13:23.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:13:23.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:13:23.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:13:23.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:13:23.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:13:23.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:13:23.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:13:23.392 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:13:23.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:13:23.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-17T04:13:23.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:13:24.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:13:24.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:13:24.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:13:24.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:13:24.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-17T04:13:24.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:13:24.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:13:24.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-17T04:13:24.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:13:24.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-17T04:13:24.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T04:13:24.730 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672970 2026-02-17T04:13:24.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:13:24.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T04:13:24.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:13:24.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T04:13:24.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:13:24.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:13:24.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T04:13:24.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:13:24.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T04:13:24.900 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542153 2026-02-17T04:13:24.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T04:13:24.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:13:25.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T04:13:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:13:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:13:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:13:25.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:13:25.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:13:25.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:13:25.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:13:25.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:13:25.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:13:25.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:13:25.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:13:25.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:13:25.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:13:25.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:13:25.816 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:13:25.816 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:13:25.816 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:13:25.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:13:25.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:13:30.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:18.296817+0000 20'14 20:35 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-17T04:13:18.296639+0000 20'16 20:37 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-17T04:13:18.295501+0000 20'23 20:44 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:18.296629+0000 20'14 20:35 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:18.296061+0000 20'14 20:35 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-17T04:13:18.295759+0000 20'12 20:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.981 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:13:18.295469+0000 20'11 20:33 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.982 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-17T04:13:18.296771+0000 20'24 20:47 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:30.982 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:13:30.982 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:13:30.982 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:13:30.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:30.989 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:13:30.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:13:30.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:13:30.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:13:31.047 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:13:31.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:13:31.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:13:31.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:13:31.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:13:31.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:13:31.107831667' 2026-02-17T04:13:31.108 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:13:31.107831667 2026-02-17T04:13:31.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301611109291810 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:13:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:13:31.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:13:33.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:13:33.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301613200621780 2026-02-17T04:13:33.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:13:33.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:13:33.201723918 (2091 ms)' 2026-02-17T04:13:33.202 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:13:33.201723918 (2091 ms) 2026-02-17T04:13:33.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=48 2026-02-17T04:13:33.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:13:33.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:13:33.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 48 2026-02-17T04:13:33.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.205 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 48 2026-02-17T04:13:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 48' 2026-02-17T04:13:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.206 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj40 2026-02-17T04:13:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj40' 2026-02-17T04:13:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.207 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 128 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj40' 2026-02-17T04:13:33.209 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj40 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj40 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj40 ' 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj116' 2026-02-17T04:13:33.211 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj116 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj116 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj116 ' 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.212 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj14 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj14' 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj14 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj14 ' 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.215 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj122 2026-02-17T04:13:33.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj122' 2026-02-17T04:13:33.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj122 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj122 ' 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj65' 2026-02-17T04:13:33.216 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj65 2026-02-17T04:13:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj65 2026-02-17T04:13:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:13:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj65 ' 2026-02-17T04:13:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj121' 2026-02-17T04:13:33.218 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj121 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj121 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj121 ' 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.220 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj4 2026-02-17T04:13:33.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj4' 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj4 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj4 ' 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.221 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj117 2026-02-17T04:13:33.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj117' 2026-02-17T04:13:33.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj117 2026-02-17T04:13:33.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj117 ' 2026-02-17T04:13:33.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.223 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj9 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj9' 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj9 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj9 ' 2026-02-17T04:13:33.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.225 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj29 2026-02-17T04:13:33.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj29' 2026-02-17T04:13:33.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj29 2026-02-17T04:13:33.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj29 ' 2026-02-17T04:13:33.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.227 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-17T04:13:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-17T04:13:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-17T04:13:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-17T04:13:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.229 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj93 2026-02-17T04:13:33.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj93' 2026-02-17T04:13:33.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj93 2026-02-17T04:13:33.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj93 ' 2026-02-17T04:13:33.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.231 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj77 2026-02-17T04:13:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj77' 2026-02-17T04:13:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj77 2026-02-17T04:13:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:13:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj77 ' 2026-02-17T04:13:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj126' 2026-02-17T04:13:33.233 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj126 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj126 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj126 ' 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj24' 2026-02-17T04:13:33.235 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj24 2026-02-17T04:13:33.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj24 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj24 ' 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.236 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj60 2026-02-17T04:13:33.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj60' 2026-02-17T04:13:33.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj60 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj60 ' 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.238 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj120 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj120' 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj120 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj120 ' 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.240 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj105 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj105' 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj105 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj105 ' 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.241 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj55 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj55' 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj55 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj55 ' 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.243 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj125 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj125' 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj125 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj125 ' 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.244 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj98 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj98' 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj98 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj98 ' 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj56' 2026-02-17T04:13:33.246 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj56 2026-02-17T04:13:33.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj56 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj56 ' 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.247 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj20 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj20' 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj20 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj20 ' 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj41' 2026-02-17T04:13:33.248 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj41 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj41 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj41 ' 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=24 )) 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj119 2026-02-17T04:13:33.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.250 INFO:tasks.workunit.client.0.trial090.stdout:Object obj119: acting: 2 0 1 2026-02-17T04:13:33.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj119: acting: 2 0 1' 2026-02-17T04:13:33.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.251 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj119 (24) 0 1 2' 2026-02-17T04:13:33.251 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj119 (24) 0 1 2 2026-02-17T04:13:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.252 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj119 2026-02-17T04:13:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj119' 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj119 ' 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj110 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj110: acting: 1 0 2' 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stdout:Object obj110: acting: 1 0 2 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.254 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj110 (25) 0 2 1' 2026-02-17T04:13:33.254 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj110 (25) 0 2 1 2026-02-17T04:13:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.255 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj110 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj110' 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj110 ' 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj78 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj78: acting: 1 0 2' 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stdout:Object obj78: acting: 1 0 2 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj78 (26) 0 2 1' 2026-02-17T04:13:33.257 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj78 (26) 0 2 1 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj78 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj78' 2026-02-17T04:13:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj78 ' 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj59 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stdout:Object obj59: acting: 2 0 1 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj59: acting: 2 0 1' 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.259 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj59 (27) 0 1 2' 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj59 (27) 0 1 2 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj59' 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj59 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj59 ' 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj2 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.261 INFO:tasks.workunit.client.0.trial090.stdout:Object obj2: acting: 1 0 2 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj2: acting: 1 0 2' 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj2 (28) 0 2 1' 2026-02-17T04:13:33.262 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj2 (28) 0 2 1 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj2 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj2' 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj2 ' 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj47 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stdout:Object obj47: acting: 1 0 2 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj47: acting: 1 0 2' 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.264 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj47 (29) 0 2 1' 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj47 (29) 0 2 1 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj47' 2026-02-17T04:13:33.265 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj47 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj47 ' 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj17 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stdout:Object obj17: acting: 1 0 2 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj17: acting: 1 0 2' 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj17 (30) 0 2 1' 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj17 (30) 0 2 1 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj17' 2026-02-17T04:13:33.267 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj17 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj17 ' 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj106 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stdout:Object obj106: acting: 1 2 0 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj106: acting: 1 2 0' 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:13:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj106 (31) 2 0 1' 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj106 (31) 2 0 1 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj106' 2026-02-17T04:13:33.269 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj106 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj106 ' 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj31 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj31: acting: 2 0 1' 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stdout:Object obj31: acting: 2 0 1 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj31 (32) 0 1 2' 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj31 (32) 0 1 2 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.271 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj31 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj31' 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj31 ' 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj64 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stdout:Object obj64: acting: 0 1 2 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj64: acting: 0 1 2' 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:13:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj64 (33) 1 2 0' 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj64 (33) 1 2 0 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj64' 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj64 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj64 ' 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj50 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stdout:Object obj50: acting: 1 0 2 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj50: acting: 1 0 2' 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj50 (34) 0 2 1' 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj50 (34) 0 2 1 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.275 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj50 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj50' 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj50 ' 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj76 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj76: acting: 1 0 2' 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stdout:Object obj76: acting: 1 0 2 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.276 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj76 (35) 0 2 1' 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj76 (35) 0 2 1 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.277 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj76 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj76' 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj76 ' 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj108 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stdout:Object obj108: acting: 0 1 2 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj108: acting: 0 1 2' 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj108 (36) 1 2 0 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj108 (36) 1 2 0' 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj108 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj108' 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj108 ' 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj42 2026-02-17T04:13:33.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj42: acting: 2 0 1' 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stdout:Object obj42: acting: 2 0 1 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj42 (37) 0 1 2' 2026-02-17T04:13:33.280 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj42 (37) 0 1 2 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj42' 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj42 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj42 ' 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj79 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj79: acting: 1 0 2' 2026-02-17T04:13:33.281 INFO:tasks.workunit.client.0.trial090.stdout:Object obj79: acting: 1 0 2 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj79 (38) 0 2 1' 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj79 (38) 0 2 1 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.282 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj79 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj79' 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj79 ' 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj124 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stdout:Object obj124: acting: 2 0 1 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj124: acting: 2 0 1' 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.283 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj124 (39) 0 1 2' 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj124 (39) 0 1 2 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj124' 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj124 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj124 ' 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj123 2026-02-17T04:13:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stdout:Object obj123: acting: 0 1 2 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj123: acting: 0 1 2' 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj123 (40) 1 2 0' 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj123 (40) 1 2 0 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj123 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj123' 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj123 ' 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj53 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj53: acting: 1 0 2' 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stdout:Object obj53: acting: 1 0 2 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj53 (41) 0 2 1' 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj53 (41) 0 2 1 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj53' 2026-02-17T04:13:33.287 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj53 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj53 ' 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj92 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stdout:Object obj92: acting: 1 0 2 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj92: acting: 1 0 2' 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.288 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj92 (42) 0 2 1 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj92 (42) 0 2 1' 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj92 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj92' 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj92 ' 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj43 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stdout:Object obj43: acting: 1 0 2 2026-02-17T04:13:33.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj43: acting: 1 0 2' 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj43 (43) 0 2 1' 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj43 (43) 0 2 1 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj43' 2026-02-17T04:13:33.290 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj43 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj43 ' 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj97 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj97: acting: 2 0 1' 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stdout:Object obj97: acting: 2 0 1 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj97 (44) 0 1 2' 2026-02-17T04:13:33.291 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj97 (44) 0 1 2 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj97' 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj97 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj97 ' 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj26 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stdout:Object obj26: acting: 1 2 0 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj26: acting: 1 2 0' 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.292 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj26 (45) 2 0 1 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj26 (45) 2 0 1' 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj26 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj26' 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj26 ' 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj11 2026-02-17T04:13:33.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stdout:Object obj11: acting: 1 2 0 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj11: acting: 1 2 0' 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj11 (46) 2 0 1' 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj11 (46) 2 0 1 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj11' 2026-02-17T04:13:33.294 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj11 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj11 ' 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj95 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stdout:Object obj95: acting: 1 2 0 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj95: acting: 1 2 0' 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj95 (47) 2 0 1' 2026-02-17T04:13:33.295 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj95 (47) 2 0 1 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj95 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj95' 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj95 ' 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:13:33.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:13:33.299 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:13:33.299 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:13:33.299 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:33.307 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:13:33.308 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:13:33.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:33.315 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:13:33.315 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:13:33.315 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:33.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:13:33.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:13:33.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:13:33.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:13:33.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:13:33.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:13:33.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:13:33.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:13:34.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:13:34.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:13:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj56 ' 2026-02-17T04:13:34.633 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj56 2026-02-17T04:13:34.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:34.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:34.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj56 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj56 2026-02-17T04:13:34.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj56 rm-attr _ 2026-02-17T04:13:34.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj119 obj78 obj2 obj17 obj106 obj31 obj50 obj79 obj92 obj97 obj26 obj95 ' obj_to_pgid delete_oi 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj119 obj78 obj2 obj17 obj106 obj31 obj50 obj79 obj92 obj97 obj26 obj95 ' 2026-02-17T04:13:34.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:13:34.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:13:34.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:13:34.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj119 obj78 obj2 obj17 obj106 obj31 obj50 obj79 obj92 obj97 obj26 obj95 ]] 2026-02-17T04:13:34.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:13:34.768 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj119 obj78 obj2 obj17 obj106 obj31 obj50 obj79 obj92 obj97 obj26 obj95 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj119 obj78 obj2 obj17 obj106 obj31 obj50 obj79 obj92 obj97 obj26 obj95 ' 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:13:34.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj119 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj119 2026-02-17T04:13:34.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj119 rm-attr _ 2026-02-17T04:13:34.866 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:34.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:34.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:34.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj78 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj78 2026-02-17T04:13:34.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj78 rm-attr _ 2026-02-17T04:13:34.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:34.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj2 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-17T04:13:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj2 rm-attr _ 2026-02-17T04:13:35.126 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.126 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.126 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:13:35.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:13:35.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj17 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj17 2026-02-17T04:13:35.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj17 rm-attr _ 2026-02-17T04:13:35.264 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.264 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.264 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.264 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj106 2026-02-17T04:13:35.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj106 2026-02-17T04:13:35.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj106 rm-attr _ 2026-02-17T04:13:35.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:35.398 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.398 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.398 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.398 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:35.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:35.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj31 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj31 2026-02-17T04:13:35.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj31 rm-attr _ 2026-02-17T04:13:35.530 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:35.530 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:35.531 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.531 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.531 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.531 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:35.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj50 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj50 2026-02-17T04:13:35.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj50 rm-attr _ 2026-02-17T04:13:35.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:35.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:35.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:35.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:35.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:35.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj79 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj79 2026-02-17T04:13:35.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj79 rm-attr _ 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.799 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:35.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:35.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj92 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj92 2026-02-17T04:13:35.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj92 rm-attr _ 2026-02-17T04:13:35.929 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:35.930 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:35.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj97 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj97 2026-02-17T04:13:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj97 rm-attr _ 2026-02-17T04:13:36.067 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:13:36.067 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:13:36.067 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:36.068 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:36.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:36.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj26 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-17T04:13:36.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj26 rm-attr _ 2026-02-17T04:13:36.201 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:13:36.201 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:13:36.201 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:36.201 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:36.201 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:36.202 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:13:36.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj95 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj95 2026-02-17T04:13:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj95 rm-attr _ 2026-02-17T04:13:36.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-17T04:13:36.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76c71d4e:::obj92:head#, (61) No data available 2026-02-17T04:13:36.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:13:36.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e3dc695:::obj78:head#, (61) No data available 2026-02-17T04:13:36.338 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:13:36.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:36.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:13:36.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:13:36.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj116 obj14 obj122 obj121 obj4 obj117 obj9 obj29 obj63 obj93 obj126 obj24 obj60 obj120 obj105 obj125 obj98 obj20 ' 2026-02-17T04:13:36.375 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj116 obj14 obj122 obj121 obj4 obj117 obj9 obj29 obj63 obj93 obj126 obj24 obj60 obj120 obj105 obj125 obj98 obj20 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj116 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj116 2026-02-17T04:13:36.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj116 rm-attr _ 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj14 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj14 2026-02-17T04:13:36.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj14 rm-attr _ 2026-02-17T04:13:36.597 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:36.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj122 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj122 2026-02-17T04:13:36.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj122 rm-attr _ 2026-02-17T04:13:36.727 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:36.727 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:36.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj121 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:36.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj121 2026-02-17T04:13:36.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj121 rm-attr _ 2026-02-17T04:13:36.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:36.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:36.856 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:36.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:36.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:36.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:36.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:36.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj4 2026-02-17T04:13:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-17T04:13:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj4 rm-attr _ 2026-02-17T04:13:36.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:36.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:36.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:36.983 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:37.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj117 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj117 2026-02-17T04:13:37.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj117 rm-attr _ 2026-02-17T04:13:37.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.117 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj9 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj9 2026-02-17T04:13:37.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj9 rm-attr _ 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.255 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:13:37.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj29 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj29 2026-02-17T04:13:37.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj29 rm-attr _ 2026-02-17T04:13:37.386 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.386 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.386 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.386 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:37.387 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.387 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.387 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:37.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-17T04:13:37.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-17T04:13:37.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:37.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:37.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj93 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj93 2026-02-17T04:13:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj93 rm-attr _ 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.646 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:37.647 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:37.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj126 2026-02-17T04:13:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj126 2026-02-17T04:13:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj126 rm-attr _ 2026-02-17T04:13:37.781 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:37.782 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:37.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj24 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj24 2026-02-17T04:13:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj24 rm-attr _ 2026-02-17T04:13:37.910 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:37.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:37.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:37.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj60 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-17T04:13:37.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj60 rm-attr _ 2026-02-17T04:13:38.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.040 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj120 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj120 2026-02-17T04:13:38.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj120 rm-attr _ 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj105 2026-02-17T04:13:38.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj105 2026-02-17T04:13:38.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj105 rm-attr _ 2026-02-17T04:13:38.328 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.328 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.330 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:38.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:38.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:38.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj125 2026-02-17T04:13:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj125 2026-02-17T04:13:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj125 rm-attr _ 2026-02-17T04:13:38.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.466 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj98 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj98 2026-02-17T04:13:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj98 rm-attr _ 2026-02-17T04:13:38.597 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.597 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.597 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:38.597 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.598 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj20 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-17T04:13:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj20 rm-attr _ 2026-02-17T04:13:38.734 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.735 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.736 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:38.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj59 obj108 obj42 obj124 obj123 ' obj_to_pgid delete_oi 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj59 obj108 obj42 obj124 obj123 ' 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj59 obj108 obj42 obj124 obj123 ]] 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:13:38.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj59 obj108 obj42 obj124 obj123 ' 2026-02-17T04:13:38.772 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj59 obj108 obj42 obj124 obj123 2026-02-17T04:13:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj59 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj59 2026-02-17T04:13:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj59 rm-attr _ 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.862 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.863 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.864 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:38.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:38.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj108 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj108 2026-02-17T04:13:38.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj108 rm-attr _ 2026-02-17T04:13:38.997 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:38.997 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:38.997 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:38.997 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:38.997 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:38.998 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:38.999 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:38.999 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:39.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj42 2026-02-17T04:13:39.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:39.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-17T04:13:39.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj42 rm-attr _ 2026-02-17T04:13:39.129 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:39.129 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:13:39.130 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:39.131 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:39.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj124 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj124 2026-02-17T04:13:39.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj124 rm-attr _ 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:13:39.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:39.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:39.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:39.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:13:39.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:13:39.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj123 2026-02-17T04:13:39.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:13:39.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj123 2026-02-17T04:13:39.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj123 rm-attr _ 2026-02-17T04:13:39.382 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:775ec905:::obj98:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7ee9cafa:::obj105:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:13:39.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0e5b0695:::obj117:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1a2eef70:::obj126:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1bad8e21:::obj122:head#, (61) No data available 2026-02-17T04:13:39.384 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1efaad2b:::obj120:head#, (61) No data available 2026-02-17T04:13:39.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:39.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:13:39.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:13:39.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj40 obj65 obj77 obj55 obj41 ' 2026-02-17T04:13:39.421 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj40 obj65 obj77 obj55 obj41 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj40 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj40 2026-02-17T04:13:39.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj40 rm-attr _ 2026-02-17T04:13:39.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:39.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:39.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj65 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:39.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj65 2026-02-17T04:13:39.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj65 rm-attr _ 2026-02-17T04:13:39.641 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:13:39.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:13:39.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj77 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj77 2026-02-17T04:13:39.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj77 rm-attr _ 2026-02-17T04:13:39.775 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:39.776 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:39.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj55 2026-02-17T04:13:39.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:39.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-17T04:13:39.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj55 rm-attr _ 2026-02-17T04:13:39.909 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:39.910 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:39.910 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:39.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj41 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj41 2026-02-17T04:13:39.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj41 rm-attr _ 2026-02-17T04:13:40.049 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.049 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.049 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.049 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj110 obj47 obj64 obj76 obj53 obj43 obj11 ' obj_to_pgid delete_oi 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj110 obj47 obj64 obj76 obj53 obj43 obj11 ' 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj110 obj47 obj64 obj76 obj53 obj43 obj11 ]] 2026-02-17T04:13:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:13:40.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj110 obj47 obj64 obj76 obj53 obj43 obj11 ' 2026-02-17T04:13:40.084 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj110 obj47 obj64 obj76 obj53 obj43 obj11 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj110 2026-02-17T04:13:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj110 2026-02-17T04:13:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj110 rm-attr _ 2026-02-17T04:13:40.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj47 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-17T04:13:40.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj47 rm-attr _ 2026-02-17T04:13:40.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj64 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj64 2026-02-17T04:13:40.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj64 rm-attr _ 2026-02-17T04:13:40.435 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.435 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.436 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.436 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.436 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.436 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.436 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:13:40.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj76 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj76 2026-02-17T04:13:40.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj76 rm-attr _ 2026-02-17T04:13:40.567 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.567 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.568 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:13:40.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:13:40.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj53 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj53 2026-02-17T04:13:40.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj53 rm-attr _ 2026-02-17T04:13:40.702 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.702 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-17T04:13:40.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj43 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj43 2026-02-17T04:13:40.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj43 rm-attr _ 2026-02-17T04:13:40.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:13:40.837 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-17T04:13:40.838 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:13:40.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:13:40.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:13:40.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:13:40.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj11 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-17T04:13:40.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj11 rm-attr _ 2026-02-17T04:13:40.980 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-17T04:13:40.980 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-17T04:13:40.980 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-17T04:13:40.980 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:13:40.980 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-17T04:13:40.981 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-17T04:13:41.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:13:41.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:13:41.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:13:41.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:13:41.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:13:52.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:13:57.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:13:57.243 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731078+0000 20'14 31:56 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-17T04:13:44.730973+0000 20'16 31:58 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-17T04:13:44.730330+0000 20'23 31:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731226+0000 20'14 31:56 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731229+0000 20'14 31:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-17T04:13:44.730350+0000 20'12 31:67 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:13:44.730285+0000 20'11 31:47 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-17T04:13:44.731627+0000 20'24 31:70 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:57.244 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:13:57.245 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:13:57.245 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:13:57.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:57.252 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:13:57.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:13:57.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:13:57.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:13:57.311 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:13:57.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:13:57.365 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:13:57.365 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:13:57.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:57.374 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:13:57.374 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:13:57.374 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:57.382 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:13:57.382 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:13:57.382 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:57.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:13:58.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:13:58.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301638388688173 2026-02-17T04:13:58.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:13:58.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:13:58.390262158' 2026-02-17T04:13:58.391 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:13:58.390262158 2026-02-17T04:13:58.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:13:58.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:13:58.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:13:58.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:13:58.545 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:13:58.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:13:58.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301638556734164 2026-02-17T04:13:58.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:13:58.558 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:13:58.557937179 (168 ms) 2026-02-17T04:13:58.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:13:58.557937179 (168 ms)' 2026-02-17T04:13:58.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:13:58.559 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:13:58.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.560 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:13:58.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:13:58.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.561 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:13:58.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:13:58.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:13:58.563 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:13:58.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.564 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:13:58.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:13:58.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.565 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:13:58.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:13:58.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.566 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:13:58.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:13:58.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:13:58.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:13:58.568 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:13:58.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:13:58.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:13:58.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731078+0000 20'14 31:56 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-17T04:13:44.730973+0000 20'16 31:58 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-17T04:13:44.730330+0000 20'23 31:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731226+0000 20'14 31:57 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731229+0000 20'14 31:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-17T04:13:44.730350+0000 20'12 31:67 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.882 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:13:44.730285+0000 20'11 31:48 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.883 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-17T04:13:44.731627+0000 20'24 31:72 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:13:58.883 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:13:58.883 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:13:58.883 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:13:58.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:13:58.944 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:13:58.945 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:58.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:58.953 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:13:58.953 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:58.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:58.960 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:13:58.960 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:58.961 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:13:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301638967334519 2026-02-17T04:13:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:13:58.969 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:13:58.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:13:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:13:59.027 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:13:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:13:59.081 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.081 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.081 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.081 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.081 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:13:59.086 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:13:59.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:13:59.139 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.140 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.140 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.140 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.140 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:13:59.144 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:13:59.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:13:59.199 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.199 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.200 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.200 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.200 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.206 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:13:59.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:13:59.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:13:59.259 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.259 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.260 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.260 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.260 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:13:59.265 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:13:59.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:13:59.318 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.319 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.319 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.319 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.319 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:13:59.323 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:13:59.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:13:59.376 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.377 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.377 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.377 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:13:59.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:13:59.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:13:59.381 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:13:59.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:13:59.435 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:13:59.435 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:13:59.435 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:13:59.435 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:13:59.436 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:13:59.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:13:59.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:13:59.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:13:59.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:13:59.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:13:59.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:13:59.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:13:59.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:13:59.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301639606370293 2026-02-17T04:13:59.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=639 2026-02-17T04:13:59.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:13:59.661 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:13:59.661 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:59.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.670 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:13:59.670 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:59.670 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.677 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:13:59.678 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:13:59.678 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:13:59.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:14:01.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731078+0000 20'14 31:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-17T04:13:44.730973+0000 20'16 31:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean+inconsistent 2026-02-17T04:13:59.768558+0000 20'23 31:70 [2,0,1] 2 [2,0,1] 2 20'23 2026-02-17T04:13:59.768517+0000 20'23 2026-02-17T04:13:59.768517+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:13:59.768517+0000 23 0 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean+inconsistent 2026-02-17T04:13:59.984206+0000 20'14 31:68 [1,0,2] 1 [1,0,2] 1 20'14 2026-02-17T04:13:59.984162+0000 20'14 2026-02-17T04:13:59.984162+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:13:59.984162+0000 14 0 2026-02-17T04:14:01.840 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:13:44.731229+0000 20'14 31:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:13:18.188101+0000 0 0 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean+inconsistent 2026-02-17T04:13:59.500217+0000 20'12 31:78 [0,1,2] 0 [0,1,2] 0 20'12 2026-02-17T04:13:59.500187+0000 20'12 2026-02-17T04:13:59.500187+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:13:59.500187+0000 12 0 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean+inconsistent 2026-02-17T04:14:00.809849+0000 20'11 31:59 [2,0,1] 2 [2,0,1] 2 20'11 2026-02-17T04:14:00.809821+0000 20'11 2026-02-17T04:14:00.809821+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:00.809821+0000 11 0 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-17T04:13:44.731627+0000 20'24 31:74 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:13:18.188101+0000 0'0 2026-02-17T04:13:18.188101+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:14:01.841 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:14:01.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_1 3 8 16 24 24 256 4194304 0 639 2026-02-17T04:14:01.848 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_1@ NAUT 3 8 16 24/ 24 256 4194304/ 0 639 2026-02-17T04:14:01.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.848 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:14:01.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:14:01.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:14:01.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.864 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:14:01.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:14:01.865 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:14:01.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:14:01.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.881 INFO:tasks.workunit.client.0.trial090.stdout:1027 2026-02-17T04:14:01.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:14:01.882 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:14:01.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:14:01.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.899 INFO:tasks.workunit.client.0.trial090.stdout:1173 2026-02-17T04:14:01.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:14:01.900 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:14:01.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:14:01.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.914 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.7 2026-02-17T04:14:01.914 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:14:01.915 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:14:01.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.916 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:14:01.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:14:01.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:14:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.930 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:14:01.930 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:14:01.931 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:14:01.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:14:01.932 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:14:01.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:14:01.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.948 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:14:01.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:14:01.949 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:14:01.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:14:01.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.964 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:14:01.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:01.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:14:01.965 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:14:01.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:14:01.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:14:01.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:14:01.979 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:14:01.980 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:14:01.980 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:14:01.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:14:01.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:14:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:14:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:14:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:14:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:14:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:14:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:14:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:14:07.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:14:07.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:14:07.697 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:14:07.697 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:07.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:07.705 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:14:07.705 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:07.705 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:07.712 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:14:07.712 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:07.712 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:07.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:14:07.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301647718836352 2026-02-17T04:14:07.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:07.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:14:07.875 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:14:07.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:07.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:14:08.041 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:14:08.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:14:08.207 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:14:08.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:14:08.375 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:14:08.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:14:08.538 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:14:08.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:14:08.701 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:14:08.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:14:08.869 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:14:08.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:14:08.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:14:09.033 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:14:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:14:09.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:14:09.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:14:09.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301649208865969 2026-02-17T04:14:09.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1490 2026-02-17T04:14:09.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:14:09.262 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:14:09.263 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:09.263 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:09.270 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:14:09.271 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:09.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:09.278 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:14:09.278 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:14:09.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:14:14.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:14:14.442 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:10.014508+0000 20'14 31:95 [1,2,0] 1 [1,2,0] 1 20'14 2026-02-17T04:14:10.010401+0000 20'14 2026-02-17T04:14:10.010401+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:10.010401+0000 14 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-17T04:14:09.049684+0000 20'16 31:104 [1,0,2] 1 [1,0,2] 1 20'16 2026-02-17T04:14:09.045474+0000 20'16 2026-02-17T04:14:09.045474+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:09.045474+0000 16 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-17T04:14:08.835659+0000 20'23 31:103 [2,0,1] 2 [2,0,1] 2 20'23 2026-02-17T04:14:08.831723+0000 20'23 2026-02-17T04:14:08.831723+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:08.831723+0000 23 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:08.024438+0000 20'14 31:91 [1,0,2] 1 [1,0,2] 1 20'14 2026-02-17T04:14:08.022470+0000 20'14 2026-02-17T04:14:08.022470+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:08.022470+0000 14 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:11.937689+0000 20'14 31:92 [1,2,0] 1 [1,2,0] 1 20'14 2026-02-17T04:14:11.935157+0000 20'14 2026-02-17T04:14:11.935157+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:11.935157+0000 14 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-17T04:14:09.578027+0000 20'12 31:105 [0,1,2] 0 [0,1,2] 0 20'12 2026-02-17T04:14:09.574864+0000 20'12 2026-02-17T04:14:09.574864+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:09.574864+0000 12 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:14:09.845046+0000 20'11 31:87 [2,0,1] 2 [2,0,1] 2 20'11 2026-02-17T04:14:09.841514+0000 20'11 2026-02-17T04:14:09.841514+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:09.841514+0000 11 0 2026-02-17T04:14:14.443 INFO:tasks.workunit.client.0.trial090.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-17T04:14:10.992747+0000 20'24 31:137 [1,0,2] 1 [1,0,2] 1 20'24 2026-02-17T04:14:10.984662+0000 20'24 2026-02-17T04:14:10.984662+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:14:10.984662+0000 24 0 2026-02-17T04:14:14.444 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:14:14.444 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:14:14.444 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:14:14.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_1 3 8 16 24 24 256 4194304 0 1490 2026-02-17T04:14:14.450 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_1@ REPR 3 8 16 24/ 24 256 4194304/ 0 1490 2026-02-17T04:14:14.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:14:14.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:14:14.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:14:14.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0414 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:14:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.538 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.539 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.540 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.541 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.542 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.543 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.544 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.545 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "value": 65536 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.546 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.005999926, 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.002999963 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.549 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.552 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.558 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.559 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.560 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.561 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.562 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 65536 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.566 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.005999926, 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.002999963 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.569 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.570 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.571 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.572 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.573 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:14.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.587 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 36, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.588 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.589 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 65536 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.044999434, 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.004499943 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.596 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.598 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.599 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 36, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.600 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.601 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 65536 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.044999434, 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.004499943 2026-02-17T04:14:14.604 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.605 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:14.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:14.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:14.647 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.647 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.647 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 16, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.648 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:14.649 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.650 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 256 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 65536 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.651 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.015999798, 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999949 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.652 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.653 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.654 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.655 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.656 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.657 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 16, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.658 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.659 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 256 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 65536 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.660 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.015999798, 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999949 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.662 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:14.663 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:14.664 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:14.665 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:14.666 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:14.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:14.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:21.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:14:21.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.878 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.879 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 9, 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.880 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.881 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.882 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.883 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 94720 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.009999875, 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003333291 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.890 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.891 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.892 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.893 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.894 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.895 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.896 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.897 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.898 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.899 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 9, 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.900 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.901 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.902 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.903 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 94720 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.904 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.009999875, 2026-02-17T04:14:21.905 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003333291 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.906 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.907 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.908 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.909 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.910 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.911 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:21.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:21.925 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.925 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.925 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.926 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 51, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.927 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.928 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr: "value": 94720 2026-02-17T04:14:21.929 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.930 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 14, 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.062999208, 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.004499943 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.931 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:21.932 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.933 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.934 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.935 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.936 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.937 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 51, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.938 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.939 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.940 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 94720 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.941 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.942 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 14, 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.062999208, 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.004499943 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.943 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.944 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.945 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.947 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:21.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.984 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 24, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.985 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.986 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 370 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 94720 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.987 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.023999697, 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999949 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.988 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.989 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:14:21.990 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.991 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:21.992 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:14:21.993 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:14:21.994 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 24, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.995 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.996 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 370 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 94720 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.997 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.023999697, 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999949 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:21.999 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.000 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.001 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.002 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:14:22.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:14:32.574 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:14:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:14:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:14:32.779 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:14:32.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:14:32.984 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:14:32.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 256 4 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:14:32.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:14:32.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301672995924002 2026-02-17T04:14:32.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:14:32.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:14:32.998 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:14:32.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:32.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.Psj2TJOFIP bs=256 count=1 2026-02-17T04:14:33.000 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 6.0161e-05 s, 4.3 MB/s 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:14:33.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:14:33.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:14:33.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:14:33.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.Psj2TJOFIP 2026-02-17T04:14:33.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:14:33.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301673304586441 2026-02-17T04:14:33.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=308 2026-02-17T04:14:33.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 308 ms' 2026-02-17T04:14:33.305 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 64 objects in pool test in 308 ms 2026-02-17T04:14:33.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:14:33.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:14:33.305800726' 2026-02-17T04:14:33.306 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:14:33.305800726 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:14:33.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:14:33.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:14:33.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:14:33.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:14:33.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:14:33.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:14:33.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:14:33.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:14:33.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:14:33.562 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:14:33.562 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:14:33.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:14:33.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:14:33.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:14:33.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:14:33.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:14:33.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:14:33.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:14:33.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:14:33.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:14:33.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:14:33.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T04:14:33.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:14:33.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:14:33.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T04:14:33.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T04:14:33.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-60129542151' 2026-02-17T04:14:33.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:14:33.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:14:33.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:14:33.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:14:33.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:14:33.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:14:33.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:14:33.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:14:33.744 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:14:33.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:14:33.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836492 2026-02-17T04:14:33.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:14:34.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:14:34.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:14:35.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:14:35.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:14:35.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:14:35.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:14:35.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:14:35.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:14:35.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:14:35.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:14:35.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:14:35.086 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T04:14:35.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:14:35.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:14:35.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:14:35.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T04:14:35.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:14:35.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:14:35.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T04:14:35.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:14:35.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T04:14:35.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T04:14:35.257 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542151 2026-02-17T04:14:35.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:14:35.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-17T04:14:35.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:14:35.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:14:35.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:14:35.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:14:35.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:14:35.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:14:35.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:14:35.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:14:35.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:14:35.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:14:35.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:14:35.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:14:35.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:14:35.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:14:35.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:14:36.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:14:36.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:14:36.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:14:36.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:14:36.175 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:14:36.175 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:14:36.176 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:14:36.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:14:36.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:14:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:14:41.347 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:14:41.347 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:28.961309+0000 19'14 19:35 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:14:41.347 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:28.961482+0000 19'14 19:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:14:41.347 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:14:28.961593+0000 19'19 19:39 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:14:41.347 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:14:28.961299+0000 19'17 19:39 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:14:41.348 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:14:41.348 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:14:41.348 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:14:41.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:14:41.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:14:41.355 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:14:41.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:14:41.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:14:41.412 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:14:41.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:14:41.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:14:41.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:14:41.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:14:41.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:14:41.471773222' 2026-02-17T04:14:41.472 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:14:41.471773222 2026-02-17T04:14:41.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:14:41.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301681472899143 2026-02-17T04:14:41.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:14:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:14:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:14:42.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:14:42.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301682555789401 2026-02-17T04:14:42.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:14:42.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:14:42.556914251 (1082 ms)' 2026-02-17T04:14:42.557 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:14:42.556914251 (1082 ms) 2026-02-17T04:14:42.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-17T04:14:42.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:14:42.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:14:42.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-17T04:14:42.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.560 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 10 2026-02-17T04:14:42.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-17T04:14:42.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.561 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj56 2026-02-17T04:14:42.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj56' 2026-02-17T04:14:42.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.561 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 64 2026-02-17T04:14:42.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-17T04:14:42.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj56' 2026-02-17T04:14:42.563 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj56 2026-02-17T04:14:42.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj56 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj56 ' 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj55' 2026-02-17T04:14:42.565 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj55 2026-02-17T04:14:42.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj55 2026-02-17T04:14:42.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:14:42.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj55 ' 2026-02-17T04:14:42.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.567 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj8 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj8' 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj8 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj8 ' 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.569 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj2 2026-02-17T04:14:42.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj2' 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj2 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj2 ' 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.571 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj46 2026-02-17T04:14:42.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj46' 2026-02-17T04:14:42.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj46 2026-02-17T04:14:42.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:14:42.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj46 ' 2026-02-17T04:14:42.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.572 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj32 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj32' 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj32 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj32 ' 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.574 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj15 2026-02-17T04:14:42.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj15' 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj15 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj15 ' 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.575 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj12 2026-02-17T04:14:42.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj12' 2026-02-17T04:14:42.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj12 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj12 ' 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.577 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1 2026-02-17T04:14:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1' 2026-02-17T04:14:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1 2026-02-17T04:14:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:14:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1 ' 2026-02-17T04:14:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:14:42.579 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj6 2026-02-17T04:14:42.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj6' 2026-02-17T04:14:42.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj6 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj6 ' 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=10 )) 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:14:42.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:14:42.613 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:14:42.613 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:14:42.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:42.621 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:14:42.621 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:14:42.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:42.628 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:14:42.629 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:14:42.629 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:14:42.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:14:42.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:14:42.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:14:42.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:14:42.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:14:42.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:14:42.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:14:42.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:14:43.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:14:43.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:14:43.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj56 ' 2026-02-17T04:14:43.744 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj56 2026-02-17T04:14:43.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj56 2026-02-17T04:14:43.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:43.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:14:43.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj56 2026-02-17T04:14:43.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj56 rm-attr _ 2026-02-17T04:14:43.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:43.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 '' obj_to_pgid delete_oi 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:14:43.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:14:43.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj2 obj46 obj32 obj1 obj6 ' 2026-02-17T04:14:43.884 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj2 obj46 obj32 obj1 obj6 2026-02-17T04:14:43.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:14:43.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj2 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:43.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:14:43.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-17T04:14:43.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj2 rm-attr _ 2026-02-17T04:14:44.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:14:44.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:14:44.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj46 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:14:44.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj46 2026-02-17T04:14:44.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj46 rm-attr _ 2026-02-17T04:14:44.106 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:14:44.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj32 2026-02-17T04:14:44.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:14:44.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-17T04:14:44.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj32 rm-attr _ 2026-02-17T04:14:44.228 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:14:44.228 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:14:44.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:14:44.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:14:44.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1 2026-02-17T04:14:44.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:14:44.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-17T04:14:44.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1 rm-attr _ 2026-02-17T04:14:44.350 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:14:44.350 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:14:44.350 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:14:44.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj6 2026-02-17T04:14:44.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:14:44.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj6 2026-02-17T04:14:44.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj6 rm-attr _ 2026-02-17T04:14:44.489 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-17T04:14:44.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:14:44.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:14:44.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 '' obj_to_pgid delete_oi 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-17T04:14:44.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:14:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:14:44.534 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj55 obj8 obj15 obj12 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj55 obj8 obj15 obj12 ' 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj55 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-17T04:14:44.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj55 rm-attr _ 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj8 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj8 2026-02-17T04:14:44.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj8 rm-attr _ 2026-02-17T04:14:44.757 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:14:44.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj15 2026-02-17T04:14:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:14:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-17T04:14:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj15 rm-attr _ 2026-02-17T04:14:44.891 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:14:44.892 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:14:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj12 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-17T04:14:44.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj12 rm-attr _ 2026-02-17T04:14:45.018 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-17T04:14:45.018 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:14:45.018 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-17T04:14:45.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 '' obj_to_pgid delete_oi 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-17T04:14:45.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-17T04:14:45.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:14:45.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:14:56.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:15:01.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:15:01.252 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:48.847430+0000 19'14 32:62 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:48.847153+0000 19'14 32:71 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:14:48.847600+0000 19'19 32:55 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:14:48.847613+0000 19'17 32:69 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:15:01.253 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:15:01.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:01.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:15:01.261 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:15:01.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:15:01.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:15:01.321 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:15:01.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:15:01.376 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:15:01.376 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:15:01.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:01.384 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:15:01.384 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:15:01.384 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:01.391 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:15:01.391 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:15:01.391 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:01.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:15:02.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:15:02.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301702399510278 2026-02-17T04:15:02.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:15:02.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:15:02.401150164' 2026-02-17T04:15:02.402 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:15:02.401150164 2026-02-17T04:15:02.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:15:02.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:15:02.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:15:02.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:15:02.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:15:02.557 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:15:02.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:15:02.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301702568551420 2026-02-17T04:15:02.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:15:02.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:15:02.569679345 (169 ms)' 2026-02-17T04:15:02.570 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:15:02.569679345 (169 ms) 2026-02-17T04:15:02.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:15:02.571 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:15:02.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:15:02.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:02.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:15:02.572 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:15:02.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:15:02.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:02.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:15:02.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:15:02.574 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:15:02.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:02.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:15:02.574 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:15:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:15:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:15:02.576 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:15:02.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:15:02.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:15:02.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:15:02.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:15:02.898 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:15:02.898 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:48.847430+0000 19'14 32:63 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:02.898 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:48.847153+0000 19'14 32:71 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:02.898 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:14:48.847600+0000 19'19 32:56 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:02.899 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:14:48.847613+0000 19'17 32:70 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:02.899 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:02.899 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:15:02.899 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:15:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:15:02.960 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:15:02.960 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:02.961 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:02.968 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:15:02.969 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:02.969 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:02.976 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:15:02.976 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:02.976 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:02.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:15:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301702981479502 2026-02-17T04:15:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:15:02.983 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:15:02.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:15:03.035 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:03.035 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:15:03.035 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:15:03.035 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:15:03.035 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:03.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:03.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:15:03.040 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:15:03.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:15:03.093 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:03.093 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:15:03.093 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:15:03.093 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:15:03.093 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:03.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:03.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:15:03.097 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:15:03.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:15:03.150 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:03.150 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:15:03.151 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:15:03.151 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:15:03.151 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:03.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:03.156 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:15:03.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:15:03.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:15:03.206 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:03.207 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:15:03.207 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:15:03.207 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:15:03.207 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:15:03.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:15:03.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:15:03.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:15:03.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:15:03.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:15:03.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:15:03.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:15:03.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:15:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301703375815521 2026-02-17T04:15:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=394 2026-02-17T04:15:03.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:15:03.431 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:15:03.431 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:03.432 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.440 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:15:03.440 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:03.440 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.447 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:15:03.447 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:03.447 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:03.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:15:05.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:15:05.609 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:14:48.847430+0000 19'14 32:63 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean+inconsistent 2026-02-17T04:15:03.380490+0000 19'14 32:82 [0,1,2] 0 [0,1,2] 0 19'14 2026-02-17T04:15:03.380458+0000 19'14 2026-02-17T04:15:03.380458+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:03.380458+0000 14 0 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:14:48.847600+0000 19'19 32:56 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:14:28.854988+0000 0'0 2026-02-17T04:14:28.854988+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:14:28.854988+0000 0 0 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean+inconsistent 2026-02-17T04:15:03.967833+0000 19'17 32:83 [1,0,2] 1 [1,0,2] 1 19'17 2026-02-17T04:15:03.967809+0000 19'17 2026-02-17T04:15:03.967809+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:03.967809+0000 17 0 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:05.610 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:15:05.611 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:15:05.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2 3 4 16 10 0 256 4194304 0 394 2026-02-17T04:15:05.617 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2@ NAUT 3 4 16 10/ 0 256 4194304/ 0 394 2026-02-17T04:15:05.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:05.618 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:15:05.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:15:05.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:15:05.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:15:05.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:15:05.633 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:15:05.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:05.634 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:15:05.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:15:05.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:15:05.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:15:05.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:15:05.649 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:15:05.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:05.650 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:15:05.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:15:05.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:15:05.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:15:05.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:15:05.665 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:15:05.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:05.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:15:05.666 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:15:05.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:15:05.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:15:05.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:15:05.682 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:15:05.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:15:05.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:15:11.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:15:11.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:15:11.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:15:11.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:15:11.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:15:11.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:15:11.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:15:11.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:15:11.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:15:11.401 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:15:11.401 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:11.401 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:11.410 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:15:11.410 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:11.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:11.418 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:15:11.418 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:11.418 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:11.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:15:11.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301711425955955 2026-02-17T04:15:11.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:11.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:15:11.583 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:15:11.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:11.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:15:11.746 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:15:11.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:11.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:15:11.908 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:15:11.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:15:11.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:15:12.071 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:15:12.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:15:12.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:15:12.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:15:12.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301712246710162 2026-02-17T04:15:12.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=820 2026-02-17T04:15:12.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:15:12.301 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:15:12.301 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:12.301 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:12.309 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:15:12.309 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:12.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:12.316 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:15:12.316 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:15:12.316 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:12.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:15:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:15:13.154400+0000 19'14 32:95 [1,2,0] 1 [1,2,0] 1 19'14 2026-02-17T04:15:13.152058+0000 19'14 2026-02-17T04:15:13.152058+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:13.152058+0000 14 0 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-17T04:15:12.599019+0000 19'14 32:103 [0,1,2] 0 [0,1,2] 0 19'14 2026-02-17T04:15:12.597480+0000 19'14 2026-02-17T04:15:12.597480+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:12.597480+0000 14 0 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-17T04:15:11.755648+0000 19'19 32:96 [2,0,1] 2 [2,0,1] 2 19'19 2026-02-17T04:15:11.753200+0000 19'19 2026-02-17T04:15:11.753200+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:11.753200+0000 19 0 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-17T04:15:12.152145+0000 19'17 32:112 [1,0,2] 1 [1,0,2] 1 19'17 2026-02-17T04:15:12.150061+0000 19'17 2026-02-17T04:15:12.150061+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:15:12.150061+0000 17 0 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:17.481 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:15:17.482 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:15:17.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2 3 4 16 10 0 256 4194304 0 820 2026-02-17T04:15:17.488 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2@ REPR 3 4 16 10/ 0 256 4194304/ 0 820 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0415 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:15:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:17.576 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.576 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.576 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.576 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.577 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:15:17.578 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.579 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.580 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.581 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.582 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.583 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "value": 32768 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.584 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.585 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.586 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.008999878, 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.004499939 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.587 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.588 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.589 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.590 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.591 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.592 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.593 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.594 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.595 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.596 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.597 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.598 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.599 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.600 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.601 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.602 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 32768 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.604 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.008999878, 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.004499939 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.605 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.606 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.607 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.608 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.609 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:17.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.623 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 14, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.624 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.625 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.626 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 32768 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.627 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.015999785, 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999946 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.628 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.629 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.630 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.631 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.632 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 14, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.633 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.634 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 32768 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.635 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.015999785, 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999946 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.636 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.637 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.638 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.639 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:17.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.683 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 8, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 128 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 32768 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.006999905, 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003499952 2026-02-17T04:15:17.686 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.687 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.688 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.689 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.690 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 8, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.691 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 128 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 32768 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.006999905, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003499952 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:17.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.695 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.696 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:17.697 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:17.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:17.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:26.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:15:26.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:26.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.487 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 9, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.488 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.489 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "value": 49152 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.490 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.491 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.011999838, 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999946 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.492 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.493 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.494 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.495 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.496 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.497 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.498 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 9, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.499 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.500 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout: "value": 49152 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.501 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.502 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.011999838, 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999946 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.504 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.505 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.506 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.507 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.508 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:26.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.545 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 21, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.546 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.547 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr: "value": 49152 2026-02-17T04:15:26.548 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.549 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.023999677, 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999946 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.554 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.555 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.556 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 21, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.557 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.558 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": 49152 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.023999677, 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999946 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.563 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:26.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.602 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 12, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.603 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 192 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 49152 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.604 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.011999838, 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.003999946 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.605 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.606 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.607 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:15:26.608 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:15:26.609 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 12, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.610 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 192 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 49152 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.612 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.613 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.011999838, 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.003999946 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.614 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.615 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.616 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.617 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:15:26.618 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:15:26.619 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:15:26.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:15:26.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:15:37.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:15:37.220 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:15:37.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:15:37.426 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:15:37.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:15:37.631 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 1024 256 4 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:15:37.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=1024 2026-02-17T04:15:37.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:15:37.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:15:37.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:15:37.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301737640473249 2026-02-17T04:15:37.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:15:37.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:15:37.642 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.wPEXvykoIW bs=256 count=1 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 6.1935e-05 s, 4.1 MB/s 2026-02-17T04:15:37.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj129 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj130 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj131 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj132 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj133 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj134 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj135 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj136 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj137 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj138 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj139 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj140 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj141 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj142 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj143 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj144 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj145 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj146 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj147 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj148 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj149 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj150 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj151 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj152 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj153 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj154 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj155 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj156 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj157 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj158 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj159 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj160 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj161 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj162 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj163 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj164 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj165 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj166 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj167 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj168 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj169 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj170 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj171 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj172 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj173 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj174 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj175 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj176 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj177 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj178 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj179 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj180 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj181 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj182 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj183 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj184 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj185 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj186 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj187 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj188 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj189 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj190 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj191 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj192 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj193 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj194 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj195 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj196 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj197 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj198 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj199 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj200 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj201 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj202 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj203 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj204 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj205 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj206 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj207 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj208 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj209 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj210 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj211 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj212 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj213 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj214 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj215 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj216 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj217 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj218 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj219 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj220 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj221 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj222 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj223 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj224 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj225 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj226 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj227 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj228 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj229 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj230 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj231 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj232 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj233 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj234 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj235 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj236 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj237 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj238 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj239 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj240 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj241 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj242 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj243 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj244 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj245 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj246 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj247 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj248 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj249 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj250 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj251 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj252 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj253 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj254 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj255 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj256 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj257 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj258 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj259 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj260 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj261 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj262 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj263 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj264 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj266 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj267 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj268 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj265 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj269 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj270 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj271 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj272 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj273 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj274 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj275 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj276 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj277 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj278 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj279 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj280 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj281 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj282 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj283 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:38.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj284 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj285 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj286 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj287 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj288 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj289 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj290 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj291 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj292 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj293 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj294 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj295 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj296 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj297 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj298 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj299 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj300 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj301 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj302 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj303 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj304 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj306 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj307 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj308 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj305 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj309 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj310 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj311 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj312 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj313 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj314 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj315 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj316 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj317 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj318 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj319 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj320 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj321 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj322 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj323 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj324 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj325 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj326 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj327 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj328 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj329 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj330 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj331 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj332 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj333 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj334 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj335 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj336 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj337 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj338 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj339 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj340 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj341 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj342 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj343 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj344 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj345 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj346 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj347 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj348 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj349 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj350 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj351 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj352 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj353 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj354 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj355 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj356 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj357 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj358 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj359 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj360 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj361 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj362 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj363 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj364 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj365 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj366 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj367 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj368 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj369 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj370 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj371 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj372 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj373 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj374 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj375 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj376 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj377 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj378 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj379 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj380 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj381 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj382 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj383 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj384 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj385 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj386 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj387 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj388 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj389 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj390 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj391 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj392 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj393 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj394 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj395 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj396 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj397 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj398 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj399 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj400 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj401 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj402 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj403 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj404 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj405 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj406 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj407 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj408 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj409 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj410 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj411 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj412 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj413 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj414 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj415 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj416 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj417 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj418 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj419 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj420 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj422 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj423 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj424 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj421 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj425 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj426 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj427 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj428 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj429 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj430 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj431 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj432 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj433 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj434 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj435 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj436 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj437 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj438 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj439 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj440 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj441 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj442 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj443 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj444 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj445 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj446 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj447 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj448 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj449 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj450 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj451 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj452 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj453 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj454 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj455 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj456 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj457 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj458 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj459 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj460 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj461 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj462 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj463 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj464 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj465 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj466 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj467 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj468 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj469 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj470 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj471 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj472 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj473 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj474 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj475 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj476 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj477 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj478 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj479 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj480 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj481 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj482 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj483 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj484 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj485 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj486 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj487 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj488 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj489 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj490 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj491 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:39.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj492 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj493 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj494 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj495 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj496 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj497 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj498 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj499 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj500 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj501 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj502 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj503 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj504 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj505 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj506 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj507 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj508 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj509 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj510 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj511 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj512 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj513 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj514 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj515 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj516 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj517 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj518 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj519 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj520 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj521 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj522 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj523 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj524 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj525 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj526 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj527 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj528 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj529 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj530 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj531 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj532 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj533 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj534 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj535 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj536 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj537 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj538 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj539 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj540 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj541 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj542 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj543 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj544 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj545 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj546 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj547 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj548 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj549 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj550 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj551 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj552 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj553 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj554 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj555 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj556 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj557 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj558 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj559 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj560 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj561 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj562 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj563 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj564 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj565 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj566 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj567 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj568 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj569 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj570 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj571 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj572 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj573 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj574 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj575 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj576 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj577 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj578 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj579 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj580 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj581 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj582 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj583 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj584 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj585 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj586 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj587 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj588 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj589 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj590 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj591 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj592 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj593 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj594 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj595 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj596 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj597 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj598 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj599 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj600 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj601 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj602 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj603 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj604 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj605 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj606 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj607 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj608 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj609 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj610 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj611 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj612 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj613 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj614 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj615 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj616 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj617 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj618 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj619 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj620 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj621 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj622 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj623 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj624 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj625 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj626 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj627 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj628 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj629 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj630 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj631 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj632 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj633 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj634 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj635 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj636 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj637 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj638 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj639 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj640 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj641 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj642 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj643 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj644 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj645 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj646 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj647 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj648 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj649 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj650 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj651 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj652 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj653 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj654 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj655 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj656 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj657 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj658 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj659 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj660 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj661 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj662 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj663 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj664 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj665 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj666 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj667 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj668 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj669 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj670 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj671 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj672 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj673 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj674 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj675 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj676 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj677 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj678 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj679 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj680 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj681 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj682 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj683 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj684 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj685 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj686 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj687 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj688 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj689 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj690 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj691 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj692 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj693 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj694 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj695 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj696 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj697 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj698 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj699 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:40.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:40.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj700 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj701 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj702 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj703 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj704 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj705 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj706 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj707 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj708 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj709 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj710 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj711 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj712 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj713 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj714 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj715 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj716 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj717 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj718 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj719 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj720 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj721 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj722 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj723 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj724 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj725 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj726 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj727 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj728 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj729 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj730 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj731 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj732 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj733 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj734 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj735 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj736 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj738 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj739 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj740 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj737 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj741 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj742 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj743 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj744 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj745 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj746 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj747 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj748 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj749 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj750 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj751 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj752 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj753 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj754 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj755 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj756 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj757 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj758 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj759 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj760 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj761 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj762 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj763 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj764 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj765 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj766 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj767 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj768 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj769 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj770 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj771 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj772 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj773 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj774 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj775 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj776 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj777 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj778 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj779 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj780 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj781 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj782 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj783 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj784 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj785 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj786 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj787 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj788 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj789 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj790 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj791 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj792 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj793 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj794 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj795 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj796 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj797 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj798 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj799 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj800 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj801 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj802 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj803 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj804 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj805 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj806 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj807 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj808 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj809 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj810 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj811 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj812 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj813 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj814 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj815 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj816 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj817 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj818 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj820 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj819 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj821 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj822 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj823 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj824 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj825 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj826 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj827 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj828 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj829 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj830 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj831 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj832 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj833 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj834 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj835 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj836 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj837 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj838 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj839 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj840 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj841 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj842 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj843 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj844 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj845 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj846 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj847 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj848 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj849 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj850 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj851 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj852 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj853 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj854 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj855 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj856 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj857 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj858 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj859 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj860 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj861 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj862 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj863 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj864 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj865 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj866 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj867 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj868 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj869 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj870 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj871 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj872 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj873 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj874 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj875 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj876 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj877 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj878 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj879 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj880 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj881 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj882 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj883 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj884 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj885 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj886 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj887 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj888 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj889 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj890 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj891 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj892 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj893 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj894 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj895 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj896 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj897 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj898 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj899 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj900 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj901 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj902 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj903 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj904 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj905 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj906 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj907 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj908 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj909 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj910 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj911 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:41.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj912 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj913 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj914 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj915 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj916 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj917 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj918 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj919 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj920 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj921 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj922 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj923 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj924 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj925 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj926 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj927 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj928 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj929 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj930 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj931 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj932 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj933 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj934 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj935 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj936 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj937 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj938 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj939 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj940 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj941 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj942 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj943 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj944 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj945 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj946 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj947 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj948 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj949 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj950 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj951 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj952 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj953 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj954 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj955 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj956 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj957 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj958 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj959 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj960 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj961 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj962 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj963 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj964 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj965 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj966 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj967 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj968 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj969 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj970 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj971 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj972 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj973 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj974 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj975 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj976 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj977 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj978 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj979 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj980 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj981 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj982 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj983 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj984 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj985 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj986 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj987 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj988 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj989 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj990 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj991 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj992 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj993 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj994 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj995 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj996 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj997 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj998 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj999 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1000 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1001 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1002 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1003 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1004 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1005 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1006 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1007 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1008 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1009 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1010 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1011 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1012 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1013 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1014 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1015 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1016 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1017 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1018 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1019 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1020 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1021 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1022 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1023 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:15:42.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1024 /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:15:42.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:15:42.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:15:42.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.wPEXvykoIW 2026-02-17T04:15:42.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:15:42.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301742549953003 2026-02-17T04:15:42.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=4909 2026-02-17T04:15:42.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 1024 objects in pool test in 4909 ms' 2026-02-17T04:15:42.551 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 1024 objects in pool test in 4909 ms 2026-02-17T04:15:42.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:15:42.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:15:42.551168371' 2026-02-17T04:15:42.552 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:15:42.551168371 2026-02-17T04:15:42.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:15:42.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:15:42.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:15:42.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:15:42.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:15:42.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:15:42.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:15:42.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-17T04:15:42.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-17T04:15:42.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T04:15:42.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:15:42.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:15:42.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672974 2026-02-17T04:15:42.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672974 2026-02-17T04:15:42.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-42949672974' 2026-02-17T04:15:42.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:15:42.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:15:42.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509452 2026-02-17T04:15:42.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509452 2026-02-17T04:15:42.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509452' 2026-02-17T04:15:42.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:15:42.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-17T04:15:42.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:15:42.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:15:42.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-17T04:15:42.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:15:42.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-17T04:15:42.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T04:15:42.984 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836496 2026-02-17T04:15:42.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:15:43.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-17T04:15:43.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:15:43.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672974 2026-02-17T04:15:43.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:15:43.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:15:43.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672974 2026-02-17T04:15:43.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:15:43.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672974 2026-02-17T04:15:43.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2026-02-17T04:15:43.156 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672974 2026-02-17T04:15:43.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:15:43.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672974 2026-02-17T04:15:43.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:15:43.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509452 2026-02-17T04:15:43.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:15:43.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:15:43.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509452 2026-02-17T04:15:43.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:15:43.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509452 2026-02-17T04:15:43.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2026-02-17T04:15:43.324 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509452 2026-02-17T04:15:43.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:15:43.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509452 -lt 64424509452 2026-02-17T04:15:43.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:15:43.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:15:43.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:15:43.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:15:43.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:15:43.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:15:43.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:15:43.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:15:43.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:15:44.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:15:44.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:15:44.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:15:44.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:15:44.235 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:15:44.235 INFO:tasks.workunit.client.0.trial090.stdout: client io 229 KiB/s wr, 0 op/s rd, 229 op/s wr 2026-02-17T04:15:44.235 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:44.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:15:44.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:15:49.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:15:49.402 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:15:49.403 INFO:tasks.workunit.client.0.trial090.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-17T04:15:33.616508+0000 20'116 20:135 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.403 INFO:tasks.workunit.client.0.trial090.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:15:33.616612+0000 20'137 20:156 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.403 INFO:tasks.workunit.client.0.trial090.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-17T04:15:33.616259+0000 20'145 20:166 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.403 INFO:tasks.workunit.client.0.trial090.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-17T04:15:33.616206+0000 20'118 20:138 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.403 INFO:tasks.workunit.client.0.trial090.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:15:33.616582+0000 20'122 20:142 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.404 INFO:tasks.workunit.client.0.trial090.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:15:33.615590+0000 20'119 20:139 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.404 INFO:tasks.workunit.client.0.trial090.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:15:33.616206+0000 20'129 20:152 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.404 INFO:tasks.workunit.client.0.trial090.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-17T04:15:33.616409+0000 20'138 20:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:15:49.404 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:15:49.404 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:15:49.405 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:15:49.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:15:49.411 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:15:49.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:15:49.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:15:49.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:15:49.468 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:15:49.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:15:49.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:15:49.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:15:49.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:15:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:15:49.529727514' 2026-02-17T04:15:49.530 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:15:49.529727514 2026-02-17T04:15:49.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:15:49.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301749530936800 2026-02-17T04:15:49.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:15:49.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 1024 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=1024 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:15:49.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:16:05.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:16:05.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301765726171357 2026-02-17T04:16:05.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:16:05.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:16:05.727305364 (16195 ms)' 2026-02-17T04:16:05.728 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:16:05.727305364 (16195 ms) 2026-02-17T04:16:05.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=50 2026-02-17T04:16:05.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:16:05.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 50 2026-02-17T04:16:05.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj475 obj291 obj474 obj290 obj477 obj293 obj476 obj292 obj769 obj471 obj295 obj768 obj470 obj294 obj598 obj473 obj297 obj599 obj472 obj296 obj765 obj596 obj299 obj764 obj597 obj298 obj767 obj594 obj766 obj595 obj761 obj592 obj479 obj760 obj593 obj478 obj763 obj590 obj762 obj591 obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj646 obj233 obj647 obj232 obj644 obj231 obj645 obj230 obj642 obj318 obj237 obj643 obj319 obj236 obj640 obj235 obj641 obj234 obj314 obj315 obj316 obj239 obj317 obj238 obj310 obj311 obj648 obj312 obj649 obj313 obj819 obj818 obj817 obj816 obj815 obj814 obj813 obj812 obj811 obj810 obj615 obj426 obj242 obj614 obj427 obj243 obj617 obj424 obj240 obj616 obj425 obj241 obj611 obj422 obj246 obj610 obj423 obj247 obj738 obj613 obj569 obj420 obj244 obj739 obj612 obj568 obj421 obj245 obj736 obj567 obj737 obj566 obj734 obj565 obj248 obj735 obj564 obj249 obj732 obj619 obj563 obj733 obj618 obj562 obj730 obj561 obj428 obj731 obj560 obj429 obj192 obj193 obj190 obj191 obj196 obj197 obj194 obj195 obj198 obj199 obj790 obj791 obj792 obj793 obj794 obj795 obj796 obj797 obj798 obj799 obj949 obj840 obj141 obj97 obj948 obj841 obj140 obj96 obj842 obj143 obj95 obj843 obj142 obj94 obj844 obj145 obj93 obj845 obj144 obj92 obj846 obj147 obj91 obj847 obj146 obj90 obj941 obj848 obj149 obj940 obj849 obj148 obj943 obj942 obj945 obj944 obj947 obj99 obj946 obj98 obj530 obj531 obj532 obj533 obj534 obj535 obj536 obj537 obj538 obj539 obj699 obj698 obj695 obj694 obj697 obj696 obj691 obj690 obj693 obj692 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj718 obj509 obj400 obj325 obj719 obj508 obj401 obj324 obj402 obj327 obj403 obj326 obj404 obj321 obj405 obj320 obj406 obj323 obj407 obj322 obj710 obj501 obj408 obj711 obj500 obj409 obj712 obj503 obj713 obj502 obj714 obj505 obj329 obj715 obj504 obj328 obj716 obj507 obj717 obj506 obj268 obj269 obj639 obj638 obj637 obj264 obj636 obj265 obj635 obj266 obj634 obj267 obj633 obj260 obj632 obj261 obj631 obj262 obj630 obj263 obj747 obj394 obj746 obj395 obj745 obj396 obj744 obj397 obj743 obj390 obj742 obj391 obj741 obj392 obj740 obj393 obj398 obj399 obj749 obj748 obj897 obj896 obj895 obj894 obj893 obj892 obj891 obj459 obj890 obj458 obj457 obj456 obj455 obj454 obj453 obj452 obj899 obj451 obj898 obj450 obj963 obj962 obj961 obj960 obj967 obj966 obj965 obj964 obj969 obj968 obj169 obj168 obj163 obj162 obj161 obj160 obj167 obj166 obj165 obj164 obj912 obj660 obj376 obj913 obj661 obj377 obj910 obj662 obj374 obj911 obj663 obj375 obj916 obj664 obj372 obj917 obj665 obj373 obj914 obj666 obj370 obj915 obj667 obj371 obj668 obj669 obj918 obj919 obj378 obj379 obj879 obj878 obj118 obj119 obj871 obj112 obj870 obj113 obj873 obj110 obj872 obj111 obj875 obj116 obj874 obj117 obj877 obj114 obj876 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj1014 obj1015 obj1016 obj1017 obj1010 obj1011 obj1012 obj1013 obj1018 obj1019 obj721 obj552 obj720 obj553 obj723 obj550 obj722 obj551 obj725 obj556 obj724 obj557 obj727 obj554 obj726 obj555 obj729 obj728 obj558 obj559 obj439 obj255 obj438 obj254 obj998 obj257 obj999 obj256 obj251 obj250 obj253 obj252 obj992 obj431 obj993 obj430 obj990 obj433 obj991 obj432 obj996 obj435 obj259 obj997 obj434 obj258 obj994 obj437 obj995 obj436 obj581 obj580 obj583 obj582 obj585 obj584 obj587 obj586 obj589 obj588 obj488 obj489 obj480 obj481 obj482 obj483 obj484 obj485 obj486 obj487 obj783 obj350 obj782 obj351 obj781 obj352 obj780 obj353 obj787 obj354 obj786 obj355 obj785 obj356 obj784 obj357 obj358 obj1024 obj359 obj789 obj788 obj1021 obj1020 obj1023 obj1022 obj853 obj134 obj852 obj135 obj851 obj136 obj850 obj137 obj938 obj857 obj130 obj939 obj856 obj131 obj855 obj132 obj854 obj133 obj934 obj935 obj936 obj859 obj937 obj858 obj930 obj138 obj931 obj139 obj932 obj933 obj523 obj522 obj521 obj520 obj527 obj526 obj525 obj524 obj529 obj528 obj822 obj659 obj206 obj823 obj658 obj207 obj820 obj204 obj821 obj205 obj826 obj202 obj827 obj203 obj824 obj309 obj200 obj825 obj308 obj201 obj651 obj307 obj650 obj306 obj828 obj653 obj305 obj829 obj652 obj304 obj655 obj303 obj654 obj302 obj657 obj301 obj208 obj656 obj300 obj209 obj185 obj184 obj187 obj186 obj181 obj180 obj183 obj182 obj189 obj188 obj279 obj278 obj277 obj276 obj275 obj274 obj273 obj272 obj271 obj270 obj462 obj387 obj463 obj386 obj778 obj460 obj385 obj779 obj461 obj384 obj466 obj383 obj467 obj382 obj464 obj381 obj465 obj380 obj772 obj773 obj770 obj468 obj771 obj469 obj776 obj777 obj774 obj389 obj775 obj388 obj288 obj289 obj286 obj287 obj284 obj285 obj282 obj283 obj280 obj281 obj158 obj159 obj156 obj157 obj154 obj155 obj152 obj153 obj150 obj151 obj905 obj673 obj369 obj220 obj904 obj672 obj368 obj221 obj907 obj671 obj222 obj906 obj670 obj223 obj901 obj677 obj224 obj900 obj676 obj225 obj903 obj675 obj226 obj902 obj674 obj227 obj361 obj228 obj360 obj229 obj679 obj363 obj678 obj362 obj909 obj365 obj908 obj364 obj367 obj366 obj808 obj109 obj809 obj108 obj804 obj105 obj805 obj104 obj806 obj107 obj807 obj106 obj800 obj101 obj801 obj100 obj802 obj103 obj803 obj102 obj602 obj413 obj603 obj412 obj709 obj600 obj411 obj708 obj601 obj410 obj606 obj578 obj417 obj607 obj579 obj416 obj604 obj415 obj605 obj414 obj703 obj574 obj702 obj575 obj701 obj608 obj576 obj419 obj700 obj609 obj577 obj418 obj707 obj570 obj706 obj571 obj705 obj572 obj704 obj573 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj1007 obj1006 obj1005 obj1004 obj1003 obj1002 obj1001 obj1000 obj1009 obj1008 obj956 obj84 obj957 obj85 obj954 obj86 obj955 obj87 obj952 obj80 obj953 obj81 obj950 obj82 obj951 obj83 obj88 obj89 obj958 obj959 obj884 obj885 obj886 obj887 obj989 obj880 obj448 obj988 obj881 obj449 obj882 obj883 obj985 obj444 obj984 obj445 obj987 obj446 obj986 obj447 obj981 obj888 obj440 obj980 obj889 obj441 obj983 obj442 obj982 obj443 obj4 obj5 obj688 obj499 obj6 obj689 obj498 obj7 obj1 obj2 obj3 obj682 obj493 obj683 obj492 obj680 obj491 obj681 obj490 obj686 obj497 obj8 obj687 obj496 obj9 obj684 obj495 obj685 obj494 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj866 obj127 obj867 obj126 obj864 obj125 obj865 obj124 obj862 obj123 obj863 obj122 obj929 obj860 obj121 obj928 obj861 obj120 obj927 obj926 obj925 obj924 obj923 obj922 obj921 obj868 obj129 obj920 obj869 obj128 obj516 obj332 obj517 obj333 obj514 obj330 obj515 obj331 obj512 obj336 obj513 obj337 obj510 obj334 obj511 obj335 obj338 obj339 obj518 obj519 obj835 obj219 obj834 obj218 obj837 obj836 obj831 obj628 obj830 obj629 obj833 obj832 obj624 obj211 obj625 obj210 obj626 obj213 obj627 obj212 obj839 obj620 obj215 obj838 obj621 obj214 obj622 obj217 obj623 obj216 obj754 obj545 obj755 obj544 obj756 obj547 obj757 obj546 obj750 obj541 obj751 obj540 obj752 obj543 obj753 obj542 obj758 obj549 obj759 obj548 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 obj970 obj971 obj972 obj973 obj974 obj975 obj976 obj977 obj978 obj979 obj178 obj179 obj170 obj171 obj172 obj173 obj174 obj175 obj176 obj177 obj343 obj342 obj341 obj340 obj347 obj346 obj345 obj344 obj349 obj348 2026-02-17T04:16:05.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 50' 2026-02-17T04:16:05.730 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 50 2026-02-17T04:16:05.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj697' 2026-02-17T04:16:05.731 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj697 2026-02-17T04:16:05.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.732 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 1024 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 1024' 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.734 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj697 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj697' 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj697 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj697 ' 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.736 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj106 2026-02-17T04:16:05.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj106' 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj106 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj106 ' 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.737 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj842 2026-02-17T04:16:05.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj842' 2026-02-17T04:16:05.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj842 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj842 ' 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.739 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj850 2026-02-17T04:16:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj850' 2026-02-17T04:16:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj850 2026-02-17T04:16:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj850 ' 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj387' 2026-02-17T04:16:05.741 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj387 2026-02-17T04:16:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj387 2026-02-17T04:16:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj387 ' 2026-02-17T04:16:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.743 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj885 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj885' 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj885 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj885 ' 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.745 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj487 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj487' 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj487 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj487 ' 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.746 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj633 2026-02-17T04:16:05.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj633' 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj633 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj633 ' 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.748 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj164 2026-02-17T04:16:05.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj164' 2026-02-17T04:16:05.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj164 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj164 ' 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj659' 2026-02-17T04:16:05.750 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj659 2026-02-17T04:16:05.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj659 2026-02-17T04:16:05.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj659 ' 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj303' 2026-02-17T04:16:05.752 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj303 2026-02-17T04:16:05.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj303 2026-02-17T04:16:05.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj303 ' 2026-02-17T04:16:05.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj124' 2026-02-17T04:16:05.754 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj124 2026-02-17T04:16:05.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj124 2026-02-17T04:16:05.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj124 ' 2026-02-17T04:16:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.756 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj40 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj40' 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj40 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj40 ' 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.758 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj51 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj51' 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj51 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj51 ' 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.760 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj552 2026-02-17T04:16:05.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj552' 2026-02-17T04:16:05.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj552 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj552 ' 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.761 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj758 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj758' 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj758 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj758 ' 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj335' 2026-02-17T04:16:05.763 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj335 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj335 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj335 ' 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.764 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj995 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj995' 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj995 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj995 ' 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.766 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj343 2026-02-17T04:16:05.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj343' 2026-02-17T04:16:05.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj343 2026-02-17T04:16:05.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj343 ' 2026-02-17T04:16:05.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.767 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj293 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj293' 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj293 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj293 ' 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj324' 2026-02-17T04:16:05.769 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj324 2026-02-17T04:16:05.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj324 2026-02-17T04:16:05.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj324 ' 2026-02-17T04:16:05.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj143' 2026-02-17T04:16:05.770 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj143 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj143 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj143 ' 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj204' 2026-02-17T04:16:05.771 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj204 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj204 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj204 ' 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj984' 2026-02-17T04:16:05.773 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj984 2026-02-17T04:16:05.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj984 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj984 ' 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.774 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj805 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj805' 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj805 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj805 ' 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.775 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj824 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj824' 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj824 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj824 ' 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj237' 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj237 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj237 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj237 ' 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj18' 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj18 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj18 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj18 ' 2026-02-17T04:16:05.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj262 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj262' 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj262 2026-02-17T04:16:05.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj262 ' 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj797 2026-02-17T04:16:05.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj797' 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj797 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj797 ' 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.781 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj128 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj128' 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj128 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj128 ' 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj217' 2026-02-17T04:16:05.782 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj217 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj217 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj217 ' 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj570' 2026-02-17T04:16:05.783 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj570 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj570 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj570 ' 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj422' 2026-02-17T04:16:05.784 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj422 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj422 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj422 ' 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.785 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1014 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1014' 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1014 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1014 ' 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj332' 2026-02-17T04:16:05.786 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj332 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj332 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj332 ' 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj908' 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj908 2026-02-17T04:16:05.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj908 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj908 ' 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj818 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj818' 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj818 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj818 ' 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj194' 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj194 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj194 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj194 ' 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj445 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj445' 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj445 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj445 ' 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=40 )) 2026-02-17T04:16:05.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj171 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stdout:Object obj171: acting: 1 0 2 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj171: acting: 1 0 2' 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.791 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj171 (40) 0 2 1' 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj171 (40) 0 2 1 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.792 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj171 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj171' 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj171 ' 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj317 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stdout:Object obj317: acting: 2 0 1 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj317: acting: 2 0 1' 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:16:05.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj317 (41) 0 1 2' 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj317 (41) 0 1 2 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj317' 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj317 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj317 ' 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj247 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stdout:Object obj247: acting: 1 0 2 2026-02-17T04:16:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj247: acting: 1 0 2' 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj247 (42) 0 2 1' 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj247 (42) 0 2 1 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj247 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj247' 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj247 ' 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj725 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.797 INFO:tasks.workunit.client.0.trial090.stdout:Object obj725: acting: 1 2 0 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj725: acting: 1 2 0' 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj725 (43) 2 0 1' 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj725 (43) 2 0 1 2026-02-17T04:16:05.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj725 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj725' 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj725 ' 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj699 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj699: acting: 0 1 2' 2026-02-17T04:16:05.799 INFO:tasks.workunit.client.0.trial090.stdout:Object obj699: acting: 0 1 2 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj699 (44) 1 2 0' 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj699 (44) 1 2 0 2026-02-17T04:16:05.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj699 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj699' 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj699 ' 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj925 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj925: acting: 1 2 0' 2026-02-17T04:16:05.801 INFO:tasks.workunit.client.0.trial090.stdout:Object obj925: acting: 1 2 0 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj925 (45) 2 0 1' 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj925 (45) 2 0 1 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj925' 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj925 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj925 ' 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj770 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stdout:Object obj770: acting: 1 0 2 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj770: acting: 1 0 2' 2026-02-17T04:16:05.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj770 (46) 0 2 1' 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj770 (46) 0 2 1 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj770' 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj770 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj770 ' 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj292 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stdout:Object obj292: acting: 2 0 1 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj292: acting: 2 0 1' 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.805 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj292 (47) 0 1 2' 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj292 (47) 0 1 2 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.806 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj292 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj292' 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj292 ' 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj183 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stdout:Object obj183: acting: 2 0 1 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj183: acting: 2 0 1' 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj183 (48) 0 1 2' 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj183 (48) 0 1 2 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj183 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj183' 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj183 ' 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj478 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj478: acting: 0 1 2' 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stdout:Object obj478: acting: 0 1 2 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj478 (49) 1 2 0' 2026-02-17T04:16:05.809 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj478 (49) 1 2 0 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj478' 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj478 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj478 ' 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:16:05.810 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:05.811 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:16:05.811 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:05.811 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:05.811 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:16:05.811 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:05.819 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:05.819 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:16:05.819 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:05.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:16:05.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:16:05.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:16:05.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:16:05.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:16:05.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:16:05.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:16:05.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:16:06.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:16:06.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:16:06.935 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj697 obj885 obj303 obj335 obj995 obj805 obj797 2026-02-17T04:16:06.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj697 obj885 obj303 obj335 obj995 obj805 obj797 ' 2026-02-17T04:16:06.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:06.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:06.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj697 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:06.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:06.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj697 2026-02-17T04:16:06.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj697 rm-attr _ 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj885 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj885 2026-02-17T04:16:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj885 rm-attr _ 2026-02-17T04:16:07.164 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj303 2026-02-17T04:16:07.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj303 2026-02-17T04:16:07.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj303 rm-attr _ 2026-02-17T04:16:07.309 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.310 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj335 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj335 2026-02-17T04:16:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj335 rm-attr _ 2026-02-17T04:16:07.443 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:07.443 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.444 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj995 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj995 2026-02-17T04:16:07.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj995 rm-attr _ 2026-02-17T04:16:07.583 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:07.584 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:07.584 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.584 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj805 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj805 2026-02-17T04:16:07.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj805 rm-attr _ 2026-02-17T04:16:07.713 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:07.713 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:07.713 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.714 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:07.714 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:07.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:07.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj797 2026-02-17T04:16:07.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj797 2026-02-17T04:16:07.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj797 rm-attr _ 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:07.855 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:07.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj171 obj247 obj725 obj925 obj770 obj183 ' obj_to_pgid delete_oi 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj171 obj247 obj725 obj925 obj770 obj183 ' 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:16:07.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:16:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj171 obj247 obj725 obj925 obj770 obj183 ]] 2026-02-17T04:16:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:16:07.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj171 obj247 obj725 obj925 obj770 obj183 ' 2026-02-17T04:16:07.891 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj171 obj247 obj725 obj925 obj770 obj183 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:07.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj171 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj171 2026-02-17T04:16:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj171 rm-attr _ 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:07.989 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj247 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj247 2026-02-17T04:16:08.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj247 rm-attr _ 2026-02-17T04:16:08.126 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:08.126 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.127 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0f45d4cb:::obj171:head#, (61) No data available 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:08.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:08.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj725 2026-02-17T04:16:08.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:08.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj725 2026-02-17T04:16:08.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj725 rm-attr _ 2026-02-17T04:16:08.254 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7a057f92:::obj247:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.258 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0f45d4cb:::obj171:head#, (61) No data available 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj925 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj925 2026-02-17T04:16:08.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj925 rm-attr _ 2026-02-17T04:16:08.392 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7a057f92:::obj247:head#, (61) No data available 2026-02-17T04:16:08.393 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c66ac714:::obj725:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:08.396 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:08.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.397 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0f45d4cb:::obj171:head#, (61) No data available 2026-02-17T04:16:08.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:16:08.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:16:08.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj770 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj770 2026-02-17T04:16:08.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj770 rm-attr _ 2026-02-17T04:16:08.544 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7a057f92:::obj247:head#, (61) No data available 2026-02-17T04:16:08.545 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c66ac714:::obj725:head#, (61) No data available 2026-02-17T04:16:08.545 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f4dfc0ef:::obj925:head#, (61) No data available 2026-02-17T04:16:08.548 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:08.548 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:08.548 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:08.548 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:08.548 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0f45d4cb:::obj171:head#, (61) No data available 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj183 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj183 2026-02-17T04:16:08.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj183 rm-attr _ 2026-02-17T04:16:08.674 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:662774ca:::obj770:head#, (61) No data available 2026-02-17T04:16:08.674 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:7a057f92:::obj247:head#, (61) No data available 2026-02-17T04:16:08.675 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c66ac714:::obj725:head#, (61) No data available 2026-02-17T04:16:08.675 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f4dfc0ef:::obj925:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:471d2579:::obj805:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4918aa91:::obj303:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4ae48d33:::obj797:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4c6e4e73:::obj885:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:56f74aab:::obj995:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5db67a8e:::obj697:head#, (61) No data available 2026-02-17T04:16:08.678 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0f45d4cb:::obj171:head#, (61) No data available 2026-02-17T04:16:08.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:08.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:16:08.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:16:08.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj106 obj842 obj387 obj487 obj633 obj164 obj659 obj758 obj343 obj293 obj143 obj204 obj984 obj824 obj237 obj262 obj128 obj570 obj422 obj1014 obj332 obj908 obj445 ' 2026-02-17T04:16:08.722 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj106 obj842 obj387 obj487 obj633 obj164 obj659 obj758 obj343 obj293 obj143 obj204 obj984 obj824 obj237 obj262 obj128 obj570 obj422 obj1014 obj332 obj908 obj445 2026-02-17T04:16:08.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:08.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj106 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj106 2026-02-17T04:16:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj106 rm-attr _ 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj842 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj842 2026-02-17T04:16:08.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj842 rm-attr _ 2026-02-17T04:16:08.946 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:08.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:08.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:08.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:08.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:08.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj387 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj387 2026-02-17T04:16:08.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj387 rm-attr _ 2026-02-17T04:16:09.082 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.082 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:16:09.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:16:09.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj487 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj487 2026-02-17T04:16:09.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj487 rm-attr _ 2026-02-17T04:16:09.215 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.215 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.216 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:09.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj633 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj633 2026-02-17T04:16:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj633 rm-attr _ 2026-02-17T04:16:09.349 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.349 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.349 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:09.349 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:09.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:09.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj164 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj164 2026-02-17T04:16:09.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj164 rm-attr _ 2026-02-17T04:16:09.481 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:09.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.482 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:09.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:16:09.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj659 2026-02-17T04:16:09.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj659 2026-02-17T04:16:09.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj659 rm-attr _ 2026-02-17T04:16:09.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:09.617 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:09.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.618 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:09.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:16:09.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:16:09.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj758 2026-02-17T04:16:09.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj758 2026-02-17T04:16:09.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj758 rm-attr _ 2026-02-17T04:16:09.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:09.754 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.754 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.754 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:09.754 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:09.755 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.755 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj343 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj343 2026-02-17T04:16:09.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj343 rm-attr _ 2026-02-17T04:16:09.899 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:09.899 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:09.901 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:09.902 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:09.902 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:09.902 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:09.902 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:09.902 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:09.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:09.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj293 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj293 2026-02-17T04:16:09.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj293 rm-attr _ 2026-02-17T04:16:10.036 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.036 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.039 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj143 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj143 2026-02-17T04:16:10.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj143 rm-attr _ 2026-02-17T04:16:10.185 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.185 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.185 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.188 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj204 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj204 2026-02-17T04:16:10.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj204 rm-attr _ 2026-02-17T04:16:10.333 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.334 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.334 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.336 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.336 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.336 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.336 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.337 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:10.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj984 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj984 2026-02-17T04:16:10.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj984 rm-attr _ 2026-02-17T04:16:10.467 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.468 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:10.469 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:10.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:10.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:10.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj824 2026-02-17T04:16:10.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj824 2026-02-17T04:16:10.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj824 rm-attr _ 2026-02-17T04:16:10.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.605 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.605 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.605 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:10.605 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:10.606 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:10.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj237 2026-02-17T04:16:10.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj237 2026-02-17T04:16:10.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj237 rm-attr _ 2026-02-17T04:16:10.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.744 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:10.745 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:10.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj262 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj262 2026-02-17T04:16:10.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj262 rm-attr _ 2026-02-17T04:16:10.874 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:10.874 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:10.875 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:10.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:10.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:10.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:10.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:10.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:10.879 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:10.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:10.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj128 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj128 2026-02-17T04:16:10.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj128 rm-attr _ 2026-02-17T04:16:11.015 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.015 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.015 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.019 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.019 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.019 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.019 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:11.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj570 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj570 2026-02-17T04:16:11.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj570 rm-attr _ 2026-02-17T04:16:11.152 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.152 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.152 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.156 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.156 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.156 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.156 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.157 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:11.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj422 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj422 2026-02-17T04:16:11.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj422 rm-attr _ 2026-02-17T04:16:11.296 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.296 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.297 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.298 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:11.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1014 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1014 2026-02-17T04:16:11.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1014 rm-attr _ 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.432 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:11.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj332 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj332 2026-02-17T04:16:11.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj332 rm-attr _ 2026-02-17T04:16:11.557 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.557 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.557 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.561 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.562 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.563 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.563 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.563 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:16:11.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj908 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj908 2026-02-17T04:16:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj908 rm-attr _ 2026-02-17T04:16:11.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.703 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dcf61aca:::obj332:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.704 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.705 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj445 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj445 2026-02-17T04:16:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj445 rm-attr _ 2026-02-17T04:16:11.842 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.843 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.843 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.849 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.849 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dcf61aca:::obj332:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff600977:::obj908:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:11.850 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.851 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj317 obj699 obj292 ' obj_to_pgid delete_oi 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj317 obj699 obj292 ' 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj317 obj699 obj292 ]] 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:16:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj317 obj699 obj292 ' 2026-02-17T04:16:11.887 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj317 obj699 obj292 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj317 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj317 2026-02-17T04:16:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj317 rm-attr _ 2026-02-17T04:16:11.977 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dcf61aca:::obj332:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:11.978 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff600977:::obj908:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0efd4012:::obj445:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:11.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:12.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:12.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:12.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj699 2026-02-17T04:16:12.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:12.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj699 2026-02-17T04:16:12.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj699 rm-attr _ 2026-02-17T04:16:12.113 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:12.113 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:12.113 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:12.113 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b26ae718:::obj317:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dcf61aca:::obj332:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:12.115 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff600977:::obj908:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:12.116 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:12.117 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:12.117 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0efd4012:::obj445:head#, (61) No data available 2026-02-17T04:16:12.117 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:12.117 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj292 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj292 2026-02-17T04:16:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj292 rm-attr _ 2026-02-17T04:16:12.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:63879cd5:::obj758:head#, (61) No data available 2026-02-17T04:16:12.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6971da6a:::obj293:head#, (61) No data available 2026-02-17T04:16:12.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6c5141d7:::obj659:head#, (61) No data available 2026-02-17T04:16:12.257 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b26ae718:::obj317:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d0f049f1:::obj387:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d624ba2f:::obj984:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:d9c98c7a:::obj262:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:dcf61aca:::obj332:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:ddce93c9:::obj164:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:f0a12295:::obj487:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:ff600977:::obj908:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:249a23dc:::obj422:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2c37d678:::obj842:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:308acc2c:::obj1014:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bac1bc4:::obj633:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-17T04:16:12.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:3d7e2b4d:::obj143:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:5ee11592:::obj699:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:040c73f9:::obj237:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ebfc2f5:::obj824:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0efd4012:::obj445:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:10f4e680:::obj204:head#, (61) No data available 2026-02-17T04:16:12.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:171b715e:::obj570:head#, (61) No data available 2026-02-17T04:16:12.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:12.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:16:12.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:16:12.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj850 obj124 obj40 obj51 obj552 obj324 obj18 obj217 obj818 obj194 ' 2026-02-17T04:16:12.301 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj850 obj124 obj40 obj51 obj552 obj324 obj18 obj217 obj818 obj194 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj850 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj850 2026-02-17T04:16:12.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj850 rm-attr _ 2026-02-17T04:16:12.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:16:12.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:16:12.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj124 2026-02-17T04:16:12.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:12.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj124 2026-02-17T04:16:12.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj124 rm-attr _ 2026-02-17T04:16:12.552 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj40 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj40 2026-02-17T04:16:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj40 rm-attr _ 2026-02-17T04:16:12.681 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:12.682 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:12.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:12.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj51 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:12.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj51 2026-02-17T04:16:12.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj51 rm-attr _ 2026-02-17T04:16:12.823 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:12.826 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:12.826 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:12.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:12.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:12.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:12.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:12.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj552 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj552 2026-02-17T04:16:12.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj552 rm-attr _ 2026-02-17T04:16:12.965 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:12.965 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:12.967 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:12.967 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj324 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj324 2026-02-17T04:16:13.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj324 rm-attr _ 2026-02-17T04:16:13.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.110 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.111 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.112 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:13.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:13.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj18 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj18 2026-02-17T04:16:13.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj18 rm-attr _ 2026-02-17T04:16:13.250 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.250 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.251 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.252 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8b716ab6:::obj324:head#, (61) No data available 2026-02-17T04:16:13.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj217 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj217 2026-02-17T04:16:13.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj217 rm-attr _ 2026-02-17T04:16:13.379 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.379 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.380 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:16:13.380 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.381 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.381 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.381 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8b716ab6:::obj324:head#, (61) No data available 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj818 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj818 2026-02-17T04:16:13.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj818 rm-attr _ 2026-02-17T04:16:13.523 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.523 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.523 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:16:13.523 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.525 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.525 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.525 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8a7d5b8a:::obj217:head#, (61) No data available 2026-02-17T04:16:13.525 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8b716ab6:::obj324:head#, (61) No data available 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:16:13.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:16:13.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj194 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj194 2026-02-17T04:16:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj194 rm-attr _ 2026-02-17T04:16:13.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:16:13.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8a7d5b8a:::obj217:head#, (61) No data available 2026-02-17T04:16:13.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8b716ab6:::obj324:head#, (61) No data available 2026-02-17T04:16:13.665 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-17T04:16:13.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj478 ' obj_to_pgid delete_oi 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj478 ' 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj478 ]] 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj478 2026-02-17T04:16:13.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj478 ' 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj478 2026-02-17T04:16:13.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:16:13.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:16:13.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj478 2026-02-17T04:16:13.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj478 rm-attr _ 2026-02-17T04:16:13.793 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-17T04:16:13.793 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b6a90992:::obj552:head#, (61) No data available 2026-02-17T04:16:13.793 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-17T04:16:13.793 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:b9836a99:::obj18:head#, (61) No data available 2026-02-17T04:16:13.793 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-17T04:16:13.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-17T04:16:13.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8336f52a:::obj850:head#, (61) No data available 2026-02-17T04:16:13.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8a7d5b8a:::obj217:head#, (61) No data available 2026-02-17T04:16:13.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8b716ab6:::obj324:head#, (61) No data available 2026-02-17T04:16:13.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-17T04:16:13.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:16:13.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:16:13.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:16:13.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:16:13.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:16:24.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:16:29.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:16:30.037 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-17T04:16:17.564074+0000 20'116 32:158 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:16:17.564140+0000 20'137 32:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-17T04:16:17.563738+0000 20'145 32:182 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-17T04:16:17.563998+0000 20'118 32:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:16:17.563937+0000 20'122 32:166 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:16:17.563482+0000 20'119 32:177 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:16:17.563756+0000 20'129 32:169 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-17T04:16:17.564050+0000 20'138 32:186 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:16:30.038 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:16:30.039 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:16:30.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:30.046 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:16:30.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:16:30.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:16:30.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:16:30.104 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:16:30.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:16:30.157 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:30.157 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:16:30.158 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:30.165 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:30.165 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:16:30.166 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:30.173 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:30.173 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:16:30.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:30.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:16:31.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:16:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301791179722430 2026-02-17T04:16:31.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:16:31.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:16:31.181524537' 2026-02-17T04:16:31.182 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:16:31.181524537 2026-02-17T04:16:31.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:16:31.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:16:31.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:16:31.343 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:16:31.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:16:31.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301791355541297 2026-02-17T04:16:31.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:16:31.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:16:31.356746185 (175 ms)' 2026-02-17T04:16:31.357 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:16:31.356746185 (175 ms) 2026-02-17T04:16:31.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:16:31.358 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:16:31.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.359 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-17T04:16:31.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-17T04:16:31.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-17T04:16:31.360 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-17T04:16:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-17T04:16:31.361 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-17T04:16:31.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.362 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-17T04:16:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-17T04:16:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.363 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:16:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:16:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.364 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:16:31.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:16:31.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.365 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:16:31.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:16:31.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:16:31.366 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:16:31.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:16:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:16:31.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:16:31.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:16:31.682 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:16:31.682 INFO:tasks.workunit.client.0.trial090.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-17T04:16:17.564074+0000 20'116 32:158 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.682 INFO:tasks.workunit.client.0.trial090.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:16:17.564140+0000 20'137 32:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.682 INFO:tasks.workunit.client.0.trial090.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-17T04:16:17.563738+0000 20'145 32:182 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-17T04:16:17.563998+0000 20'118 32:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:16:17.563937+0000 20'122 32:167 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:16:17.563482+0000 20'119 32:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:16:17.563756+0000 20'129 32:170 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-17T04:16:17.564050+0000 20'138 32:187 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:16:31.683 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:16:31.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:16:31.746 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:31.746 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:31.746 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.755 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:31.755 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:31.756 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.764 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:31.764 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:31.764 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:16:31.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301791770915996 2026-02-17T04:16:31.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:31.772 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:16:31.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:16:31.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:16:31.826 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:31.826 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:31.826 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:31.826 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:31.826 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:31.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:16:31.831 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:16:31.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:16:31.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:31.884 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:31.884 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:31.884 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:31.884 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:16:31.889 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:16:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:16:31.945 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:31.945 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:31.945 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:31.945 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:31.945 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:31.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:31.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:31.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:16:31.950 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:16:31.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:16:32.005 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:32.005 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:32.005 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:32.005 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:32.006 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:32.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:32.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:16:32.011 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:16:32.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:16:32.065 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:32.065 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:32.065 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:32.065 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:32.066 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:32.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:32.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:16:32.070 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:16:32.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:16:32.123 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:32.123 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:32.123 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:32.123 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:32.123 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:32.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:32.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:16:32.128 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:16:32.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:16:32.182 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:32.182 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:32.182 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:32.182 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:32.182 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:32.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:16:32.187 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:16:32.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:16:32.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:16:32.242 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:32.242 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:16:32.242 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:16:32.242 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:16:32.242 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:16:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:16:32.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:16:32.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:16:32.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:16:32.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301792412884141 2026-02-17T04:16:32.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=641 2026-02-17T04:16:32.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:16:32.467 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:32.467 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:32.467 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.475 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:32.476 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:32.476 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.483 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:32.483 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:32.483 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:32.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:16:34.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:16:34.646 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-17T04:16:17.564074+0000 20'116 32:159 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean+scrubbing+deep 2026-02-17T04:16:32.816790+0000 20'137 32:193 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 deep scrubbing for 1s 45 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-17T04:16:17.563738+0000 20'145 32:183 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean+inconsistent 2026-02-17T04:16:31.851569+0000 20'118 32:194 [1,0,2] 1 [1,0,2] 1 20'118 2026-02-17T04:16:31.851525+0000 20'118 2026-02-17T04:16:31.851525+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:31.851525+0000 118 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:16:17.563937+0000 20'122 32:167 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean+inconsistent 2026-02-17T04:16:32.363437+0000 20'119 32:209 [0,1,2] 0 [0,1,2] 0 20'119 2026-02-17T04:16:32.363386+0000 20'119 2026-02-17T04:16:32.363386+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:32.363386+0000 119 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:16:17.563756+0000 20'129 32:170 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:15:33.507298+0000 0 0 2026-02-17T04:16:34.647 INFO:tasks.workunit.client.0.trial090.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-17T04:16:17.564050+0000 20'138 32:189 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:15:33.507298+0000 0'0 2026-02-17T04:15:33.507298+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:16:34.648 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:16:34.648 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:16:34.648 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:16:34.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2b 3 8 128 40 10 256 4194304 0 641 2026-02-17T04:16:34.654 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2b@ NAUT 3 8 128 40/ 10 256 4194304/ 0 641 2026-02-17T04:16:34.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.655 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:16:34.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:16:34.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:16:34.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.671 INFO:tasks.workunit.client.0.trial090.stdout:1027 2026-02-17T04:16:34.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:16:34.672 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:16:34.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:16:34.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.689 INFO:tasks.workunit.client.0.trial090.stdout:1173 2026-02-17T04:16:34.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:16:34.690 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:16:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:16:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.706 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:16:34.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.706 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:16:34.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:16:34.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:16:34.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.722 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:16:34.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.723 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:16:34.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:16:34.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:16:34.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.738 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.0 2026-02-17T04:16:34.738 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:16:34.739 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:16:34.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:16:34.739 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:16:34.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:16:34.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.755 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:16:34.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.756 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:16:34.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:16:34.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:16:34.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.773 INFO:tasks.workunit.client.0.trial090.stdout:1319 2026-02-17T04:16:34.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:34.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:16:34.774 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:16:34.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:16:34.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:16:34.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:16:34.788 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:16:34.789 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:16:34.789 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:16:34.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:16:34.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:16:40.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:16:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:16:40.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:16:40.503 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:40.503 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:40.504 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:40.511 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:40.511 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:40.512 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:40.518 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:40.519 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:40.519 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:40.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:16:40.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301800525311912 2026-02-17T04:16:40.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:40.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:16:40.683 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-17T04:16:40.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:40.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:16:40.847 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:16:40.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:40.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:16:41.014 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-17T04:16:41.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:41.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:16:41.176 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:16:41.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:41.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:16:41.339 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:16:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:16:41.504 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:16:41.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:16:41.675 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:16:41.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:16:41.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:16:41.840 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:16:41.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:16:41.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:16:41.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:16:41.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:16:41.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:16:41.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:16:41.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:16:42.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:16:42.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:16:42.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301802020267228 2026-02-17T04:16:42.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1494 2026-02-17T04:16:42.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:16:42.074 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:16:42.074 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:42.074 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:42.082 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:16:42.082 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:42.083 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:42.090 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:16:42.090 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:16:42.090 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:42.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:16:47.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:16:47.253 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:16:47.253 INFO:tasks.workunit.client.0.trial090.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-17T04:16:42.863885+0000 20'116 32:233 [1,2,0] 1 [1,2,0] 1 20'116 2026-02-17T04:16:42.861553+0000 20'116 2026-02-17T04:16:42.861553+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:42.861553+0000 116 0 2026-02-17T04:16:47.253 INFO:tasks.workunit.client.0.trial090.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:16:41.868661+0000 20'137 32:268 [1,0,2] 1 [1,0,2] 1 20'137 2026-02-17T04:16:41.865932+0000 20'137 2026-02-17T04:16:41.865932+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:41.865932+0000 137 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-17T04:16:41.514549+0000 20'145 32:278 [2,0,1] 2 [2,0,1] 2 20'145 2026-02-17T04:16:41.510451+0000 20'145 2026-02-17T04:16:41.510451+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:41.510451+0000 145 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-17T04:16:40.815453+0000 20'118 32:247 [1,0,2] 1 [1,0,2] 1 20'118 2026-02-17T04:16:40.811927+0000 20'118 2026-02-17T04:16:40.811927+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:40.811927+0000 118 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:16:44.827679+0000 20'122 32:254 [1,2,0] 1 [1,2,0] 1 20'122 2026-02-17T04:16:44.823390+0000 20'122 2026-02-17T04:16:44.823390+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:44.823390+0000 122 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:16:42.434420+0000 20'119 32:267 [0,1,2] 0 [0,1,2] 0 20'119 2026-02-17T04:16:42.428756+0000 20'119 2026-02-17T04:16:42.428756+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:42.428756+0000 119 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:16:42.551055+0000 20'129 32:257 [2,0,1] 2 [2,0,1] 2 20'129 2026-02-17T04:16:42.547836+0000 20'129 2026-02-17T04:16:42.547836+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:42.547836+0000 129 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-17T04:16:43.866206+0000 20'138 32:283 [1,0,2] 1 [1,0,2] 1 20'138 2026-02-17T04:16:43.862675+0000 20'138 2026-02-17T04:16:43.862675+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:16:43.862675+0000 138 0 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:16:47.254 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:16:47.255 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:16:47.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2b 3 8 128 40 10 256 4194304 0 1494 2026-02-17T04:16:47.262 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2b@ REPR 3 8 128 40/ 10 256 4194304/ 0 1494 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:16:47.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0416 2026-02-17T04:16:47.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:16:47.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:16:47.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.350 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.351 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 48, 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.353 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.354 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 524288 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.359 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:16:47.360 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.050999271, 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.025499635 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.361 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.362 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.363 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.364 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.365 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.366 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.367 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.368 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.369 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.370 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.371 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.372 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 48, 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.373 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.374 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.375 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.376 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "value": 524288 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.377 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.050999271, 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.025499635 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.378 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.379 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.380 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.381 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.382 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.384 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.385 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.386 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:47.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.397 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 258, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.398 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.399 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.400 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 524288 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.401 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.269996145, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.026999614 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.402 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.403 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.404 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.405 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.406 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 258, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.407 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 524288 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.409 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.269996145, 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.026999614 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.410 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.411 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.412 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.413 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:47.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:47.453 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 110, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:47.454 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2048 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 524288 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.455 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.115998345, 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.028999586 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.456 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.457 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.458 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.459 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.460 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 110, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.461 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2048 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 524288 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.462 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.115998345, 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.028999586 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.463 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:47.464 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.465 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.466 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:47.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:55.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:16:55.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.836 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.837 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 72, 2026-02-17T04:16:55.838 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.839 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.840 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.841 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.842 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.843 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.844 INFO:tasks.workunit.client.0.trial090.stderr: "value": 755200 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.845 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:16:55.846 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.076998901, 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.025666300 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.847 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.848 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.849 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.850 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.851 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.852 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.853 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.854 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.855 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.856 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.857 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 72, 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.858 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.859 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.860 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "value": 755200 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:16:55.862 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.076998901, 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.025666300 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.863 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.864 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.865 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.866 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.867 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.868 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.869 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.870 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:55.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.881 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 362, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.882 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.883 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2950 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 755200 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.884 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 14, 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.388994450, 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.027785317 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.885 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr: "value": 14 2026-02-17T04:16:55.886 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.887 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.888 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.889 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 362, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.890 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.891 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2950 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 755200 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.892 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 14, 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.388994450, 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.027785317 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.893 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 14 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.894 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.895 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.896 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.897 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.939 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 165, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.940 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2985 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2985 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2985 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2985 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2985 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 764160 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.941 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.177997462, 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.029666243 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.942 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.943 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.944 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.945 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.946 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 165, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:16:55.947 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2985 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2985 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2985 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2985 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2985 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 764160 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.177997462, 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.029666243 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:16:55.949 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:16:55.950 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.951 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:16:55.952 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:16:55.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:17:06.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:17:06.610 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:17:06.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:17:06.816 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:17:06.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:17:07.021 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 32 256 4 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=32 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:17:07.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:17:07.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301827032586652 2026-02-17T04:17:07.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:17:07.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:17:07.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:17:07.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.yx3OOqHEoK bs=256 count=1 2026-02-17T04:17:07.035 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:17:07.035 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:17:07.035 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 5.3649e-05 s, 4.8 MB/s 2026-02-17T04:17:07.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:17:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:17:07.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:17:07.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:17:07.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.yx3OOqHEoK 2026-02-17T04:17:07.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:17:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301827192422202 2026-02-17T04:17:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=159 2026-02-17T04:17:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 32 objects in pool test in 159 ms' 2026-02-17T04:17:07.193 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 32 objects in pool test in 159 ms 2026-02-17T04:17:07.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:17:07.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:17:07.193650262' 2026-02-17T04:17:07.194 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:17:07.193650262 2026-02-17T04:17:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:17:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:17:07.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:17:07.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:17:07.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:17:07.449 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:17:07.450 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:17:07.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:17:07.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:17:07.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:17:07.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:17:07.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:17:07.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:17:07.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:17:07.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:17:07.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-17T04:17:07.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-17T04:17:07.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672970' 2026-02-17T04:17:07.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:17:07.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:17:07.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672970 2-60129542151' 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:17:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:17:07.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:17:07.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:17:07.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:17:07.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:17:07.633 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836491 2026-02-17T04:17:07.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:17:07.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-17T04:17:07.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:17:08.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:17:08.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:17:08.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836491 2026-02-17T04:17:08.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:17:08.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-17T04:17:08.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:17:08.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:17:08.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-17T04:17:08.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:17:08.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-17T04:17:08.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T04:17:08.973 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672970 2026-02-17T04:17:08.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:17:09.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T04:17:09.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:17:09.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T04:17:09.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:17:09.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:17:09.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T04:17:09.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:17:09.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T04:17:09.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T04:17:09.147 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542151 2026-02-17T04:17:09.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:17:09.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-17T04:17:09.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:17:09.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:17:09.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:17:09.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:17:09.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:17:09.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:17:09.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:17:09.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:17:09.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:17:09.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:17:09.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:17:09.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:17:09.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:17:09.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:17:09.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:17:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:17:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:17:09.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:17:09.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:17:10.064 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:17:10.065 INFO:tasks.workunit.client.0.trial090.stdout: nothing is going on 2026-02-17T04:17:10.065 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:10.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:17:10.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:17:15.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:17:03.104876+0000 20'11 20:31 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-17T04:17:03.104755+0000 20'4 20:27 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-17T04:17:03.005477+0000 20'9 20:33 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-17T04:17:03.104851+0000 20'8 20:30 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:15.232 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:17:15.233 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:17:15.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:15.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:17:15.240 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:17:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:17:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:17:15.297 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:17:15.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:17:15.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:17:15.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:17:15.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:17:15.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:17:15.356902464' 2026-02-17T04:17:15.357 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:17:15.356902464 2026-02-17T04:17:15.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:17:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301835358090189 2026-02-17T04:17:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:17:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:17:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 32 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=32 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:17:15.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:17:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:17:15.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301835936319947 2026-02-17T04:17:15.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:17:15.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:17:15.937585056 (578 ms)' 2026-02-17T04:17:15.938 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:17:15.937585056 (578 ms) 2026-02-17T04:17:15.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-17T04:17:15.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:17:15.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-17T04:17:15.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj31 obj30 obj32 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-17T04:17:15.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.940 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 10 2026-02-17T04:17:15.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-17T04:17:15.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.941 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj15 2026-02-17T04:17:15.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj15' 2026-02-17T04:17:15.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 32' 2026-02-17T04:17:15.942 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 32 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 0 )) 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=0 )) 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj15 2026-02-17T04:17:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj15: acting: 2 0 1' 2026-02-17T04:17:15.944 INFO:tasks.workunit.client.0.trial090.stdout:Object obj15: acting: 2 0 1 2026-02-17T04:17:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:17:15.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.945 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:17:15.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj15 (0) 0 1 2' 2026-02-17T04:17:15.946 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj15 (0) 0 1 2 2026-02-17T04:17:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:17:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj15' 2026-02-17T04:17:15.948 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj15 2026-02-17T04:17:15.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj15 ' 2026-02-17T04:17:15.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj29 2026-02-17T04:17:15.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.949 INFO:tasks.workunit.client.0.trial090.stdout:Object obj29: acting: 1 2 0 2026-02-17T04:17:15.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj29: acting: 1 2 0' 2026-02-17T04:17:15.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:17:15.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.950 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:17:15.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj29 (1) 2 0 1' 2026-02-17T04:17:15.951 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj29 (1) 2 0 1 2026-02-17T04:17:15.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-17T04:17:15.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.953 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj29 2026-02-17T04:17:15.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj29' 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj29 ' 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj7 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.954 INFO:tasks.workunit.client.0.trial090.stdout:Object obj7: acting: 2 0 1 2026-02-17T04:17:15.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj7: acting: 2 0 1' 2026-02-17T04:17:15.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:17:15.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.955 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:17:15.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj7 (2) 0 1 2' 2026-02-17T04:17:15.957 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj7 (2) 0 1 2 2026-02-17T04:17:15.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:17:15.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.958 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj7 2026-02-17T04:17:15.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj7' 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj7 ' 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj31 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj31: acting: 2 0 1' 2026-02-17T04:17:15.959 INFO:tasks.workunit.client.0.trial090.stdout:Object obj31: acting: 2 0 1 2026-02-17T04:17:15.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:17:15.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.960 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:17:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj31 (3) 0 1 2' 2026-02-17T04:17:15.962 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj31 (3) 0 1 2 2026-02-17T04:17:15.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:17:15.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj31' 2026-02-17T04:17:15.963 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj31 2026-02-17T04:17:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj31 ' 2026-02-17T04:17:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj4 2026-02-17T04:17:15.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.964 INFO:tasks.workunit.client.0.trial090.stdout:Object obj4: acting: 1 0 2 2026-02-17T04:17:15.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj4: acting: 1 0 2' 2026-02-17T04:17:15.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:17:15.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.965 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:17:15.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj4 (4) 0 2 1' 2026-02-17T04:17:15.966 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj4 (4) 0 2 1 2026-02-17T04:17:15.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:17:15.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.968 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj4 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj4' 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj4 ' 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj18 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.969 INFO:tasks.workunit.client.0.trial090.stdout:Object obj18: acting: 2 0 1 2026-02-17T04:17:15.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj18: acting: 2 0 1' 2026-02-17T04:17:15.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:17:15.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.971 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:17:15.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj18 (5) 0 1 2' 2026-02-17T04:17:15.972 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj18 (5) 0 1 2 2026-02-17T04:17:15.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:17:15.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.973 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj18 2026-02-17T04:17:15.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj18' 2026-02-17T04:17:15.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj18 ' 2026-02-17T04:17:15.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj11 2026-02-17T04:17:15.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.974 INFO:tasks.workunit.client.0.trial090.stdout:Object obj11: acting: 1 2 0 2026-02-17T04:17:15.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj11: acting: 1 2 0' 2026-02-17T04:17:15.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:17:15.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.975 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:17:15.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.976 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj11 (6) 2 0 1 2026-02-17T04:17:15.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj11 (6) 2 0 1' 2026-02-17T04:17:15.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:17:15.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.977 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj11 2026-02-17T04:17:15.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj11' 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj11 ' 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj19 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.978 INFO:tasks.workunit.client.0.trial090.stdout:Object obj19: acting: 1 0 2 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj19: acting: 1 0 2' 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj19 (7) 0 2 1' 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj19 (7) 0 2 1 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj19' 2026-02-17T04:17:15.981 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj19 2026-02-17T04:17:15.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj19 ' 2026-02-17T04:17:15.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj3 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj3: acting: 2 0 1' 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stdout:Object obj3: acting: 2 0 1 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-17T04:17:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.983 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:17:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj3 (8) 0 1 2' 2026-02-17T04:17:15.983 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj3 (8) 0 1 2 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj3' 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj3 2026-02-17T04:17:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj3 ' 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj21 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stdout:Object obj21: acting: 1 0 2 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj21: acting: 1 0 2' 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-17T04:17:15.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:17:15.986 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:17:15.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:17:15.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj21 (9) 0 2 1' 2026-02-17T04:17:15.986 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj21 (9) 0 2 1 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj21' 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj21 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj21 ' 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:17:15.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-17T04:17:15.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:17:15.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:17:15.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:17:16.011 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:16.011 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:17:16.011 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:16.019 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:16.019 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:17:16.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:16.028 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:16.028 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:17:16.028 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:17:16.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:17:16.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:17:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:17:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:17:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:17:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:17:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:17:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:17:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:17:17.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj15 obj29 obj7 obj4 obj3 ' 2026-02-17T04:17:17.347 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj15 obj29 obj7 obj4 obj3 2026-02-17T04:17:17.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj15 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:17.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:17:17.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-17T04:17:17.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj15 rm-attr _ 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:17:17.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj29 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj29 2026-02-17T04:17:17.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj29 rm-attr _ 2026-02-17T04:17:17.579 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:17:17.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:17:17.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:17.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj7 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-17T04:17:17.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj7 rm-attr _ 2026-02-17T04:17:17.707 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:17:17.707 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:17:17.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj4 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-17T04:17:17.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj4 rm-attr _ 2026-02-17T04:17:17.846 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:17:17.846 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-17T04:17:17.846 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:17:17.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:17.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:17.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:17.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:17:17.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:17:17.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:17.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:17.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj3 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj3 2026-02-17T04:17:17.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj3 rm-attr _ 2026-02-17T04:17:17.992 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-17T04:17:17.992 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-17T04:17:17.992 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-17T04:17:17.993 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-17T04:17:18.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:17:18.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:17:18.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:17:18.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj31 obj18 ' 2026-02-17T04:17:18.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:17:18.030 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj31 obj18 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:18.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj31 2026-02-17T04:17:18.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:18.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:17:18.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj31 2026-02-17T04:17:18.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj31 rm-attr _ 2026-02-17T04:17:18.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:18.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:17:18.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:17:18.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:18.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj18 2026-02-17T04:17:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:18.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:17:18.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj18 2026-02-17T04:17:18.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj18 rm-attr _ 2026-02-17T04:17:18.262 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:a0217245:::obj31:head#, (61) No data available 2026-02-17T04:17:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:17:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:17:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:17:18.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj11 obj19 obj21 ' 2026-02-17T04:17:18.308 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj11 obj19 obj21 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:18.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj11 2026-02-17T04:17:18.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:18.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:17:18.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-17T04:17:18.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj11 rm-attr _ 2026-02-17T04:17:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:18.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:18.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj19 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj19 2026-02-17T04:17:18.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj19 rm-attr _ 2026-02-17T04:17:18.528 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:17:18.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:17:18.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:17:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:17:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj21 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj21 2026-02-17T04:17:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj21 rm-attr _ 2026-02-17T04:17:18.666 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-17T04:17:18.666 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-17T04:17:18.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:17:18.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:17:18.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:17:18.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:17:18.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:17:29.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:17:34.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:17:34.916 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:17:34.916 INFO:tasks.workunit.client.0.trial090.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:17:22.364976+0000 20'11 32:54 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:34.916 INFO:tasks.workunit.client.0.trial090.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-17T04:17:22.364773+0000 20'4 32:62 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:34.916 INFO:tasks.workunit.client.0.trial090.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-17T04:17:22.364483+0000 20'9 32:50 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:34.916 INFO:tasks.workunit.client.0.trial090.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-17T04:17:22.364910+0000 20'8 32:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:34.917 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:34.917 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:17:34.917 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:17:34.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:34.925 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:17:34.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:17:34.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:17:34.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:17:34.987 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:17:34.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:17:35.041 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:35.041 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:17:35.042 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:35.049 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:35.049 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:17:35.049 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:35.057 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:35.057 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:17:35.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:35.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:17:36.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:17:36.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301856065110475 2026-02-17T04:17:36.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:17:36.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:17:36.066624496' 2026-02-17T04:17:36.067 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:17:36.066624496 2026-02-17T04:17:36.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:17:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:17:36.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:17:36.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:17:36.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:17:36.225 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:17:36.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:17:36.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301856237867815 2026-02-17T04:17:36.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:17:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:17:36.239048627 (172 ms)' 2026-02-17T04:17:36.239 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:17:36.239048627 (172 ms) 2026-02-17T04:17:36.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:36.240 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:17:36.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:17:36.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:36.241 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:17:36.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:17:36.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:36.243 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-17T04:17:36.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-17T04:17:36.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:36.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-17T04:17:36.244 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-17T04:17:36.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:17:36.245 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:17:36.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:17:36.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:17:36.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:17:36.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:17:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:17:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:17:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:17:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:17:36.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:17:36.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:17:22.364976+0000 20'11 32:55 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-17T04:17:22.364773+0000 20'4 32:62 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-17T04:17:22.364483+0000 20'9 32:50 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-17T04:17:22.364910+0000 20'8 32:57 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:17:36.563 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:17:36.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:17:36.624 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:36.624 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:36.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.632 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:36.632 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:36.632 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.640 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:36.640 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:36.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:17:36.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301856646557530 2026-02-17T04:17:36.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:36.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:17:36.647 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:17:36.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:17:36.700 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:36.700 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:17:36.700 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:17:36.700 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:17:36.700 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:17:36.704 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:17:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:17:36.757 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:36.757 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:17:36.757 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:17:36.758 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:17:36.758 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:36.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:17:36.764 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:17:36.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:17:36.817 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:36.817 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:17:36.818 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:17:36.818 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:17:36.818 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:36.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:17:36.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:17:36.823 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:17:36.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:17:36.876 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:36.876 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:17:36.876 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:17:36.876 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:17:36.876 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:36.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:17:36.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:17:36.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:17:36.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:17:36.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:17:36.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:17:36.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:17:37.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:17:37.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:17:37.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301857047220400 2026-02-17T04:17:37.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=400 2026-02-17T04:17:37.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:17:37.102 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:37.102 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:37.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:37.110 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:37.110 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:37.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:37.118 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:37.118 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:37.118 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:37.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:17:39.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:17:22.364976+0000 20'11 32:55 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:17:02.896919+0000 0'0 2026-02-17T04:17:02.896919+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:17:02.896919+0000 0 0 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-17T04:17:37.169597+0000 20'4 32:71 [0,1,2] 0 [0,1,2] 0 20'4 2026-02-17T04:17:37.169566+0000 20'4 2026-02-17T04:17:37.169566+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:37.169566+0000 4 0 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean+inconsistent 2026-02-17T04:17:37.120263+0000 20'9 32:60 [2,0,1] 2 [2,0,1] 2 20'9 2026-02-17T04:17:37.120232+0000 20'9 2026-02-17T04:17:37.120232+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:37.120232+0000 9 0 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean+inconsistent 2026-02-17T04:17:36.757664+0000 20'8 32:67 [1,0,2] 1 [1,0,2] 1 20'8 2026-02-17T04:17:36.757619+0000 20'8 2026-02-17T04:17:36.757619+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:36.757619+0000 8 0 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:39.281 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:17:39.282 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:17:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2c 3 4 8 0 10 256 4194304 0 400 2026-02-17T04:17:39.288 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2c@ NAUT 3 4 8 0/ 10 256 4194304/ 0 400 2026-02-17T04:17:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:39.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:17:39.289 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:17:39.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:17:39.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:17:39.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:17:39.305 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:17:39.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:17:39.306 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:17:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:17:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:17:39.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:17:39.323 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:17:39.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:39.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:17:39.324 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:17:39.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:17:39.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:17:39.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:17:39.339 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:17:39.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:17:39.356 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:17:39.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:17:39.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:17:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:17:45.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:17:45.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:17:45.071 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:45.071 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.072 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.079 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:45.079 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.079 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.087 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:45.087 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.087 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:17:45.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301865093537238 2026-02-17T04:17:45.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:45.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:17:45.249 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:17:45.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:45.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:17:45.414 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-17T04:17:45.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:45.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:17:45.578 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:17:45.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:17:45.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:17:45.743 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:17:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:17:45.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:17:45.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:17:45.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301865918423241 2026-02-17T04:17:45.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=824 2026-02-17T04:17:45.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:17:45.972 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:17:45.972 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.972 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.980 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:17:45.980 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.980 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.988 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:17:45.988 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:17:45.988 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:45.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:17:50.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:17:51.150 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:17:51.150 INFO:tasks.workunit.client.0.trial090.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-17T04:17:46.617535+0000 20'11 32:87 [1,2,0] 1 [1,2,0] 1 20'11 2026-02-17T04:17:46.615445+0000 20'11 2026-02-17T04:17:46.615445+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:46.615445+0000 11 0 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-17T04:17:46.193785+0000 20'4 32:82 [0,1,2] 0 [0,1,2] 0 20'4 2026-02-17T04:17:46.193754+0000 20'4 2026-02-17T04:17:46.193754+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:46.193754+0000 4 0 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-17T04:17:46.174304+0000 20'9 32:89 [2,0,1] 2 [2,0,1] 2 20'9 2026-02-17T04:17:46.171001+0000 20'9 2026-02-17T04:17:46.171001+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:46.171001+0000 9 0 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-17T04:17:45.641925+0000 20'8 32:93 [1,0,2] 1 [1,0,2] 1 20'8 2026-02-17T04:17:45.639835+0000 20'8 2026-02-17T04:17:45.639835+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:17:45.639835+0000 8 0 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:17:51.151 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:17:51.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2c 3 4 8 0 10 256 4194304 0 824 2026-02-17T04:17:51.158 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_2c@ REPR 3 4 8 0/ 10 256 4194304/ 0 824 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0417 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:17:51.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.249 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.250 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 2, 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.251 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.252 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.253 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.254 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.255 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.256 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16384 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.257 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.258 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.001999970, 2026-02-17T04:17:51.259 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.000999985 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.260 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.261 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.262 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.263 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.264 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.265 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.266 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.267 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.268 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.269 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.270 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 2, 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.271 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.272 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.273 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.274 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16384 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.001999970, 2026-02-17T04:17:51.276 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.000999985 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.277 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.278 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.279 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.280 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.281 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.283 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:51.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.294 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 10, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.295 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.296 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16384 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.297 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.011999829, 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.002999957 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.298 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.299 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.300 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.301 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.302 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.303 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 10, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.304 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.305 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16384 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.011999829, 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.002999957 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.306 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.309 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 4, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.352 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.353 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 64 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16384 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.354 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.004999929, 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.002499964 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.355 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.356 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.357 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.358 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 4, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.359 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 64 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16384 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.361 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.004999929, 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.002499964 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.362 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:51.363 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.364 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.365 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:51.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:58.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:17:58.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:58.994 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:58.995 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:58.996 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 3, 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:58.997 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:58.998 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:58.999 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.000 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.001 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.002 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 24576 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.003 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.004 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.002999955, 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.000999985 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.005 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.006 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.007 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.008 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.009 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.010 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.011 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.012 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.013 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.014 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:59.015 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.016 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 3, 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.017 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.018 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.019 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.020 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "value": 24576 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.021 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.022 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.002999955, 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.000999985 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.024 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.025 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.026 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.027 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.028 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.029 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:59.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.041 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 15, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.042 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.043 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr: "value": 24576 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.044 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.017999743, 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.002999957 2026-02-17T04:17:59.045 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.046 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.047 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.048 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.049 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.050 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 15, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.051 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.052 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 24576 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.053 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.017999743, 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.002999957 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.054 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.055 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.056 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.057 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.058 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:59.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 6, 2026-02-17T04:17:59.100 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:17:59.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 96 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 24576 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.007999886, 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.002666628 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:17:59.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.107 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:17:59.108 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 96 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": 24576 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.007999886, 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.002666628 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:17:59.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.111 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:17:59.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:17:59.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-17T04:18:14.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-17T04:18:14.459 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:18:14.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-17T04:18:14.664 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 noscrub to 1 2026-02-17T04:18:14.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-17T04:18:14.869 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 nodeep-scrub to 1 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 2048 256 4 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=2048 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-17T04:18:14.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-17T04:18:14.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771301894878041347 2026-02-17T04:18:14.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-17T04:18:14.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-17T04:18:14.880 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T04:18:14.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.K5YLGK4ayS bs=256 count=1 2026-02-17T04:18:14.882 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:18:14.882 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 6.1554e-05 s, 4.2 MB/s 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:14.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:14.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:14.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj129 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj130 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj131 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj132 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj133 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj134 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj135 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj136 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj137 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj138 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj139 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj140 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj141 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj142 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj143 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj144 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj145 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj146 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj147 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj148 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj149 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj150 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj151 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj152 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj153 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj154 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj155 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj156 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj157 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj158 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj159 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj160 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj161 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj162 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj163 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj164 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj165 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj166 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj167 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj168 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj169 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj170 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj171 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj172 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj173 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj174 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj175 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj176 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj177 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj178 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj179 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj180 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj181 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj182 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj183 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj184 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj185 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj186 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj187 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj188 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj189 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj190 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj191 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj192 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj193 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj194 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj195 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj196 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj197 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj198 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj199 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj200 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj201 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj202 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj203 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj204 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj205 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj206 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj207 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj208 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj209 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj210 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj211 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj212 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj213 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj214 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj215 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj216 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj217 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj218 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj219 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj220 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj221 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj222 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj223 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj224 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj225 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj226 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj227 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj228 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj229 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj230 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj231 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:15.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj232 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj233 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj234 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj235 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj236 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj237 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj238 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj239 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj240 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj241 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj242 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj243 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj244 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj245 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj246 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj247 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj248 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj249 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj250 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj251 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj252 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj253 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj254 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj255 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj256 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj257 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj258 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj259 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj260 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj261 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj262 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj263 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj264 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj265 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj266 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj267 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj268 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj270 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj271 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj272 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj269 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj273 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj274 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj275 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj276 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj277 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj278 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj279 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj280 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj281 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj282 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj283 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj284 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj285 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj286 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj287 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj288 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj289 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj290 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj291 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj292 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj293 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj294 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj295 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj296 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj297 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj298 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj299 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj300 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj301 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj302 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj303 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj304 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj305 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj306 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj307 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj308 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj309 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj310 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj311 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj312 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj313 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj314 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj315 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj316 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj317 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj318 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj319 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj320 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj321 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj322 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj323 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj324 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj325 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj326 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj327 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj328 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj329 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj330 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj331 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj332 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj333 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj334 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj336 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj335 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj337 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj338 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj339 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj340 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj341 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj342 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj343 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj344 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj345 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj346 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj347 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj348 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj349 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj350 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj351 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj352 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj353 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj354 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj355 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj356 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj357 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj358 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj359 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj360 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj361 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj362 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj363 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj364 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj365 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj366 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj367 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj368 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj369 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj370 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj371 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj372 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj373 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj374 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj375 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj376 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj377 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj378 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj379 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj380 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj381 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj382 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj383 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj384 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj385 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj386 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj387 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj388 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj389 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj390 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj391 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj392 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj393 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj394 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj395 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj396 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj397 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj398 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj399 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj400 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj401 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj402 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj403 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj404 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj405 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj406 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj407 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj408 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj409 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj410 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj411 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj412 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj414 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj415 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj416 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj413 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj417 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj418 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj419 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj420 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj421 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj422 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj423 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj424 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj425 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj426 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj427 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj428 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj429 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj430 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj431 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj432 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj433 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj434 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj435 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj436 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj437 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj438 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj439 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj440 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj441 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj442 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj443 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj444 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj445 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj446 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj447 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj448 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj449 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj450 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj451 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj452 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj453 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj454 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj455 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj456 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj457 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj458 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj459 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj460 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj461 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj462 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj463 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj464 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj465 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj466 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj467 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj468 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj469 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj470 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj471 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj472 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj473 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj474 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj475 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj476 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj477 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj478 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj479 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj480 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj481 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj482 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj483 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj484 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj485 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj486 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj487 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj488 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj489 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj490 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj491 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj492 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj493 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj494 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj495 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj496 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj497 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj498 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj499 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj500 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj501 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj502 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj503 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj504 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj505 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj506 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj507 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj508 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj509 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj510 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj511 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj512 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj513 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj514 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj515 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj516 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj517 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj518 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj519 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj520 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj521 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj522 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj523 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj524 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj525 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj526 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj527 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj528 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj529 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj530 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj531 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj532 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj533 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj534 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj535 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj536 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj537 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj538 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj539 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj540 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj541 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj542 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj543 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj544 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj545 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj546 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj547 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj548 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj549 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj550 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj551 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj552 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj553 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj554 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj555 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj556 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj557 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj558 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj559 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj560 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj561 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj562 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj563 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj564 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj565 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj566 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj567 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj568 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj569 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj570 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj571 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj572 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj573 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj574 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj575 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj576 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj577 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj578 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj579 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj580 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj581 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj582 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj583 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj584 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj585 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj586 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj587 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj588 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj589 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj590 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj591 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj592 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj593 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj594 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj595 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj596 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj597 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj598 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj599 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj600 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj601 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj602 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj603 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj604 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj605 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj606 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj607 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj608 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj609 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj610 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj611 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj612 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj613 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj614 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj615 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj616 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj617 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj618 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj619 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj620 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj621 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj622 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj623 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj624 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj625 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj626 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj627 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj628 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj629 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj630 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj631 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj632 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj633 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj634 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj635 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj636 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj637 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj638 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj639 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj640 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj641 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj642 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj643 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj644 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj645 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj646 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj647 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj648 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj649 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj650 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj651 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:17.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj652 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj653 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj654 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj655 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj656 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj657 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj658 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj659 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj660 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj661 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj662 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj663 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj664 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj665 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj666 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj667 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj668 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj669 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj670 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj671 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj672 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj673 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj674 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj675 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj676 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj677 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj678 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj679 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj680 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj681 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj682 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj683 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj684 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj685 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj686 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj687 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj688 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj689 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj690 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj691 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj692 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj693 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj694 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj695 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj696 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj697 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj698 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj699 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj700 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj701 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj702 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj703 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj704 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj705 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj706 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj707 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj708 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj709 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj710 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj711 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj712 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj713 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj714 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj715 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj716 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj717 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj718 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj719 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj720 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj721 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj722 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj723 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj724 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj725 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj726 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj727 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj728 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj729 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj730 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj731 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj732 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj733 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj734 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj735 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj736 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj737 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj738 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj739 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj740 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj741 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj742 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj743 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj744 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj745 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj746 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj747 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj748 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj749 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj750 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj751 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj752 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj753 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj754 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj755 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj756 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj757 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj758 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj759 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj760 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj761 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj763 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj764 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj762 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj765 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj766 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj767 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj768 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj769 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj770 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj771 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj772 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj773 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj774 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj775 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj776 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj777 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj778 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj779 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj780 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj781 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj782 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj783 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj784 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj785 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj786 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj787 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj788 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj789 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj790 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj791 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj792 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj793 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj794 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj795 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj796 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj797 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj798 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj799 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj800 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj801 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj802 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj803 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj804 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj805 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj806 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj807 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj808 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj809 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj810 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj811 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj812 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj813 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj814 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj815 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj816 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj817 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj818 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj819 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj820 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj821 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj822 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj823 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj824 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj825 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj826 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj827 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj828 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj829 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj830 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj831 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj832 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj833 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj834 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj835 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj836 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj837 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj838 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj839 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj840 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj841 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj842 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj843 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj844 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj845 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj846 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj847 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj848 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj849 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj850 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj851 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj852 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj853 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj854 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj855 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj856 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj857 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj858 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj859 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:18.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj860 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj861 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj862 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj863 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj864 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj865 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj866 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj867 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj868 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj869 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj870 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj871 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj872 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj873 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj874 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj875 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj876 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj877 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj878 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj879 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj880 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj881 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj882 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj883 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj884 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj885 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj886 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj887 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj888 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj889 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj890 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj891 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj892 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj893 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj894 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj895 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj896 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj897 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj898 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj899 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj900 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj901 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj902 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj903 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj904 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj905 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj906 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj907 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj908 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj909 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj910 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj911 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj912 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj913 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj914 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj915 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj916 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj917 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj918 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj919 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj920 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj921 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj922 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj923 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj924 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj925 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj926 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj927 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj928 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj929 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj930 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj931 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj932 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj933 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj934 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj935 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj936 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj937 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj938 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj939 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj940 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj941 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj942 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj943 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj944 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj945 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj946 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj947 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj948 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj949 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj950 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj951 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj952 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj953 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj954 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj955 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj956 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj957 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj958 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj959 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj960 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj961 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj962 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj963 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj964 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj965 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj966 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj967 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj968 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj969 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj970 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj971 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj972 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj973 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj974 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj975 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj976 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj977 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj978 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj979 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj980 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj981 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj982 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj983 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj984 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj985 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj986 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj987 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj988 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj989 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj990 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj991 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj992 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj993 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj994 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj995 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj996 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj997 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj998 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj999 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1000 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1001 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1002 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1003 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1004 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1005 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1006 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1007 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1008 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1009 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1010 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1011 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1012 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1013 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1014 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1015 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1016 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1017 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1018 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1019 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1020 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1021 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1022 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1023 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1024 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1025 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1026 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1027 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1028 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1029 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1030 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1031 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1032 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1033 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1034 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1035 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1036 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1037 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1038 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1039 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1040 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1041 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1042 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1043 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1044 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1045 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1046 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1047 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1048 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1049 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1050 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1051 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1052 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1053 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1054 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1055 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1056 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1057 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1058 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1059 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1060 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1061 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1062 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1063 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1064 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1065 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1066 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1067 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:19.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1068 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1069 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1070 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1071 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1072 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1073 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1074 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1075 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1076 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1077 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1078 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1079 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1080 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1081 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1082 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1083 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1084 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1085 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1086 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1087 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1088 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1089 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1090 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1091 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1092 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1093 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1094 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1095 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1096 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1097 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1098 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1099 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1100 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1101 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1102 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1103 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1104 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1105 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1106 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1107 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1108 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1109 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1110 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1111 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1112 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1113 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1114 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1115 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1116 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1117 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1118 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1119 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1120 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1121 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1122 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1123 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1124 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1125 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1126 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1127 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1128 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1129 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1130 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1131 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1132 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1133 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1134 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1135 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1136 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1137 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1138 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1139 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1140 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1141 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1142 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1143 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1144 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1145 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1146 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1147 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1148 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1149 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1150 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1151 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1152 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1153 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1154 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1155 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1156 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1157 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1158 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1159 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1160 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1161 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1162 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1163 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1164 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1165 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1166 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1167 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1168 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1169 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1170 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1171 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1172 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1173 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1174 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1175 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1176 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1177 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1178 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1179 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1180 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1181 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1182 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1183 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1184 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1185 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1186 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1187 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1188 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1189 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1190 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1191 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1192 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1193 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1194 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1195 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1196 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1197 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1198 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1199 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1200 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1201 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1202 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1203 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1204 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1205 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1206 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1207 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1208 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1209 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1210 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1211 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1212 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1213 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1214 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1215 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1216 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1217 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1218 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1219 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1220 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1221 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1222 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1223 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1224 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1225 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1226 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1227 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1228 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1229 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1230 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1231 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1232 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1233 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1234 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1235 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1236 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1237 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1238 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1239 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1240 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1241 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1242 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1243 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1244 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1245 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1246 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1247 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1248 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1249 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1250 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1251 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1252 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1253 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1254 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1255 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1256 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1257 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1258 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1259 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1260 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1261 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1262 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1263 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1264 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1265 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1266 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1267 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1268 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1269 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1270 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1271 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:20.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:20.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1272 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1273 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1274 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1275 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1276 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1277 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1278 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1279 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1280 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1281 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1282 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1283 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1284 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1285 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1286 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1287 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1288 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1289 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1290 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1291 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1292 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1293 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1294 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1295 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1296 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1297 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1298 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1299 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1300 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1301 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1302 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1303 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1304 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1305 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1306 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1307 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1308 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1309 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1310 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1311 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1312 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1313 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1314 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1315 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1316 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1317 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1318 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1319 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1320 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1321 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1322 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1323 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1324 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1325 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1326 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1327 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1328 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1329 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1330 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1331 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1332 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1333 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1334 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1335 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1336 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1337 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1338 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1339 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1340 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1341 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1342 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1343 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1344 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1345 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1346 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1347 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1348 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1349 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1350 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1351 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1352 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1353 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1354 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1355 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1356 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1357 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1358 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1359 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1360 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1361 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1362 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1363 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1364 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1365 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1366 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1367 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1368 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1369 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1370 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1371 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1372 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1373 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1374 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1375 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1376 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1377 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1378 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1379 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1380 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1381 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1382 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1383 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1384 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1385 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1386 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1387 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1388 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1389 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1390 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1391 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1392 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1393 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1394 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1395 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1396 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1397 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1398 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1399 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1400 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1401 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1402 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1403 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1404 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1405 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1406 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1407 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1408 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1409 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1410 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1411 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1412 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1413 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1414 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1415 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1416 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1417 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1418 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1419 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1420 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1421 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1422 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1423 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1424 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1425 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1426 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1427 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1428 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1429 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1430 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1431 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1432 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1434 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1435 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1436 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1433 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1437 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1438 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1439 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1440 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1441 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1442 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1443 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1444 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1445 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1446 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1447 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1448 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1449 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1450 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1451 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1452 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1453 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1454 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1455 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1456 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1457 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1458 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1459 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1460 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1461 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1462 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1463 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1464 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1465 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1466 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1467 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1468 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1469 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1470 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1471 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1472 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1473 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1474 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1475 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1476 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1477 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1478 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:21.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:21.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1479 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:21.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:21.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:21.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1480 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1481 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1482 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1483 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1484 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1485 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1486 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1487 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1488 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1489 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1490 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1491 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1492 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1493 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1494 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1495 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1496 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1497 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1498 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1499 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1500 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1501 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1502 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1503 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1504 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1505 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1506 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1507 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1508 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1509 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1510 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1511 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1512 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1513 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1514 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1515 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1516 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1517 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1518 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1519 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1520 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1521 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1522 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1523 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1524 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1525 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1526 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1527 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1528 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1529 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1530 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1531 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1532 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1533 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1534 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1535 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1536 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1537 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1539 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1540 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1538 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1541 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1542 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1543 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1544 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1545 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1546 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1547 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1548 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1549 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1550 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1551 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1552 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1553 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1554 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1555 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1556 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1557 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1558 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1559 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1560 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1561 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1562 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1563 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1564 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1565 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1566 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1567 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1568 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1569 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1570 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1571 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1572 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1573 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1574 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1575 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1576 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1577 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1578 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1579 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1580 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1581 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1582 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1583 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1584 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1585 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1586 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1587 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1588 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1589 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1590 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1591 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1592 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1593 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1594 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1595 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1596 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1597 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1598 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1599 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1600 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1601 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1602 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1603 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1604 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1605 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1606 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1607 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1608 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1609 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1610 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1611 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1612 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1613 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1614 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1615 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1616 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1617 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1618 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1619 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1620 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1621 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1622 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1623 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1624 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1625 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1626 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1627 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1628 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1629 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1630 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1631 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1632 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1633 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1634 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1635 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1636 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1637 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1638 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1639 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1640 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1641 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1642 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1643 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1644 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1645 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1646 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1647 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1648 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1649 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1650 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1651 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1652 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1653 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1654 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1655 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1656 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1657 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1658 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1659 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1660 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1661 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1662 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1663 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1664 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1665 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1666 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1667 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1668 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1669 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1670 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1671 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1672 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1673 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1674 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1675 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1676 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1677 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1678 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1679 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1680 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1681 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1682 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1683 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1684 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1685 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1686 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1687 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:22.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1688 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1689 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1690 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1691 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1692 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1693 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1694 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1695 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1696 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1697 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1698 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1699 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1700 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1701 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1702 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1703 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1704 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1705 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1706 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1707 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1708 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1709 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1710 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1711 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1712 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1713 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1714 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1715 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1716 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1717 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1718 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1719 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1720 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1721 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1722 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1723 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1724 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1725 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1726 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1727 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1728 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1729 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1730 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1731 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1732 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1733 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1734 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1735 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1736 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1737 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1738 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1739 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1740 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1741 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1742 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1743 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1744 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1745 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1746 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1747 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1748 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1749 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1750 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1751 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1752 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1753 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1754 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1755 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1756 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1757 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1758 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1759 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1760 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1761 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1762 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1763 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1764 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1765 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1766 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1767 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1768 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1769 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1770 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1771 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1772 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1773 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1774 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1775 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1776 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1777 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1778 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1779 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1780 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1781 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1782 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1783 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1784 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1785 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1786 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1787 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1788 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1789 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1790 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1791 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1792 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1793 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1794 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1795 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1796 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1797 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1798 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1799 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1800 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1801 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1802 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1803 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1804 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1805 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1806 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1807 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1808 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1809 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1810 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1811 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1812 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1813 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1814 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1815 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1816 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1817 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1818 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1819 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1820 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1821 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1822 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1823 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1824 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1825 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1826 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1827 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1828 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1829 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1830 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1831 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1832 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1833 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1834 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1835 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1836 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1837 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1838 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1839 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1840 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1841 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1842 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1843 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1844 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1845 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1846 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1847 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1848 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1849 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1850 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1851 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1852 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1853 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1854 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1855 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1856 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1857 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1858 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1859 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1860 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1861 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1862 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1863 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1864 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1865 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1866 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1867 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1868 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1869 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1870 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1871 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1872 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1873 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1874 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1875 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1876 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1877 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1878 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1879 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1880 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1881 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1882 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1883 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1884 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1885 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1886 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1887 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1888 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1889 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1890 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1891 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1892 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1893 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1894 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1895 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:23.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1896 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1897 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1898 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1899 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1900 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1901 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1902 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1903 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1904 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1905 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1906 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1907 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1908 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1909 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1910 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1911 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1912 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1913 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1914 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1915 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1916 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1917 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1918 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1919 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1920 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1921 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1922 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1924 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1923 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1925 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1926 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1927 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1928 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1929 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1930 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1931 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1932 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1933 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1934 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1935 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1936 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1937 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1938 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1939 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1940 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1941 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1942 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1943 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1944 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1945 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1946 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1947 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1948 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1949 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1950 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1951 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1952 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1953 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1954 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1955 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1956 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1957 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1958 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1959 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1960 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1961 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1962 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1963 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1964 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1965 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1966 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1967 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1968 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1969 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1970 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1971 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1972 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1973 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1974 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1975 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1976 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1977 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1978 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1979 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1980 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1981 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1982 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1983 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1984 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1985 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1986 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1987 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1988 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1989 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1990 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1991 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1992 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1993 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1994 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1995 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1996 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1997 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1998 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1999 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2000 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2001 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2002 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2003 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2004 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2005 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2006 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2007 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2008 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2009 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2010 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2011 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2012 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2013 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2014 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2015 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2016 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2017 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2018 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2019 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2020 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2021 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2022 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2023 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2024 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2025 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2026 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2027 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2028 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2029 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2030 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2031 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2032 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2033 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2034 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2035 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2036 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2037 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2038 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2039 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2040 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2041 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2042 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2043 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2044 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2045 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2046 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2047 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-17T04:18:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2048 /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-17T04:18:24.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-17T04:18:24.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-17T04:18:24.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.K5YLGK4ayS 2026-02-17T04:18:24.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-17T04:18:24.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771301904735334795 2026-02-17T04:18:24.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=9857 2026-02-17T04:18:24.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 2048 objects in pool test in 9857 ms' 2026-02-17T04:18:24.736 INFO:tasks.workunit.client.0.trial090.stdout:create_objects(): created 2048 objects in pool test in 9857 ms 2026-02-17T04:18:24.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-17T04:18:24.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 04:18:24.737156637' 2026-02-17T04:18:24.737 INFO:tasks.workunit.client.0.trial090.stdout:Pre-wait-forclean: 04:18:24.737156637 2026-02-17T04:18:24.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:18:24.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:18:24.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:18:24.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:18:24.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:18:24.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:18:25.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-17T04:18:25.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-17T04:18:25.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T04:18:25.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:18:25.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:18:25.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705688 2026-02-17T04:18:25.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705688 2026-02-17T04:18:25.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688' 2026-02-17T04:18:25.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:18:25.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:18:25.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574870 2026-02-17T04:18:25.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574870 2026-02-17T04:18:25.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688 2-55834574870' 2026-02-17T04:18:25.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:18:25.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:18:25.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411348 2026-02-17T04:18:25.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411348 2026-02-17T04:18:25.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688 2-55834574870 3-77309411348' 2026-02-17T04:18:25.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:18:25.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836506 2026-02-17T04:18:25.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:18:25.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:18:25.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-17T04:18:25.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:18:25.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-17T04:18:25.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T04:18:25.231 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836506 2026-02-17T04:18:25.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:18:25.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836506 2026-02-17T04:18:25.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:18:26.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:18:26.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:18:26.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-17T04:18:26.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:18:26.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705688 2026-02-17T04:18:26.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:18:26.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:18:26.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705688 2026-02-17T04:18:26.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:18:26.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705688 2026-02-17T04:18:26.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705688' 2026-02-17T04:18:26.568 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705688 2026-02-17T04:18:26.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:18:26.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705688 -lt 38654705688 2026-02-17T04:18:26.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:18:26.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574870 2026-02-17T04:18:26.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:18:26.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:18:26.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574870 2026-02-17T04:18:26.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:18:26.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574870 2026-02-17T04:18:26.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-17T04:18:26.738 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574870 2026-02-17T04:18:26.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:18:26.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574870 -lt 55834574870 2026-02-17T04:18:26.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:18:26.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411348 2026-02-17T04:18:26.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:18:26.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:18:26.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411348 2026-02-17T04:18:26.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:18:26.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411348 2026-02-17T04:18:26.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411348' 2026-02-17T04:18:26.912 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 77309411348 2026-02-17T04:18:26.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:18:27.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411348 -lt 77309411348 2026-02-17T04:18:27.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:18:27.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:18:27.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:18:27.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-17T04:18:27.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:18:27.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:18:27.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-17T04:18:27.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:18:27.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:18:27.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:18:27.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-17T04:18:27.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:18:27.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:18:27.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-17T04:18:27.840 INFO:tasks.workunit.client.0.trial090.stdout:pool test id 1 2026-02-17T04:18:27.840 INFO:tasks.workunit.client.0.trial090.stdout: client io 170 KiB/s wr, 0 op/s rd, 169 op/s wr 2026-02-17T04:18:27.840 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:18:27.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-17T04:18:27.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-17T04:18:32.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:18:33.007 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:18:08.287894+0000 23'122 23:141 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-17T04:18:08.288245+0000 23'131 23:150 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-17T04:18:08.286990+0000 23'128 23:149 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:18:08.288739+0000 23'133 23:157 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:18:08.287923+0000 23'133 23:156 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-17T04:18:08.288240+0000 23'136 23:155 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-17T04:18:08.287189+0000 23'126 23:148 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:18:08.288599+0000 23'119 23:140 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:18:08.288408+0000 23'127 23:148 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.008 INFO:tasks.workunit.client.0.trial090.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:18:08.286006+0000 23'127 23:149 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-17T04:18:08.287844+0000 23'134 23:154 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:18:08.288730+0000 23'129 23:149 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-17T04:18:08.288137+0000 23'113 23:133 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-17T04:18:08.288618+0000 23'121 23:140 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-17T04:18:08.288321+0000 23'132 23:151 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:18:08.288694+0000 23'137 23:156 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:18:33.009 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:18:33.010 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:18:33.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:18:33.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:18:33.015 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:18:33.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:18:33.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:18:33.072 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:18:33.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:18:33.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:18:33.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-17T04:18:33.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-17T04:18:33.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 04:18:33.131262695' 2026-02-17T04:18:33.131 INFO:tasks.workunit.client.0.trial090.stdout:Pre dict creation: 04:18:33.131262695 2026-02-17T04:18:33.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771301913132551778 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 2048 obj_to_pgid obj_to_primary obj_to_acting 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=2048 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-17T04:18:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-17T04:19:05.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-17T04:19:05.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771301945492373736 2026-02-17T04:19:05.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-17T04:19:05.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 04:19:05.493625389 (32359 ms)' 2026-02-17T04:19:05.494 INFO:tasks.workunit.client.0.trial090.stdout:Post dict creation: 04:19:05.493625389 (32359 ms) 2026-02-17T04:19:05.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=50 2026-02-17T04:19:05.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-17T04:19:05.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 50 2026-02-17T04:19:05.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj475 obj291 obj474 obj290 obj477 obj293 obj476 obj292 obj769 obj471 obj295 obj768 obj470 obj294 obj598 obj473 obj297 obj599 obj472 obj296 obj765 obj596 obj299 obj764 obj597 obj298 obj767 obj594 obj766 obj595 obj761 obj592 obj479 obj760 obj593 obj478 obj763 obj590 obj762 obj591 obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj1696 obj1263 obj1697 obj1262 obj1694 obj1261 obj1695 obj1260 obj1692 obj1267 obj1693 obj1266 obj1690 obj1265 obj1691 obj1264 obj1269 obj1268 obj1698 obj1699 obj1199 obj1198 obj1191 obj1190 obj1193 obj1192 obj1195 obj1194 obj1197 obj1196 obj1498 obj646 obj233 obj1499 obj647 obj232 obj644 obj231 obj645 obj230 obj642 obj318 obj237 obj643 obj319 obj236 obj640 obj235 obj641 obj234 obj1490 obj314 obj1491 obj315 obj1492 obj316 obj239 obj1493 obj317 obj238 obj1494 obj310 obj1495 obj311 obj1496 obj648 obj312 obj1497 obj649 obj313 obj819 obj818 obj817 obj816 obj815 obj814 obj813 obj812 obj811 obj810 obj615 obj426 obj242 obj614 obj427 obj243 obj617 obj424 obj240 obj616 obj425 obj241 obj611 obj422 obj246 obj610 obj423 obj247 obj738 obj613 obj569 obj420 obj244 obj739 obj612 obj568 obj421 obj245 obj736 obj567 obj737 obj566 obj734 obj565 obj248 obj735 obj564 obj249 obj732 obj619 obj563 obj733 obj618 obj562 obj730 obj561 obj428 obj731 obj560 obj429 obj2046 obj1537 obj192 obj2047 obj1536 obj193 obj2044 obj1535 obj190 obj2045 obj1534 obj191 obj2042 obj1533 obj196 obj2043 obj1532 obj197 obj2040 obj1531 obj194 obj2041 obj1530 obj195 obj198 obj199 obj2048 obj1539 obj1538 obj1906 obj1322 obj1111 obj790 obj1907 obj1323 obj1110 obj791 obj1904 obj1320 obj1113 obj1038 obj792 obj1905 obj1321 obj1112 obj1039 obj793 obj1902 obj1326 obj1115 obj794 obj1903 obj1327 obj1114 obj795 obj1900 obj1618 obj1324 obj1117 obj796 obj1901 obj1619 obj1325 obj1116 obj797 obj1616 obj1119 obj1032 obj798 obj1617 obj1118 obj1033 obj799 obj1614 obj1328 obj1030 obj1615 obj1329 obj1031 obj1612 obj1036 obj1613 obj1037 obj1908 obj1610 obj1034 obj1909 obj1611 obj1035 obj2015 obj1429 obj949 obj840 obj141 obj97 obj2014 obj1428 obj948 obj841 obj140 obj96 obj2017 obj842 obj143 obj95 obj2016 obj843 obj142 obj94 obj2011 obj1818 obj844 obj145 obj93 obj2010 obj1819 obj845 obj144 obj92 obj2013 obj846 obj147 obj91 obj2012 obj847 obj146 obj90 obj1814 obj1421 obj941 obj848 obj149 obj1815 obj1420 obj940 obj849 obj148 obj1816 obj1423 obj943 obj1817 obj1422 obj942 obj2019 obj1810 obj1425 obj945 obj2018 obj1811 obj1424 obj944 obj1812 obj1427 obj947 obj99 obj1813 obj1426 obj946 obj98 obj1955 obj1744 obj530 obj1954 obj1745 obj531 obj1957 obj1746 obj1298 obj532 obj1956 obj1747 obj1299 obj533 obj1951 obj1740 obj1649 obj534 obj1950 obj1741 obj1648 obj535 obj1953 obj1742 obj536 obj1952 obj1743 obj537 obj1645 obj1292 obj538 obj1644 obj1293 obj539 obj1647 obj1290 obj1646 obj1291 obj1959 obj1748 obj1641 obj1296 obj1958 obj1749 obj1640 obj1297 obj1643 obj1294 obj1642 obj1295 obj1098 obj699 obj1099 obj698 obj1094 obj695 obj1095 obj694 obj1096 obj697 obj1097 obj696 obj1090 obj691 obj1091 obj690 obj1092 obj693 obj1093 obj692 obj1568 obj79 obj1569 obj78 obj1560 obj71 obj1561 obj70 obj1562 obj73 obj1563 obj72 obj1564 obj75 obj1565 obj74 obj1566 obj77 obj1567 obj76 obj1353 obj1352 obj1351 obj1049 obj1350 obj1048 obj1357 obj1238 obj1356 obj1239 obj1355 obj1354 obj1234 obj1043 obj1235 obj1042 obj1359 obj1236 obj1041 obj1358 obj1237 obj1040 obj1230 obj1047 obj1231 obj1046 obj1232 obj1045 obj1233 obj1044 obj1894 obj718 obj509 obj400 obj325 obj1895 obj719 obj508 obj401 obj324 obj1896 obj402 obj327 obj1897 obj403 obj326 obj1890 obj1779 obj404 obj321 obj1891 obj1778 obj405 obj320 obj1988 obj1892 obj406 obj323 obj1989 obj1893 obj407 obj322 obj1986 obj1775 obj710 obj501 obj408 obj1987 obj1774 obj711 obj500 obj409 obj1984 obj1777 obj712 obj503 obj1985 obj1776 obj713 obj502 obj1982 obj1898 obj1771 obj714 obj505 obj329 obj1983 obj1899 obj1770 obj715 obj504 obj328 obj1980 obj1773 obj716 obj507 obj1981 obj1772 obj717 obj506 obj268 obj269 obj639 obj638 obj637 obj264 obj636 obj265 obj635 obj266 obj634 obj267 obj633 obj260 obj632 obj261 obj631 obj262 obj630 obj263 obj747 obj394 obj746 obj395 obj745 obj396 obj744 obj397 obj743 obj390 obj742 obj391 obj741 obj392 obj740 obj393 obj398 obj399 obj749 obj748 obj897 obj896 obj895 obj894 obj893 obj892 obj891 obj459 obj890 obj458 obj457 obj456 obj455 obj454 obj453 obj452 obj899 obj451 obj898 obj450 obj1876 obj1403 obj963 obj1877 obj1402 obj962 obj1874 obj1401 obj1139 obj961 obj1875 obj1400 obj1138 obj960 obj1872 obj1407 obj1308 obj967 obj1873 obj1406 obj1309 obj966 obj1870 obj1405 obj965 obj1871 obj1404 obj964 obj1304 obj1133 obj1305 obj1132 obj1409 obj1306 obj1131 obj969 obj1408 obj1307 obj1130 obj968 obj1300 obj1137 obj1301 obj1136 obj1878 obj1302 obj1135 obj1879 obj1303 obj1134 obj1667 obj1666 obj1665 obj169 obj1664 obj168 obj1663 obj1662 obj2039 obj1661 obj2038 obj1660 obj2037 obj163 obj2036 obj162 obj2035 obj161 obj2034 obj160 obj2033 obj167 obj2032 obj166 obj2031 obj1669 obj165 obj2030 obj1668 obj164 obj1825 obj1472 obj912 obj660 obj376 obj1824 obj1473 obj913 obj661 obj377 obj1827 obj1470 obj1148 obj910 obj662 obj374 obj1826 obj1471 obj1149 obj911 obj663 obj375 obj1821 obj1476 obj916 obj664 obj372 obj1820 obj1477 obj917 obj665 obj373 obj1979 obj1823 obj1728 obj1474 obj914 obj666 obj370 obj1978 obj1822 obj1729 obj1475 obj915 obj667 obj371 obj1977 obj1726 obj1142 obj668 obj1976 obj1727 obj1143 obj669 obj1975 obj1724 obj1478 obj1140 obj918 obj1974 obj1725 obj1479 obj1141 obj919 obj1973 obj1829 obj1722 obj1146 obj1972 obj1828 obj1723 obj1147 obj1971 obj1720 obj1144 obj378 obj1970 obj1721 obj1145 obj379 obj879 obj878 obj118 obj119 obj871 obj112 obj870 obj113 obj873 obj110 obj872 obj111 obj875 obj116 obj874 obj117 obj877 obj114 obj876 obj115 obj1582 obj53 obj1583 obj52 obj1580 obj51 obj1581 obj50 obj1586 obj57 obj1587 obj56 obj1584 obj55 obj1585 obj54 obj1588 obj59 obj1589 obj58 obj1780 obj1689 obj1256 obj1781 obj1688 obj1257 obj1782 obj1254 obj1783 obj1255 obj1784 obj1252 obj1785 obj1253 obj1786 obj1250 obj1787 obj1251 obj1788 obj1681 obj1789 obj1680 obj1683 obj1682 obj1685 obj1684 obj1687 obj1258 obj1686 obj1259 obj1551 obj22 obj1550 obj23 obj1553 obj20 obj1552 obj21 obj1555 obj26 obj1554 obj27 obj1557 obj24 obj1556 obj25 obj1559 obj1558 obj28 obj29 obj1920 obj1638 obj1205 obj1014 obj1921 obj1639 obj1204 obj1015 obj1922 obj1207 obj1016 obj1923 obj1206 obj1017 obj1924 obj1201 obj1010 obj1925 obj1200 obj1011 obj1926 obj1203 obj1012 obj1927 obj1202 obj1013 obj1928 obj1630 obj1929 obj1631 obj1632 obj1633 obj1634 obj1209 obj1018 obj1635 obj1208 obj1019 obj1636 obj1637 obj721 obj552 obj720 obj553 obj723 obj550 obj722 obj551 obj725 obj556 obj724 obj557 obj727 obj554 obj726 obj555 obj729 obj728 obj558 obj559 obj439 obj255 obj438 obj254 obj998 obj257 obj999 obj256 obj251 obj250 obj253 obj252 obj992 obj431 obj993 obj430 obj990 obj433 obj991 obj432 obj996 obj435 obj259 obj997 obj434 obj258 obj994 obj437 obj995 obj436 obj581 obj580 obj583 obj582 obj585 obj584 obj587 obj586 obj589 obj588 obj488 obj489 obj480 obj481 obj482 obj483 obj484 obj485 obj486 obj487 obj1919 obj1708 obj1335 obj1164 obj783 obj350 obj1918 obj1709 obj1334 obj1165 obj782 obj351 obj1337 obj1166 obj781 obj352 obj1336 obj1167 obj780 obj353 obj1331 obj1160 obj1029 obj787 obj354 obj1330 obj1161 obj1028 obj786 obj355 obj1333 obj1162 obj785 obj356 obj1332 obj1163 obj784 obj357 obj1911 obj1700 obj1025 obj358 obj1910 obj1701 obj1024 obj359 obj1913 obj1702 obj1027 obj789 obj1912 obj1703 obj1026 obj788 obj1915 obj1704 obj1339 obj1168 obj1021 obj1914 obj1705 obj1338 obj1169 obj1020 obj1917 obj1706 obj1023 obj1916 obj1707 obj1022 obj853 obj134 obj852 obj135 obj851 obj136 obj850 obj137 obj1458 obj938 obj857 obj130 obj1459 obj939 obj856 obj131 obj1809 obj855 obj132 obj1808 obj854 obj133 obj1807 obj1454 obj934 obj1806 obj1455 obj935 obj1805 obj1456 obj936 obj859 obj1804 obj1457 obj937 obj858 obj1803 obj1450 obj930 obj138 obj1802 obj1451 obj931 obj139 obj1801 obj1452 obj932 obj1800 obj1453 obj933 obj1757 obj1384 obj523 obj1756 obj1385 obj522 obj1755 obj1386 obj521 obj1754 obj1387 obj520 obj1753 obj1380 obj1289 obj527 obj1752 obj1381 obj1288 obj526 obj1751 obj1382 obj525 obj1750 obj1383 obj524 obj1285 obj1284 obj1287 obj529 obj1286 obj528 obj1388 obj1281 obj1389 obj1280 obj1759 obj1283 obj1758 obj1282 obj822 obj659 obj206 obj823 obj658 obj207 obj1489 obj820 obj204 obj1488 obj821 obj205 obj826 obj202 obj827 obj203 obj824 obj309 obj200 obj825 obj308 obj201 obj1483 obj651 obj307 obj1482 obj650 obj306 obj1481 obj828 obj653 obj305 obj1480 obj829 obj652 obj304 obj1487 obj655 obj303 obj1486 obj654 obj302 obj1485 obj657 obj301 obj208 obj1484 obj656 obj300 obj209 obj1186 obj1187 obj1184 obj1185 obj1182 obj1183 obj1180 obj1089 obj1181 obj1088 obj1087 obj1086 obj1085 obj1084 obj1083 obj1082 obj1188 obj1081 obj1189 obj1080 obj1579 obj1578 obj1573 obj1572 obj1571 obj1570 obj1577 obj1576 obj1575 obj1574 obj1850 obj1366 obj1851 obj1367 obj1852 obj1364 obj1853 obj1365 obj1854 obj1362 obj1855 obj1363 obj1856 obj1360 obj1229 obj1078 obj1857 obj1361 obj1228 obj1079 obj1858 obj1227 obj1076 obj1859 obj1226 obj1077 obj1225 obj1074 obj1224 obj1075 obj1223 obj1072 obj1222 obj1073 obj1368 obj1221 obj1070 obj1369 obj1220 obj1071 obj1601 obj185 obj1600 obj184 obj1603 obj1508 obj187 obj1602 obj1509 obj186 obj1605 obj181 obj1604 obj180 obj1607 obj183 obj1606 obj182 obj1609 obj1502 obj1608 obj1503 obj1500 obj1501 obj1506 obj189 obj1507 obj188 obj1504 obj1505 obj279 obj278 obj277 obj276 obj275 obj274 obj273 obj272 obj271 obj270 obj462 obj387 obj463 obj386 obj778 obj460 obj385 obj779 obj461 obj384 obj466 obj383 obj467 obj382 obj464 obj381 obj465 obj380 obj772 obj773 obj770 obj468 obj771 obj469 obj776 obj777 obj774 obj389 obj775 obj388 obj288 obj289 obj286 obj287 obj284 obj285 obj282 obj283 obj280 obj281 obj1270 obj1271 obj1272 obj1273 obj1274 obj1275 obj1276 obj1277 obj1278 obj1279 obj1942 obj1731 obj1943 obj1730 obj1940 obj1733 obj1658 obj1941 obj1732 obj1659 obj1946 obj1735 obj1947 obj1734 obj1944 obj1737 obj158 obj1945 obj1736 obj159 obj1739 obj1652 obj156 obj1738 obj1653 obj157 obj1948 obj1650 obj154 obj1949 obj1651 obj155 obj1656 obj152 obj1657 obj153 obj1654 obj150 obj1655 obj151 obj1465 obj905 obj673 obj369 obj220 obj1464 obj904 obj672 obj368 obj221 obj1467 obj907 obj671 obj222 obj1466 obj906 obj670 obj223 obj1461 obj1159 obj901 obj677 obj224 obj1460 obj1158 obj900 obj676 obj225 obj1463 obj903 obj675 obj226 obj1462 obj902 obj674 obj227 obj1155 obj361 obj228 obj1154 obj360 obj229 obj1157 obj679 obj363 obj1156 obj678 obj362 obj1469 obj1151 obj909 obj365 obj1468 obj1150 obj908 obj364 obj1153 obj367 obj1152 obj366 obj1991 obj1990 obj1993 obj1992 obj1995 obj808 obj109 obj1994 obj809 obj108 obj1997 obj1996 obj1999 obj804 obj105 obj1998 obj805 obj104 obj806 obj107 obj807 obj106 obj800 obj101 obj801 obj100 obj802 obj103 obj803 obj102 obj1887 obj602 obj413 obj1886 obj603 obj412 obj1885 obj709 obj600 obj411 obj1884 obj708 obj601 obj410 obj1883 obj606 obj578 obj417 obj1882 obj607 obj579 obj416 obj1881 obj604 obj415 obj1880 obj605 obj414 obj703 obj574 obj702 obj575 obj701 obj608 obj576 obj419 obj700 obj609 obj577 obj418 obj707 obj570 obj706 obj571 obj1889 obj705 obj572 obj1888 obj704 obj573 obj1793 obj1340 obj1249 obj1058 obj1792 obj1341 obj1248 obj1059 obj1791 obj1342 obj1790 obj1343 obj1797 obj1344 obj1796 obj1345 obj1795 obj1346 obj1794 obj1347 obj1348 obj1241 obj1050 obj1349 obj1240 obj1051 obj1799 obj1243 obj1052 obj1798 obj1242 obj1053 obj1245 obj1054 obj1244 obj1055 obj1247 obj1056 obj1246 obj1057 obj1524 obj35 obj1525 obj34 obj1526 obj37 obj1527 obj36 obj1520 obj31 obj1521 obj30 obj1522 obj33 obj1523 obj32 obj1528 obj39 obj1529 obj38 obj1933 obj1007 obj1932 obj1006 obj1931 obj1629 obj1005 obj1930 obj1628 obj1004 obj1937 obj1003 obj1936 obj1002 obj1935 obj1001 obj1934 obj1000 obj1623 obj1622 obj1939 obj1621 obj1938 obj1620 obj1627 obj1626 obj1625 obj1009 obj1624 obj1008 obj2002 obj1869 obj1436 obj956 obj84 obj2003 obj1868 obj1437 obj957 obj85 obj2000 obj1434 obj954 obj86 obj2001 obj1435 obj955 obj87 obj2006 obj1432 obj952 obj80 obj2007 obj1433 obj953 obj81 obj2004 obj1430 obj1319 obj1108 obj950 obj82 obj2005 obj1431 obj1318 obj1109 obj951 obj83 obj1861 obj1317 obj1106 obj1860 obj1316 obj1107 obj2008 obj1863 obj1315 obj1104 obj2009 obj1862 obj1314 obj1105 obj1865 obj1313 obj1102 obj88 obj1864 obj1312 obj1103 obj89 obj1867 obj1438 obj1311 obj1100 obj958 obj1866 obj1439 obj1310 obj1101 obj959 obj884 obj885 obj886 obj887 obj989 obj880 obj448 obj988 obj881 obj449 obj882 obj883 obj985 obj444 obj984 obj445 obj987 obj446 obj986 obj447 obj981 obj888 obj440 obj980 obj889 obj441 obj983 obj442 obj982 obj443 obj4 obj5 obj688 obj499 obj6 obj689 obj498 obj7 obj1 obj2 obj3 obj682 obj493 obj683 obj492 obj680 obj491 obj681 obj490 obj686 obj497 obj8 obj687 obj496 obj9 obj684 obj495 obj685 obj494 obj1595 obj66 obj1594 obj67 obj1597 obj64 obj1596 obj65 obj1591 obj62 obj1590 obj63 obj1593 obj60 obj1592 obj61 obj1599 obj1598 obj68 obj69 obj866 obj127 obj867 obj126 obj864 obj125 obj865 obj124 obj862 obj123 obj863 obj122 obj1449 obj929 obj860 obj121 obj1448 obj928 obj861 obj120 obj1447 obj927 obj1446 obj926 obj1445 obj925 obj1444 obj924 obj1443 obj923 obj1442 obj922 obj1441 obj921 obj868 obj129 obj1440 obj920 obj869 obj128 obj1397 obj516 obj332 obj1396 obj517 obj333 obj1768 obj1395 obj514 obj330 obj1769 obj1394 obj515 obj331 obj1393 obj512 obj336 obj1392 obj513 obj337 obj1391 obj510 obj334 obj1390 obj511 obj335 obj1762 obj1763 obj1760 obj338 obj1761 obj339 obj1766 obj1767 obj1764 obj1399 obj518 obj1765 obj1398 obj519 obj835 obj219 obj834 obj218 obj837 obj836 obj831 obj628 obj830 obj629 obj833 obj832 obj624 obj211 obj625 obj210 obj626 obj213 obj627 obj212 obj839 obj620 obj215 obj838 obj621 obj214 obj622 obj217 obj623 obj216 obj754 obj545 obj755 obj544 obj756 obj547 obj757 obj546 obj750 obj541 obj751 obj540 obj752 obj543 obj753 obj542 obj758 obj549 obj759 obj548 obj1212 obj1061 obj1213 obj1060 obj1210 obj1063 obj1211 obj1062 obj1216 obj1065 obj1217 obj1064 obj1548 obj1214 obj1067 obj19 obj1549 obj1215 obj1066 obj18 obj1546 obj1069 obj17 obj1547 obj1068 obj16 obj1544 obj1218 obj15 obj1545 obj1219 obj14 obj1542 obj13 obj1543 obj12 obj1540 obj11 obj1541 obj10 obj1843 obj1410 obj1379 obj1128 obj970 obj1842 obj1411 obj1378 obj1129 obj971 obj1841 obj1412 obj972 obj1840 obj1413 obj973 obj1847 obj1414 obj974 obj1846 obj1415 obj975 obj1845 obj1416 obj976 obj1844 obj1417 obj977 obj1418 obj1371 obj1120 obj978 obj1419 obj1370 obj1121 obj979 obj1849 obj1373 obj1122 obj1848 obj1372 obj1123 obj1375 obj1124 obj1374 obj1125 obj1377 obj1126 obj1376 obj1127 obj1674 obj178 obj1675 obj179 obj1676 obj1677 obj2028 obj1670 obj1519 obj2029 obj1671 obj1518 obj1672 obj1673 obj2024 obj1515 obj170 obj2025 obj1514 obj171 obj2026 obj1517 obj172 obj2027 obj1516 obj173 obj2020 obj1678 obj1511 obj174 obj2021 obj1679 obj1510 obj175 obj2022 obj1513 obj176 obj2023 obj1512 obj177 obj1832 obj1177 obj343 obj1833 obj1176 obj342 obj1830 obj1719 obj1175 obj341 obj1831 obj1718 obj1174 obj340 obj1968 obj1836 obj1173 obj347 obj1969 obj1837 obj1172 obj346 obj1834 obj1171 obj345 obj1835 obj1170 obj344 obj1964 obj1713 obj1965 obj1712 obj1966 obj1838 obj1711 obj349 obj1967 obj1839 obj1710 obj348 obj1960 obj1717 obj1961 obj1716 obj1962 obj1715 obj1179 obj1963 obj1714 obj1178 2026-02-17T04:19:05.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 50' 2026-02-17T04:19:05.498 INFO:tasks.workunit.client.0.trial090.stdout:Selected keys: 50 2026-02-17T04:19:05.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.498 INFO:tasks.workunit.client.0.trial090.stdout:First element: obj1623 2026-02-17T04:19:05.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj1623' 2026-02-17T04:19:05.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.499 INFO:tasks.workunit.client.0.trial090.stdout:obj_to_primary: 2048 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 2048' 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.501 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1623 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1623' 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1623 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1623 ' 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.503 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj38 2026-02-17T04:19:05.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj38' 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj38 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj38 ' 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1037' 2026-02-17T04:19:05.504 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1037 2026-02-17T04:19:05.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1037 2026-02-17T04:19:05.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1037 ' 2026-02-17T04:19:05.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.506 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1270 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1270' 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1270 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1270 ' 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.508 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1104 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1104' 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1104 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1104 ' 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.509 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj715 2026-02-17T04:19:05.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj715' 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj715 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj715 ' 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj170' 2026-02-17T04:19:05.511 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj170 2026-02-17T04:19:05.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj170 2026-02-17T04:19:05.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj170 ' 2026-02-17T04:19:05.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.513 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj417 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj417' 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj417 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj417 ' 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.515 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj121 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj121' 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj121 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj121 ' 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.517 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1881 2026-02-17T04:19:05.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1881' 2026-02-17T04:19:05.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1881 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1881 ' 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.518 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj511 2026-02-17T04:19:05.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj511' 2026-02-17T04:19:05.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj511 2026-02-17T04:19:05.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj511 ' 2026-02-17T04:19:05.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.520 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj977 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj977' 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj977 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj977 ' 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.522 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1796 2026-02-17T04:19:05.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1796' 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1796 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1796 ' 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1604' 2026-02-17T04:19:05.523 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1604 2026-02-17T04:19:05.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1604 2026-02-17T04:19:05.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1604 ' 2026-02-17T04:19:05.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.525 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj577 2026-02-17T04:19:05.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj577' 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj577 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj577 ' 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.526 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1480 2026-02-17T04:19:05.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1480' 2026-02-17T04:19:05.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1480 2026-02-17T04:19:05.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1480 ' 2026-02-17T04:19:05.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.528 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj566 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj566' 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj566 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj566 ' 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.530 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj994 2026-02-17T04:19:05.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj994' 2026-02-17T04:19:05.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj994 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj994 ' 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.531 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj562 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj562' 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj562 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj562 ' 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj228' 2026-02-17T04:19:05.533 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj228 2026-02-17T04:19:05.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj228 2026-02-17T04:19:05.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj228 ' 2026-02-17T04:19:05.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.534 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1584 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1584' 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1584 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1584 ' 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.535 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj71 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj71' 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj71 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj71 ' 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1940' 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1940 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1940 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1940 ' 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.538 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj235 2026-02-17T04:19:05.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj235' 2026-02-17T04:19:05.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj235 2026-02-17T04:19:05.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj235 ' 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1798' 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1798 2026-02-17T04:19:05.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1798 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1798 ' 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.540 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1292 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1292' 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1292 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1292 ' 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.541 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj784 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj784' 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj784 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj784 ' 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1061' 2026-02-17T04:19:05.542 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1061 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1061 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1061 ' 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1868' 2026-02-17T04:19:05.543 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1868 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1868 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1868 ' 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.544 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj811 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj811' 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj811 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj811 ' 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1893' 2026-02-17T04:19:05.545 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1893 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1893 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1893 ' 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.546 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj590 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj590' 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj590 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj590 ' 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.547 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj899 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj899' 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj899 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj899 ' 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1200' 2026-02-17T04:19:05.548 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1200 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1200 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1200 ' 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.549 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1325 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1325' 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1325 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1325 ' 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj653 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj653' 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj653 2026-02-17T04:19:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj653 ' 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj1867 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1867' 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1867 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1867 ' 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj180' 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj180 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj180 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj180 ' 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.552 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj700 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj700' 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj700 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj700 ' 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.553 INFO:tasks.workunit.client.0.trial090.stdout:Corrupting primary object (td/osd-scrub-dump) obj2047 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj2047' 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj2047 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj2047 ' 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=40 )) 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1429 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.554 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1429: acting: 1 2 0 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1429: acting: 1 2 0' 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1429 (40) 2 0 1' 2026-02-17T04:19:05.555 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj1429 (40) 2 0 1 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj1429' 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj1429 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1429 ' 2026-02-17T04:19:05.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1921 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1921: acting: 3 0 1 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1921: acting: 3 0 1' 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '3 0 1' 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.557 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 3 for obj1921 (41) 0 1 3' 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stdout:r----- 3 for obj1921 (41) 0 1 3 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj1921' 2026-02-17T04:19:05.558 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj1921 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1921 ' 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj108 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj108: acting: 0 1 3' 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stdout:Object obj108: acting: 0 1 3 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 3' 2026-02-17T04:19:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj108 (42) 1 3 0' 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stdout:r----- 0 for obj108 (42) 1 3 0 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj108' 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj108 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj108 ' 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1543 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1543: acting: 1 3 2 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1543: acting: 1 3 2' 2026-02-17T04:19:05.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 3 2' 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1543 (43) 3 2 1' 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj1543 (43) 3 2 1 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:19:05.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj1543 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj1543' 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1543 ' 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj420 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stdout:Object obj420: acting: 2 3 0 2026-02-17T04:19:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj420: acting: 2 3 0' 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 3 0' 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj420 (44) 3 0 2' 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stdout:r----- 2 for obj420 (44) 3 0 2 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=3 2026-02-17T04:19:05.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stdout:replosd 3 for obj420 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 3 for obj420' 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj420 ' 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj105 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stdout:Object obj105: acting: 1 3 2 2026-02-17T04:19:05.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj105: acting: 1 3 2' 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 3 2' 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj105 (45) 3 2 1' 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj105 (45) 3 2 1 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj105' 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stdout:replosd 2 for obj105 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj105 ' 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1578 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1578: acting: 1 3 0' 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1578: acting: 1 3 0 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 3 0' 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1578 (46) 3 0 1' 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stdout:r----- 1 for obj1578 (46) 3 0 1 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=3 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.568 INFO:tasks.workunit.client.0.trial090.stdout:replosd 3 for obj1578 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 3 for obj1578' 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1578 ' 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1878 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1878: acting: 3 0 1' 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1878: acting: 3 0 1 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '3 0 1' 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.569 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 3 for obj1878 (47) 0 1 3' 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stdout:r----- 3 for obj1878 (47) 0 1 3 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.570 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj1878 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj1878' 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1878 ' 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1994 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stdout:Object obj1994: acting: 3 0 1 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1994: acting: 3 0 1' 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '3 0 1' 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 3 for obj1994 (48) 0 1 3' 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stdout:r----- 3 for obj1994 (48) 0 1 3 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stdout:replosd 0 for obj1994 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj1994' 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1994 ' 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj654 2026-02-17T04:19:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stdout:Object obj654: acting: 3 0 1 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj654: acting: 3 0 1' 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '3 0 1' 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 3 for obj654 (49) 0 1 3' 2026-02-17T04:19:05.573 INFO:tasks.workunit.client.0.trial090.stdout:r----- 3 for obj654 (49) 0 1 3 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stdout:replosd 1 for obj654 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj654' 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj654 ' 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:19:05.574 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:05.576 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:05.576 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:19:05.576 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:05.584 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:05.584 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:19:05.584 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:05.592 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:05.592 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-17T04:19:05.592 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:05.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-17T04:19:05.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:19:05.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:19:05.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:19:05.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:19:05.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:19:05.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:19:05.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-17T04:19:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:19:06.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:19:06.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj38 obj784 obj1200 obj2047 ' 2026-02-17T04:19:06.911 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj38 obj784 obj1200 obj2047 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:19:06.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj38 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:19:06.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj38 2026-02-17T04:19:06.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj38 rm-attr _ 2026-02-17T04:19:07.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj784 2026-02-17T04:19:07.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:19:07.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj784 2026-02-17T04:19:07.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj784 rm-attr _ 2026-02-17T04:19:07.152 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:19:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:19:07.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:19:07.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj1200 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:19:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1200 2026-02-17T04:19:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj1200 rm-attr _ 2026-02-17T04:19:07.294 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:43ae5336:::obj784:head#, (61) No data available 2026-02-17T04:19:07.294 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj2047 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2047 2026-02-17T04:19:07.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj2047 rm-attr _ 2026-02-17T04:19:07.430 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:43ae5336:::obj784:head#, (61) No data available 2026-02-17T04:19:07.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4bb258c3:::obj1200:head#, (61) No data available 2026-02-17T04:19:07.431 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:19:07.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:07.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj1994 ' obj_to_pgid delete_oi 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1994 ' 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1994 ]] 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:19:07.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj1994 ' 2026-02-17T04:19:07.474 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.0: obj1994 2026-02-17T04:19:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj1994 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-17T04:19:07.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1994 2026-02-17T04:19:07.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj1994 rm-attr _ 2026-02-17T04:19:07.574 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:43ae5336:::obj784:head#, (61) No data available 2026-02-17T04:19:07.574 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4bb258c3:::obj1200:head#, (61) No data available 2026-02-17T04:19:07.574 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-17T04:19:07.574 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4f5500e8:::obj2047:head#, (61) No data available 2026-02-17T04:19:07.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:07.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:19:07.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:19:07.614 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj715 obj170 obj417 obj1796 obj566 obj228 obj1584 obj235 obj1292 obj899 obj1325 obj653 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj715 obj170 obj417 obj1796 obj566 obj228 obj1584 obj235 obj1292 obj899 obj1325 obj653 ' 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.b 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.b ]] 2026-02-17T04:19:07.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj715 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj715 2026-02-17T04:19:07.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj715 rm-attr _ 2026-02-17T04:19:07.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-17T04:19:07.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-17T04:19:07.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj170 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj170 2026-02-17T04:19:07.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj170 rm-attr _ 2026-02-17T04:19:07.874 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:07.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj417 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj417 2026-02-17T04:19:07.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj417 rm-attr _ 2026-02-17T04:19:08.010 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.011 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.8 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.8 ]] 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1796 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1796 2026-02-17T04:19:08.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1796 rm-attr _ 2026-02-17T04:19:08.150 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.150 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.153 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.e 2026-02-17T04:19:08.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.e ]] 2026-02-17T04:19:08.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj566 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj566 2026-02-17T04:19:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj566 rm-attr _ 2026-02-17T04:19:08.284 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.284 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.285 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.287 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj228 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj228 2026-02-17T04:19:08.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj228 rm-attr _ 2026-02-17T04:19:08.416 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.417 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.417 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.418 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:08.419 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1584 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1584 2026-02-17T04:19:08.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1584 rm-attr _ 2026-02-17T04:19:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:08.549 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.550 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.550 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:08.551 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj235 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj235 2026-02-17T04:19:08.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj235 rm-attr _ 2026-02-17T04:19:08.688 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.688 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:08.688 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.688 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:08.688 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.689 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:08.690 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-17T04:19:08.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1292 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1292 2026-02-17T04:19:08.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1292 rm-attr _ 2026-02-17T04:19:08.820 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:08.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:08.821 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.822 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:08.823 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:08.823 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:08.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj899 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj899 2026-02-17T04:19:08.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj899 rm-attr _ 2026-02-17T04:19:08.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:08.959 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:08.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:08.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:08.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:08.960 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:08.961 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:08.962 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:08.962 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.b 2026-02-17T04:19:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.b ]] 2026-02-17T04:19:09.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1325 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1325 2026-02-17T04:19:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1325 rm-attr _ 2026-02-17T04:19:09.094 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.095 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.096 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.097 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-17T04:19:09.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-17T04:19:09.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj653 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj653 2026-02-17T04:19:09.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj653 rm-attr _ 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:dee5bdd1:::obj1325:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.234 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.235 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.235 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.236 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.236 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj1921 obj108 obj1878 obj654 ' obj_to_pgid delete_oi 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1921 obj108 obj1878 obj654 ' 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:19:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1921 obj108 obj1878 obj654 ]] 2026-02-17T04:19:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:19:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj1921 obj108 obj1878 obj654 ' 2026-02-17T04:19:09.284 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.1: obj1921 obj108 obj1878 obj654 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1921 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1921 2026-02-17T04:19:09.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1921 rm-attr _ 2026-02-17T04:19:09.382 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.382 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:dee5bdd1:::obj1325:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.383 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.385 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.385 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.385 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0c20735d:::obj653:head#, (61) No data available 2026-02-17T04:19:09.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-17T04:19:09.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-17T04:19:09.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj108 2026-02-17T04:19:09.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj108 2026-02-17T04:19:09.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj108 rm-attr _ 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:dee5bdd1:::obj1325:head#, (61) No data available 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.518 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3bacc04f:::obj1921:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.519 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0c20735d:::obj653:head#, (61) No data available 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:09.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:09.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1878 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1878 2026-02-17T04:19:09.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1878 rm-attr _ 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:dee5bdd1:::obj1325:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.662 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3bacc04f:::obj1921:head#, (61) No data available 2026-02-17T04:19:09.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.663 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.664 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-17T04:19:09.664 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0c20735d:::obj653:head#, (61) No data available 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj654 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj654 2026-02-17T04:19:09.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj654 rm-attr _ 2026-02-17T04:19:09.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:d4c61911:::obj715:head#, (61) No data available 2026-02-17T04:19:09.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.b_head,#1:dee5bdd1:::obj1325:head#, (61) No data available 2026-02-17T04:19:09.795 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9455f78c:::obj228:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:99944c24:::obj170:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.9_head,#1:9df0e57c:::obj1584:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:58e9d9f4:::obj899:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5adc0c1a:::obj1292:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.8_head,#1:1295173d:::obj1796:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:7c406887:::obj566:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3bacc04f:::obj1921:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-17T04:19:09.796 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.7_head,#1:e9ac1484:::obj417:head#, (61) No data available 2026-02-17T04:19:09.798 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:23ce092b:::obj1878:head#, (61) No data available 2026-02-17T04:19:09.798 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-17T04:19:09.798 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:0c20735d:::obj653:head#, (61) No data available 2026-02-17T04:19:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:19:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:19:09.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj1623 obj577 obj562 obj811 obj700 ' 2026-02-17T04:19:09.839 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj1623 obj577 obj562 obj811 obj700 2026-02-17T04:19:09.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1623 2026-02-17T04:19:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1623 2026-02-17T04:19:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1623 rm-attr _ 2026-02-17T04:19:09.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:09.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:09.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:09.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:09.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:09.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:09.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj577 2026-02-17T04:19:09.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:09.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:09.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj577 2026-02-17T04:19:09.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj577 rm-attr _ 2026-02-17T04:19:10.090 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:19:10.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:19:10.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj562 2026-02-17T04:19:10.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj562 2026-02-17T04:19:10.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj562 rm-attr _ 2026-02-17T04:19:10.226 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.227 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-17T04:19:10.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-17T04:19:10.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj811 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj811 2026-02-17T04:19:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj811 rm-attr _ 2026-02-17T04:19:10.362 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.363 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.363 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a601bbe9:::obj562:head#, (61) No data available 2026-02-17T04:19:10.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:19:10.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:19:10.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj700 2026-02-17T04:19:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj700 2026-02-17T04:19:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj700 rm-attr _ 2026-02-17T04:19:10.497 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.497 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:be67e789:::obj811:head#, (61) No data available 2026-02-17T04:19:10.497 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.497 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a601bbe9:::obj562:head#, (61) No data available 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj1429 obj1543 obj105 ' obj_to_pgid delete_oi 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1429 obj1543 obj105 ' 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1429 obj1543 obj105 ]] 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:19:10.542 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.2: obj1429 obj1543 obj105 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj1429 obj1543 obj105 ' 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1429 2026-02-17T04:19:10.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1429 2026-02-17T04:19:10.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1429 rm-attr _ 2026-02-17T04:19:10.641 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.641 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:be67e789:::obj811:head#, (61) No data available 2026-02-17T04:19:10.642 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.642 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a601bbe9:::obj562:head#, (61) No data available 2026-02-17T04:19:10.642 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:adf6adb0:::obj700:head#, (61) No data available 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.e 2026-02-17T04:19:10.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.e ]] 2026-02-17T04:19:10.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1543 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1543 2026-02-17T04:19:10.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1543 rm-attr _ 2026-02-17T04:19:10.773 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5953ae81:::obj1429:head#, (61) No data available 2026-02-17T04:19:10.774 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.775 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:be67e789:::obj811:head#, (61) No data available 2026-02-17T04:19:10.776 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.776 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a601bbe9:::obj562:head#, (61) No data available 2026-02-17T04:19:10.776 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:adf6adb0:::obj700:head#, (61) No data available 2026-02-17T04:19:10.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.e 2026-02-17T04:19:10.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.e ]] 2026-02-17T04:19:10.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj105 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj105 2026-02-17T04:19:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj105 rm-attr _ 2026-02-17T04:19:10.919 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.a_head,#1:5953ae81:::obj1429:head#, (61) No data available 2026-02-17T04:19:10.919 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:b69fc5dd:::obj1623:head#, (61) No data available 2026-02-17T04:19:10.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.d_head,#1:be67e789:::obj811:head#, (61) No data available 2026-02-17T04:19:10.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a2bd80aa:::obj577:head#, (61) No data available 2026-02-17T04:19:10.920 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a601bbe9:::obj562:head#, (61) No data available 2026-02-17T04:19:10.921 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:adf6adb0:::obj700:head#, (61) No data available 2026-02-17T04:19:10.921 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.e_head,#1:79657af2:::obj1543:head#, (61) No data available 2026-02-17T04:19:10.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:10.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:10.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:10.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:19:10.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-17T04:19:10.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.3: obj1037 obj1270 obj1104 obj121 obj1881 obj511 obj977 obj1604 obj1480 obj994 obj71 obj1940 obj1798 obj1061 obj1868 obj1893 obj590 obj1867 obj180 ' 2026-02-17T04:19:10.969 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.3: obj1037 obj1270 obj1104 obj121 obj1881 obj511 obj977 obj1604 obj1480 obj994 obj71 obj1940 obj1798 obj1061 obj1868 obj1893 obj590 obj1867 obj180 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:10.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1037 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1037 2026-02-17T04:19:10.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1037 rm-attr _ 2026-02-17T04:19:11.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:19:11.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:19:11.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1270 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1270 2026-02-17T04:19:11.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1270 rm-attr _ 2026-02-17T04:19:11.212 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:19:11.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:19:11.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1104 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1104 2026-02-17T04:19:11.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1104 rm-attr _ 2026-02-17T04:19:11.342 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:11.344 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-17T04:19:11.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-17T04:19:11.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj121 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj121 2026-02-17T04:19:11.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj121 rm-attr _ 2026-02-17T04:19:11.474 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:11.474 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:11.476 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:19:11.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:19:11.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1881 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1881 2026-02-17T04:19:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1881 rm-attr _ 2026-02-17T04:19:11.622 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:11.622 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:11.623 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:11.624 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:11.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:11.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj511 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj511 2026-02-17T04:19:11.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj511 rm-attr _ 2026-02-17T04:19:11.765 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:11.765 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:11.766 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:11.767 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.767 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-17T04:19:11.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-17T04:19:11.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj977 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj977 2026-02-17T04:19:11.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj977 rm-attr _ 2026-02-17T04:19:11.894 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:11.896 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:11.896 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:11.897 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:11.898 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:11.899 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:11.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:11.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:11.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1604 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1604 2026-02-17T04:19:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1604 rm-attr _ 2026-02-17T04:19:12.033 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.035 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.036 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.037 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.037 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.038 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.038 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-17T04:19:12.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-17T04:19:12.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1480 2026-02-17T04:19:12.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1480 2026-02-17T04:19:12.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1480 rm-attr _ 2026-02-17T04:19:12.180 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.180 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.182 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.183 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.184 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.184 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:19:12.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:19:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj994 2026-02-17T04:19:12.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj994 2026-02-17T04:19:12.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj994 rm-attr _ 2026-02-17T04:19:12.325 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.325 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.327 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.328 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.328 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.328 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:12.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.329 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-17T04:19:12.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-17T04:19:12.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj71 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj71 2026-02-17T04:19:12.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj71 rm-attr _ 2026-02-17T04:19:12.461 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.461 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.464 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:12.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.465 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:12.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:12.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1940 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1940 2026-02-17T04:19:12.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1940 rm-attr _ 2026-02-17T04:19:12.599 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.599 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.601 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.602 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:12.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.603 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:12.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:12.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1798 2026-02-17T04:19:12.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1798 2026-02-17T04:19:12.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1798 rm-attr _ 2026-02-17T04:19:12.748 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.749 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.751 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.751 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:12.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:12.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.752 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:12.753 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:12.753 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.754 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:12.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:12.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1061 2026-02-17T04:19:12.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1061 2026-02-17T04:19:12.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1061 rm-attr _ 2026-02-17T04:19:12.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:12.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:12.885 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:12.885 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:12.885 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:12.886 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:12.886 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:12.886 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:12.886 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:12.887 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:12.887 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:12.887 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:12.888 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-17T04:19:12.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:12.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1868 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1868 2026-02-17T04:19:12.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1868 rm-attr _ 2026-02-17T04:19:13.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.020 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.022 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.022 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.022 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.022 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.023 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.023 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.023 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.024 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.024 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.024 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.025 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1893 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1893 2026-02-17T04:19:13.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1893 rm-attr _ 2026-02-17T04:19:13.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.168 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.169 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.169 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.170 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.171 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.172 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-17T04:19:13.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-17T04:19:13.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj590 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj590 2026-02-17T04:19:13.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj590 rm-attr _ 2026-02-17T04:19:13.302 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.303 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.303 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.306 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f6ca8c35:::obj1893:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.307 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.308 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-17T04:19:13.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-17T04:19:13.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1867 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1867 2026-02-17T04:19:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1867 rm-attr _ 2026-02-17T04:19:13.441 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.442 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.442 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.446 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.446 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f6ca8c35:::obj1893:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.447 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8f4c4fa9:::obj590:head#, (61) No data available 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-17T04:19:13.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-17T04:19:13.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj180 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj180 2026-02-17T04:19:13.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj180 rm-attr _ 2026-02-17T04:19:13.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.586 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.587 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3eead42d:::obj1867:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f6ca8c35:::obj1893:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.591 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.592 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.592 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.592 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.592 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.592 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8f4c4fa9:::obj590:head#, (61) No data available 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 3 'obj420 obj1578 ' obj_to_pgid delete_oi 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=3 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj420 obj1578 ' 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj420 obj1578 ]] 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.3: obj420 obj1578 ' 2026-02-17T04:19:13.636 INFO:tasks.workunit.client.0.trial090.stdout:Objects to modify on osd.3: obj420 obj1578 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj420 2026-02-17T04:19:13.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj420 2026-02-17T04:19:13.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj420 rm-attr _ 2026-02-17T04:19:13.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3eead42d:::obj1867:head#, (61) No data available 2026-02-17T04:19:13.739 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.739 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.740 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f6ca8c35:::obj1893:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fb333d49:::obj180:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.741 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.742 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.742 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.742 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8f4c4fa9:::obj590:head#, (61) No data available 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-17T04:19:13.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-17T04:19:13.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-17T04:19:13.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1578 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1578 2026-02-17T04:19:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1578 rm-attr _ 2026-02-17T04:19:13.876 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:31bdbc4b:::obj1604:head#, (61) No data available 2026-02-17T04:19:13.876 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:353c3910:::obj1061:head#, (61) No data available 2026-02-17T04:19:13.876 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3b0aa4c9:::obj511:head#, (61) No data available 2026-02-17T04:19:13.876 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.c_head,#1:3eead42d:::obj1867:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:60e88c50:::obj1104:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:64b337fe:::obj71:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:66c02c79:::obj994:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.6_head,#1:6b3175e1:::obj1270:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.5_head,#1:a6b27c5f:::obj420:head#, (61) No data available 2026-02-17T04:19:13.881 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f2f9dd5a:::obj121:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:f6ca8c35:::obj1893:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fb333d49:::obj180:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fda2788d:::obj977:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.f_head,#1:fe4073fb:::obj1480:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2752c318:::obj1868:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2851d730:::obj1940:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:294a6dbb:::obj1798:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.4_head,#1:2e3ae8cd:::obj1037:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:82ea294a:::obj1881:head#, (61) No data available 2026-02-17T04:19:13.882 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.1_head,#1:8f4c4fa9:::obj590:head#, (61) No data available 2026-02-17T04:19:13.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-17T04:19:13.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-17T04:19:13.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-17T04:19:13.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-17T04:19:13.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-17T04:19:26.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-17T04:19:31.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:19:19.164286+0000 23'122 42:155 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-17T04:19:19.164230+0000 23'131 42:186 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-17T04:19:19.163576+0000 23'128 42:174 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:17.710446+0000 23'133 42:206 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:19.164199+0000 23'133 42:172 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-17T04:19:19.164419+0000 23'136 42:170 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.671 INFO:tasks.workunit.client.0.trial090.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-17T04:19:19.163988+0000 23'126 42:201 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:19:17.710915+0000 23'119 42:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:19.164210+0000 23'127 42:163 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:19.163798+0000 23'127 42:175 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-17T04:19:19.164247+0000 23'134 42:169 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:19:19.164652+0000 23'129 42:185 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-17T04:19:19.164238+0000 23'113 42:171 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-17T04:19:19.164747+0000 23'121 42:178 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-17T04:19:17.710819+0000 23'132 42:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:19:17.710336+0000 23'137 42:187 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:19:31.672 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:19:31.673 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:19:31.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:31.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-17T04:19:31.680 INFO:tasks.workunit.client.0.trial090.stdout:Getting actual osd_deep_scrub_stride: 2026-02-17T04:19:31.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-17T04:19:31.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-17T04:19:31.737 INFO:tasks.workunit.client.0.trial090.stdout:4194304 2026-02-17T04:19:31.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-17T04:19:31.792 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:31.793 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:19:31.793 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:31.801 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:31.801 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:19:31.801 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:31.808 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:31.809 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:19:31.809 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:31.816 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:31.816 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:19:31.816 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:31.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-17T04:19:32.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-17T04:19:32.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771301972824715338 2026-02-17T04:19:32.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-17T04:19:32.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 04:19:32.826602000' 2026-02-17T04:19:32.827 INFO:tasks.workunit.client.0.trial090.stdout:Pre standard dict creation: 04:19:32.826602000 2026-02-17T04:19:32.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-17T04:19:32.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:19:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:19:32.987 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:19:33.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-17T04:19:33.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771301973000520802 2026-02-17T04:19:33.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-17T04:19:33.002 INFO:tasks.workunit.client.0.trial090.stdout:Post standard dict creation: 04:19:33.001683270 (175 ms) 2026-02-17T04:19:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 04:19:33.001683270 (175 ms)' 2026-02-17T04:19:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.002 INFO:tasks.workunit.client.0.trial090.stdout:PGs table: 2026-02-17T04:19:33.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.8: 1 ( 1 2 3 ) 1 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.8: 1 ( 1 2 3 ) 1' 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.003 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.9: 1 ( 1 3 2 ) 1 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.9: 1 ( 1 3 2 ) 1' 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 3 ( 3 0 1 ) 1' 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.4: 3 ( 3 0 1 ) 1 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.5: 2 ( 2 3 0 ) 1 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 3 0 ) 1' 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 3 ( 3 0 2 ) 1' 2026-02-17T04:19:33.005 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.6: 3 ( 3 0 2 ) 1 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 3 0 ) 1' 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.7: 1 ( 1 3 0 ) 1 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.006 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.1: 3 ( 3 0 2 ) 1 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 3 ( 3 0 2 ) 1' 2026-02-17T04:19:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.2: 0 ( 0 1 3 ) 1 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 3 ) 1' 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-17T04:19:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.d: 2 ( 2 1 3 ) 1 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.d: 2 ( 2 1 3 ) 1' 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.e: 1 ( 1 3 2 ) 1' 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.e: 1 ( 1 3 2 ) 1 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.f: 3 ( 3 0 2 ) 1 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.f: 3 ( 3 0 2 ) 1' 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.a: 1 ( 1 2 0 ) 1 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.a: 1 ( 1 2 0 ) 1' 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.b: 1 ( 1 0 2 ) 1 2026-02-17T04:19:33.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.b: 1 ( 1 0 2 ) 1' 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.c: 3 ( 3 0 1 ) 1' 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stdout:Got: 1.c: 3 ( 3 0 1 ) 1 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:19:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:19:33.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:19:33.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:19:33.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:19:33.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:19:33.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:19:33.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:19:33.324 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:19:19.164286+0000 23'122 42:155 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-17T04:19:19.164230+0000 23'131 42:186 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-17T04:19:19.163576+0000 23'128 42:174 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:17.710446+0000 23'133 42:206 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:19.164199+0000 23'133 42:172 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-17T04:19:19.164419+0000 23'136 42:170 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-17T04:19:19.163988+0000 23'126 42:201 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:19:17.710915+0000 23'119 42:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:19.164210+0000 23'127 42:163 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.325 INFO:tasks.workunit.client.0.trial090.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:19.163798+0000 23'127 42:175 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-17T04:19:19.164247+0000 23'134 42:169 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:19:19.164652+0000 23'129 42:185 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-17T04:19:19.164238+0000 23'113 42:171 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-17T04:19:19.164747+0000 23'121 42:178 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-17T04:19:17.710819+0000 23'132 42:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:19:17.710336+0000 23'137 42:187 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:19:33.326 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:19:33.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:19:33.387 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:33.387 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:33.387 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.395 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:33.395 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:33.395 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.403 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:33.403 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:33.403 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.410 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:33.410 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:33.410 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-17T04:19:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771301973416934817 2026-02-17T04:19:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.8' 2026-02-17T04:19:33.418 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.8 2026-02-17T04:19:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.8 deep-scrub 2026-02-17T04:19:33.471 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.472 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.472 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.472 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.472 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.9' 2026-02-17T04:19:33.477 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.9 2026-02-17T04:19:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.9 deep-scrub 2026-02-17T04:19:33.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.529 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.529 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.530 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-17T04:19:33.534 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.4 2026-02-17T04:19:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-17T04:19:33.586 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.586 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.586 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.586 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.586 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.590 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.5 2026-02-17T04:19:33.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-17T04:19:33.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-17T04:19:33.643 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.643 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.643 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.643 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.643 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.647 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.6 2026-02-17T04:19:33.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-17T04:19:33.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-17T04:19:33.701 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.701 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.701 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.701 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.701 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.707 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.7 2026-02-17T04:19:33.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-17T04:19:33.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-17T04:19:33.759 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.759 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.759 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.760 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.760 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-17T04:19:33.764 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.0 2026-02-17T04:19:33.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-17T04:19:33.817 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.817 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.817 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.818 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.818 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-17T04:19:33.822 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.1 2026-02-17T04:19:33.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-17T04:19:33.876 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.876 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.876 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.877 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.877 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-17T04:19:33.881 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.2 2026-02-17T04:19:33.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-17T04:19:33.934 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.934 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.935 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.935 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.935 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-17T04:19:33.939 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.3 2026-02-17T04:19:33.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-17T04:19:33.992 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:33.992 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:33.992 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:33.992 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:33.992 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:33.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:33.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:33.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.d' 2026-02-17T04:19:33.996 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.d 2026-02-17T04:19:33.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.d deep-scrub 2026-02-17T04:19:34.047 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.047 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.048 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.048 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.048 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:34.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:34.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.e' 2026-02-17T04:19:34.052 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.e 2026-02-17T04:19:34.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.e deep-scrub 2026-02-17T04:19:34.104 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.104 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.104 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.104 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.104 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:34.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:34.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.f' 2026-02-17T04:19:34.108 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.f 2026-02-17T04:19:34.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.f deep-scrub 2026-02-17T04:19:34.162 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.162 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.162 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.162 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.163 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:34.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:34.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.a' 2026-02-17T04:19:34.167 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.a 2026-02-17T04:19:34.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.a deep-scrub 2026-02-17T04:19:34.219 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.219 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.219 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.219 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.219 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:34.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:34.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.b' 2026-02-17T04:19:34.223 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.b 2026-02-17T04:19:34.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.b deep-scrub 2026-02-17T04:19:34.277 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.278 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.278 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.278 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:34.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-17T04:19:34.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.c' 2026-02-17T04:19:34.282 INFO:tasks.workunit.client.0.trial090.stdout:deep-scrub 1.c 2026-02-17T04:19:34.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.c deep-scrub 2026-02-17T04:19:34.336 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:34.336 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:19:34.336 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:19:34.336 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:19:34.336 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:19:34.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:19:34.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:19:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:19:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:19:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:19:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:19:34.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:19:34.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-17T04:19:34.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771301974508600078 2026-02-17T04:19:34.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=1091 2026-02-17T04:19:34.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:19:34.562 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:34.563 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:34.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.570 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:34.570 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:34.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.578 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:34.578 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:34.578 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.585 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:34.585 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:34.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:34.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-17T04:19:36.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:19:36.749 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:19:36.749 INFO:tasks.workunit.client.0.trial090.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:19:19.164286+0000 23'122 42:155 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:36.749 INFO:tasks.workunit.client.0.trial090.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-17T04:19:19.164230+0000 23'131 42:187 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:36.749 INFO:tasks.workunit.client.0.trial090.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean+inconsistent 2026-02-17T04:19:35.386766+0000 23'128 42:207 [2,1,3] 2 [2,1,3] 2 23'128 2026-02-17T04:19:35.386737+0000 23'128 2026-02-17T04:19:35.386737+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:35.386737+0000 128 0 2026-02-17T04:19:36.749 INFO:tasks.workunit.client.0.trial090.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:17.710446+0000 23'133 42:208 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:19.164199+0000 23'133 42:174 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-17T04:19:19.164419+0000 23'136 42:171 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean+inconsistent 2026-02-17T04:19:34.360784+0000 23'126 42:236 [0,1,3] 0 [0,1,3] 0 23'126 2026-02-17T04:19:34.360752+0000 23'126 2026-02-17T04:19:34.360752+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:34.360752+0000 126 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:19:17.710915+0000 23'119 42:173 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean+inconsistent 2026-02-17T04:19:33.877553+0000 23'127 42:197 [3,0,1] 3 [3,0,1] 3 23'127 2026-02-17T04:19:33.877519+0000 23'127 2026-02-17T04:19:33.877519+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:33.877519+0000 127 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean+inconsistent 2026-02-17T04:19:34.354977+0000 23'127 42:208 [2,3,0] 2 [2,3,0] 2 23'127 2026-02-17T04:19:34.354942+0000 23'127 2026-02-17T04:19:34.354942+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:34.354942+0000 127 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean+inconsistent 2026-02-17T04:19:34.928891+0000 23'134 42:204 [3,0,2] 3 [3,0,2] 3 23'134 2026-02-17T04:19:34.928857+0000 23'134 2026-02-17T04:19:34.928857+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:34.928857+0000 134 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:19:19.164652+0000 23'129 42:186 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 queued for deep scrub 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean+inconsistent 2026-02-17T04:19:33.798305+0000 23'113 42:201 [1,2,3] 1 [1,2,3] 1 23'113 2026-02-17T04:19:33.798274+0000 23'113 2026-02-17T04:19:33.798274+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:33.798274+0000 113 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean+inconsistent 2026-02-17T04:19:34.837828+0000 23'121 42:210 [1,3,2] 1 [1,3,2] 1 23'121 2026-02-17T04:19:34.837787+0000 23'121 2026-02-17T04:19:34.837787+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:34.837787+0000 121 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-17T04:19:17.710819+0000 23'132 42:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:36.750 INFO:tasks.workunit.client.0.trial090.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-17T04:19:17.710336+0000 23'137 42:187 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T04:18:08.178320+0000 0'0 2026-02-17T04:18:08.178320+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:18:08.178320+0000 0 0 2026-02-17T04:19:36.751 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:19:36.751 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:19:36.751 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:19:36.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_3 4 16 128 40 10 256 4194304 0 1091 2026-02-17T04:19:36.757 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_3@ NAUT 4 16 128 40/ 10 256 4194304/ 0 1091 2026-02-17T04:19:36.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.8' 2026-02-17T04:19:36.758 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.8 2026-02-17T04:19:36.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.8 --format=json-pretty 2026-02-17T04:19:36.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.774 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:19:36.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.9' 2026-02-17T04:19:36.775 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.9 2026-02-17T04:19:36.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.9 --format=json-pretty 2026-02-17T04:19:36.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.791 INFO:tasks.workunit.client.0.trial090.stdout:443 2026-02-17T04:19:36.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.792 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.4 2026-02-17T04:19:36.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-17T04:19:36.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-17T04:19:36.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.808 INFO:tasks.workunit.client.0.trial090.stdout:881 2026-02-17T04:19:36.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-17T04:19:36.809 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.5 2026-02-17T04:19:36.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-17T04:19:36.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.825 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:19:36.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-17T04:19:36.827 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.6 2026-02-17T04:19:36.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-17T04:19:36.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.842 INFO:tasks.workunit.client.0.trial090.stdout:589 2026-02-17T04:19:36.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-17T04:19:36.842 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.7 2026-02-17T04:19:36.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-17T04:19:36.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.859 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:19:36.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-17T04:19:36.860 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.0 2026-02-17T04:19:36.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:19:36.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.875 INFO:tasks.workunit.client.0.trial090.stdout:151 2026-02-17T04:19:36.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-17T04:19:36.876 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.1 2026-02-17T04:19:36.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-17T04:19:36.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.892 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:19:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-17T04:19:36.893 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.2 2026-02-17T04:19:36.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-17T04:19:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.907 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:19:36.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-17T04:19:36.908 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.3 2026-02-17T04:19:36.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-17T04:19:36.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.924 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.3 2026-02-17T04:19:36.924 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:19:36.925 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:36.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.d' 2026-02-17T04:19:36.926 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.d 2026-02-17T04:19:36.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.d --format=json-pretty 2026-02-17T04:19:36.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.941 INFO:tasks.workunit.client.0.trial090.stdout:297 2026-02-17T04:19:36.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.e' 2026-02-17T04:19:36.942 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.e 2026-02-17T04:19:36.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.e --format=json-pretty 2026-02-17T04:19:36.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.958 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.e 2026-02-17T04:19:36.959 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:19:36.959 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:36.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.f' 2026-02-17T04:19:36.960 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.f 2026-02-17T04:19:36.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.f --format=json-pretty 2026-02-17T04:19:36.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.976 INFO:tasks.workunit.client.0.trial090.stdout:735 2026-02-17T04:19:36.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.977 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.a 2026-02-17T04:19:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.a' 2026-02-17T04:19:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.a --format=json-pretty 2026-02-17T04:19:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:36.992 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.a 2026-02-17T04:19:36.992 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:19:36.993 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:36.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:36.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.b' 2026-02-17T04:19:36.995 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.b 2026-02-17T04:19:36.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.b --format=json-pretty 2026-02-17T04:19:36.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:36.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:37.008 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.b 2026-02-17T04:19:37.008 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:19:37.008 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:37.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:37.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.c' 2026-02-17T04:19:37.009 INFO:tasks.workunit.client.0.trial090.stdout:list-inconsistent for PG 1.c 2026-02-17T04:19:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.c --format=json-pretty 2026-02-17T04:19:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-17T04:19:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-17T04:19:37.023 INFO:tasks.workunit.client.0.trial090.stderr:No scrub information available for pg 1.c 2026-02-17T04:19:37.024 INFO:tasks.workunit.client.0.trial090.stderr:error 2: (2) No such file or directory 2026-02-17T04:19:37.024 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:19:37.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-17T04:19:37.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-17T04:19:42.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-17T04:19:42.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-17T04:19:42.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-17T04:19:42.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-17T04:19:42.916 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:42.917 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:42.917 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:42.925 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:42.925 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:42.925 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:42.933 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:42.933 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:42.933 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:42.941 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:42.941 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:42.941 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:42.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-17T04:19:42.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771301982948034908 2026-02-17T04:19:42.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:42.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.8 2026-02-17T04:19:43.102 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.8 on osd.1 to repair 2026-02-17T04:19:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.9 2026-02-17T04:19:43.269 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.9 on osd.1 to repair 2026-02-17T04:19:43.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-17T04:19:43.434 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.4 on osd.3 to repair 2026-02-17T04:19:43.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-17T04:19:43.600 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-17T04:19:43.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-17T04:19:43.764 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.6 on osd.3 to repair 2026-02-17T04:19:43.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-17T04:19:43.930 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-17T04:19:43.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:43.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-17T04:19:44.094 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:19:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-17T04:19:44.258 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.1 on osd.3 to repair 2026-02-17T04:19:44.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-17T04:19:44.420 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-17T04:19:44.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-17T04:19:44.587 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:19:44.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.d 2026-02-17T04:19:44.756 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.d on osd.2 to repair 2026-02-17T04:19:44.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.e 2026-02-17T04:19:44.922 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.e on osd.1 to repair 2026-02-17T04:19:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.f 2026-02-17T04:19:45.087 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.f on osd.3 to repair 2026-02-17T04:19:45.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:45.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.a 2026-02-17T04:19:45.252 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.a on osd.1 to repair 2026-02-17T04:19:45.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:45.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.b 2026-02-17T04:19:45.419 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.b on osd.1 to repair 2026-02-17T04:19:45.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-17T04:19:45.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.c 2026-02-17T04:19:45.584 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.c on osd.3 to repair 2026-02-17T04:19:45.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-17T04:19:45.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-17T04:19:45.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-17T04:19:45.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-17T04:19:45.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-17T04:19:45.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-17T04:19:45.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-17T04:19:45.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-17T04:19:45.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-17T04:19:45.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771301985760929190 2026-02-17T04:19:45.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=2812 2026-02-17T04:19:45.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-17T04:19:45.816 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:19:45.816 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:45.816 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:45.825 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:19:45.826 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:45.826 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:45.833 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:19:45.833 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:45.833 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:45.842 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:19:45.842 INFO:tasks.workunit.client.0.trial090.stdout: "success": "" 2026-02-17T04:19:45.842 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:45.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-17T04:19:50.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-17T04:19:46.909891+0000 23'122 42:235 [3,0,2] 3 [3,0,2] 3 23'122 2026-02-17T04:19:46.906492+0000 23'122 2026-02-17T04:19:46.906492+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:46.906492+0000 122 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-17T04:19:48.842216+0000 23'131 42:267 [1,3,2] 1 [1,3,2] 1 23'131 2026-02-17T04:19:48.840109+0000 23'131 2026-02-17T04:19:48.840109+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:48.840109+0000 131 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-17T04:19:45.505597+0000 23'128 42:250 [2,1,3] 2 [2,1,3] 2 23'128 2026-02-17T04:19:45.503993+0000 23'128 2026-02-17T04:19:45.503993+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:45.503993+0000 128 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:46.835308+0000 23'133 42:292 [1,0,2] 1 [1,0,2] 1 23'133 2026-02-17T04:19:46.834124+0000 23'133 2026-02-17T04:19:46.834124+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:46.834124+0000 133 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-17T04:19:45.958813+0000 23'133 42:256 [3,0,2] 3 [3,0,2] 3 23'133 2026-02-17T04:19:45.956947+0000 23'133 2026-02-17T04:19:45.956947+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:45.956947+0000 133 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-17T04:19:47.928074+0000 23'136 42:259 [3,0,1] 3 [3,0,1] 3 23'136 2026-02-17T04:19:47.924559+0000 23'136 2026-02-17T04:19:47.924559+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:47.924559+0000 136 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-17T04:19:45.250215+0000 23'126 42:288 [0,1,3] 0 [0,1,3] 0 23'126 2026-02-17T04:19:45.247379+0000 23'126 2026-02-17T04:19:45.247379+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:45.247379+0000 126 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-17T04:19:47.800887+0000 23'119 42:245 [1,2,0] 1 [1,2,0] 1 23'119 2026-02-17T04:19:47.799751+0000 23'119 2026-02-17T04:19:47.799751+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:47.799751+0000 119 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:43.932219+0000 23'127 42:250 [3,0,1] 3 [3,0,1] 3 23'127 2026-02-17T04:19:43.928870+0000 23'127 2026-02-17T04:19:43.928870+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:43.928870+0000 127 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-17T04:19:44.509564+0000 23'127 42:257 [2,3,0] 2 [2,3,0] 2 23'127 2026-02-17T04:19:44.507164+0000 23'127 2026-02-17T04:19:44.507164+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:44.507164+0000 127 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-17T04:19:44.915111+0000 23'134 42:253 [3,0,2] 3 [3,0,2] 3 23'134 2026-02-17T04:19:44.912972+0000 23'134 2026-02-17T04:19:44.912972+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:44.912972+0000 134 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-17T04:19:45.801043+0000 23'129 42:262 [1,3,0] 1 [1,3,0] 1 23'129 2026-02-17T04:19:45.799619+0000 23'129 2026-02-17T04:19:45.799619+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:45.799619+0000 129 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-17T04:19:43.807640+0000 23'113 42:240 [1,2,3] 1 [1,2,3] 1 23'113 2026-02-17T04:19:43.806607+0000 23'113 2026-02-17T04:19:43.806607+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:43.806607+0000 113 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-17T04:19:44.778625+0000 23'121 42:255 [1,3,2] 1 [1,3,2] 1 23'121 2026-02-17T04:19:44.776640+0000 23'121 2026-02-17T04:19:44.776640+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:44.776640+0000 121 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean+inconsistent 2026-02-17T04:19:39.802682+0000 23'132 42:217 [1,2,0] 1 [1,2,0] 1 23'132 2026-02-17T04:19:39.802645+0000 23'132 2026-02-17T04:19:39.802645+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:39.802645+0000 132 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean+inconsistent 2026-02-17T04:19:40.821492+0000 23'137 42:223 [1,0,2] 1 [1,0,2] 1 23'137 2026-02-17T04:19:40.821464+0000 23'137 2026-02-17T04:19:40.821464+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:19:40.821464+0000 137 0 2026-02-17T04:19:51.017 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:19:51.018 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:19:51.018 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_3 4 16 128 40 10 256 4194304 0 2812 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stdout:MSR @ basic_3@ REPR 4 16 128 40/ 10 256 4194304/ 0 2812 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 4 'After repair' 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=4 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-17T04:19:51.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-17T04:19:51.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_17_0419 2026-02-17T04:19:51.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-17T04:19:51.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:19:51.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.095 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 52, 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.096 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.097 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3110 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.098 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3110 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3110 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3110 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3110 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr: "value": 796160 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.099 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.100 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 2, 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.044999346, 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.022499673 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.101 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.102 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.103 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.104 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.105 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.106 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.107 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 52, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.108 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.109 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3110 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3110 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.110 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3110 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3110 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3110 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 796160 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.111 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.112 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 2, 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.044999346, 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.022499673 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.113 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.114 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.115 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.116 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.117 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.118 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:19:51.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.157 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 414, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.158 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.159 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3064 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3064 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.160 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3064 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3064 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3064 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 784384 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.161 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 16, 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.431993736, 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.026999608 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.162 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "value": 16 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.163 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.164 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.165 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.166 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.167 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 414, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.168 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3064 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3064 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3064 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.169 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3064 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3064 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 784384 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 16, 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.431993736, 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.026999608 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.170 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "value": 16 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.171 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.172 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.173 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:19:51.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 104, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.219 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3060 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3060 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.220 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3060 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3060 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3060 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 783360 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.221 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 4, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.100998536, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.025249634 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.222 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.223 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.224 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.225 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.226 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 104, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.227 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3060 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.228 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3060 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3060 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3060 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3060 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.229 INFO:tasks.workunit.client.0.trial090.stdout: "value": 783360 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:19:51.230 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 4, 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.100998536, 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.025249634 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.231 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.232 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.233 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.234 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.235 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:19:51.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.281 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 266, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.282 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3054 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3054 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3054 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.283 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3054 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3054 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 781824 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.284 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 10, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.279995941, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.027999594 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.285 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 10 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.286 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.287 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:19:51.288 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 266, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.289 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3054 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.290 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3054 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3054 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3054 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3054 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 781824 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:19:51.291 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 10, 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.279995941, 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.027999594 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.292 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 10 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:19:51.293 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.294 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:19:51.295 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:19:51.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:19:51.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:20:01.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-17T04:20:01.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:20:01.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:20:01.503 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.503 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.503 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.504 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 78, 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.505 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.506 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.507 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4396 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.508 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4396 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.509 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4396 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4396 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4396 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1125376 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.510 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.511 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.512 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 3, 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.073998922, 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.024666307 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.513 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.514 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.515 INFO:tasks.workunit.client.0.trial090.stderr: "value": 3 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.516 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.517 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.518 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.519 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.520 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.521 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 78, 2026-02-17T04:20:01.522 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.523 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4396 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.524 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4396 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4396 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4396 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4396 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1125376 2026-02-17T04:20:01.525 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.526 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 3, 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.073998922, 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.024666307 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.527 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.528 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": 3 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.530 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.531 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.532 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:20:01.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.550 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 566, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.551 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4327 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4327 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.552 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4327 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4327 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4327 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1107712 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.553 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 22 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 22 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 22 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 22, 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.597991311, 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.027181423 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.554 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr: "value": 22 2026-02-17T04:20:01.555 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.556 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.557 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.558 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.559 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 566, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.560 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.561 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4327 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4327 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4327 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4327 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4327 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.562 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1107712 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 22 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 22 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout: "value": 22 2026-02-17T04:20:01.563 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 22, 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.597991311, 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.027181423 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.564 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 22 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.565 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.567 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:20:01.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.612 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 156, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.613 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4321 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4321 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4321 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.614 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4321 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4321 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1106176 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.615 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 6, 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.158997688, 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.026499614 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.616 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": 6 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.617 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.618 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.619 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:20:01.620 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 156, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.621 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.622 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4321 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4321 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4321 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4321 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4321 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1106176 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 6, 2026-02-17T04:20:01.624 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.158997688, 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.026499614 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.625 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 6 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.626 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.627 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.628 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:20:01.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.676 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 399, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "ec" 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "value": [ 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:20:01.677 INFO:tasks.workunit.client.0.trial090.stderr: "labels": { 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "pooltype": "replicated" 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "counters": { 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "preemptions": 0, 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_selected": 0, 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "chunk_busy": 0, 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "locked_object": 0, 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: ] 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4581 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4581 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.678 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4581 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4581 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 4581 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 1172736 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.679 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 15, 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0.425993806, 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0.028399587 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.680 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr: "value": 15 2026-02-17T04:20:01.681 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": 2 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.682 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.683 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": { 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "avgcount": 0, 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "sum": 0E-9, 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "avgtime": 0E-9 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.684 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr:} 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr:{ 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr: "value": 0 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_ec", 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.685 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_dp_repl", 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 399, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_ec", 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.686 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "key": "osd_scrub_sh_repl", 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "value": [ 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.687 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4581 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_cnt", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4581 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_omapget_bytes", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4581 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4581 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_cnt", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 4581 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_read_bytes", 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout: "value": 1172736 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.688 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_stats_cnt", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_cnt", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_read_bytes", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_replicated", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 15, 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0.425993806, 2026-02-17T04:20:01.689 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0.028399587 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_intersects", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_io_blocked", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.690 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 15 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 2 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_started_ec", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-17T04:20:01.691 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_intersects", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_io_blocked", 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.692 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservations_completed", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "value": { 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "avgcount": 0, 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "sum": 0E-9, 2026-02-17T04:20:01.693 INFO:tasks.workunit.client.0.trial090.stdout: "avgtime": 0E-9 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "key": "write_blocked_by_scrub", 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout: "value": 0 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:01.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-17T04:20:01.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:20:02.015 INFO:tasks.workunit:Running workunit scrub/osd-scrub-repair.sh... 2026-02-17T04:20:02.015 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-scrub-repair.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh 2026-02-17T04:20:02.076 INFO:tasks.workunit.client.0.trial090.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2026-02-17T04:20:02.076 INFO:tasks.workunit.client.0.trial090.stderr:++ TIMEOUT=300 2026-02-17T04:20:02.076 INFO:tasks.workunit.client.0.trial090.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ MAX_TIMEOUT=15 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ PG_NUM=4 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ TMPDIR=/tmp 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:+++ uname 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ '[' Linux = FreeBSD ']' 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ SED=sed 2026-02-17T04:20:02.077 INFO:tasks.workunit.client.0.trial090.stderr:++ AWK=awk 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:+++ stty -a 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:+++ head -1 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:++ termwidth= 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:++ DIFFCOLOPTS='-y ' 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:++ KERNCORE=kernel.core_pattern 2026-02-17T04:20:02.079 INFO:tasks.workunit.client.0.trial090.stderr:++ EXTRA_OPTS= 2026-02-17T04:20:02.080 INFO:tasks.workunit.client.0.trial090.stderr:++ test '' = TESTS 2026-02-17T04:20:02.080 INFO:tasks.workunit.client.0.trial090.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh 2026-02-17T04:20:02.080 INFO:tasks.workunit.client.0.trial090.stderr:++ uname 2026-02-17T04:20:02.081 INFO:tasks.workunit.client.0.trial090.stderr:+ '[' Linux = FreeBSD ']' 2026-02-17T04:20:02.081 INFO:tasks.workunit.client.0.trial090.stderr:+ use_ec_overwrite=true 2026-02-17T04:20:02.081 INFO:tasks.workunit.client.0.trial090.stderr:+ getjson=no 2026-02-17T04:20:02.081 INFO:tasks.workunit.client.0.trial090.stderr:+ jqfilter='def walk(f): 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:20:02.082 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:20:02.083 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:20:02.083 INFO:tasks.workunit.client.0.trial090.stderr:+ sortkeys='import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:+ main osd-scrub-repair 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:+ local dir=td/osd-scrub-repair 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:+ shift 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:+ shopt -s -o xtrace 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:20:02.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-repair 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:52: run: local dir=td/osd-scrub-repair 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:53: run: shift 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:55: run: export CEPH_MON=127.0.0.1:7107 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:55: run: CEPH_MON=127.0.0.1:7107 2026-02-17T04:20:02.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:56: run: export CEPH_ARGS 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:57: run: uuidgen 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:57: run: CEPH_ARGS+='--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none ' 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:58: run: CEPH_ARGS+='--mon-host=127.0.0.1:7107 ' 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:59: run: CEPH_ARGS+='--osd-skip-data-digest=false ' 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:61: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: set 2026-02-17T04:20:02.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:20:02.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: local 'funcs=TEST_allow_oper_initiated_scrub_during_recovery 2026-02-17T04:20:02.090 INFO:tasks.workunit.client.0.trial090.stderr:TEST_allow_repair_during_recovery 2026-02-17T04:20:02.090 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_bluestore_basic 2026-02-17T04:20:02.090 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_bluestore_failed 2026-02-17T04:20:02.090 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_bluestore_failed_norecov 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_bluestore_scrub 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_bluestore_tag 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_erasure_coded_appends 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_auto_repair_erasure_coded_overwrites 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_and_repair_jerasure_appends 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_and_repair_jerasure_overwrites 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_and_repair_lrc_appends 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_and_repair_lrc_overwrites 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_and_repair_replicated 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_scrub_erasure_appends 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_scrub_erasure_overwrites 2026-02-17T04:20:02.091 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_scrub_replicated 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_corrupt_snapset_scrub_rep 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_dual_store_replicated_cluster 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_list_missing_erasure_coded_appends 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_list_missing_erasure_coded_overwrites 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_periodic_scrub_replicated 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_repair_stats 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_repair_stats_ec 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_request_scrub_priority 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_warning 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_skip_non_repair_during_recovery 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_unfound_erasure_coded_appends 2026-02-17T04:20:02.092 INFO:tasks.workunit.client.0.trial090.stderr:TEST_unfound_erasure_coded_overwrites' 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:02.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:02.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:02.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:20:02.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:20:02.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:20:02.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:02.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:20:02.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:20:02.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:20:02.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:20:02.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:02.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:02.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:20:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:20:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:20:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:20:02.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:20:02.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:02.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:02.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:20:02.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_allow_oper_initiated_scrub_during_recovery td/osd-scrub-repair 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:115: TEST_allow_oper_initiated_scrub_during_recovery: local dir=td/osd-scrub-repair 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:116: TEST_allow_oper_initiated_scrub_during_recovery: cluster_conf=(['osds_num']='2' ['pgs_in_pool']='4' ['pool_name']='nopool' ['pool_default_size']='2' ['extras']='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true') 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:116: TEST_allow_oper_initiated_scrub_during_recovery: local -A cluster_conf 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:125: TEST_allow_oper_initiated_scrub_during_recovery: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-17T04:20:02.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=2 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=nopool 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=nopool 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=2 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=2 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars=--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:20:02.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:20:02.342 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 1959e8b7-0baa-4d6b-b4b2-5206f66f5789 2026-02-17T04:20:02.435 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:02.464 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.462+0000 7fd9a79fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:02.465 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.463+0000 7fd9a79fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:02.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.464+0000 7fd9a79fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:02.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.464+0000 7fd9a79fd780 -1 bdev(0x43b6c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:02.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.464+0000 7fd9a79fd780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:20:02.861 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:20:02.947 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:20:02.968 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.967+0000 7fc48462e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:02.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.968+0000 7fc48462e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:02.971 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:02.969+0000 7fc48462e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:03.029 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:03.144 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:03.143+0000 7fc48462e780 -1 Falling back to public interface 2026-02-17T04:20:03.467 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:03.465+0000 7fc48462e780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:20:04.113 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:04.195 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/49845178,v1:127.0.0.1:6801/49845178] [v2:127.0.0.1:6802/49845178,v1:127.0.0.1:6803/49845178] exists,up 1959e8b7-0baa-4d6b-b4b2-5206f66f5789 2026-02-17T04:20:04.199 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 1ea42267-4213-4f60-b55e-8aa4376e3c52 2026-02-17T04:20:04.292 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:04.321 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.319+0000 7fa8c6a62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:04.322 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.321+0000 7fa8c6a62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:04.323 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.321+0000 7fa8c6a62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:04.324 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.322+0000 7fa8c6a62780 -1 bdev(0x40acc00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:04.324 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.322+0000 7fa8c6a62780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:20:04.651 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:20:04.862 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:20:04.882 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.880+0000 7fb4f922e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:04.883 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.882+0000 7fb4f922e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:04.884 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:04.882+0000 7fb4f922e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:05.015 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:05.014+0000 7fb4f922e780 -1 Falling back to public interface 2026-02-17T04:20:05.026 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:05.308 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:05.306+0000 7fb4f922e780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:20:06.189 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:06.352 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2863524259,v1:127.0.0.1:6811/2863524259] [v2:127.0.0.1:6812/2863524259,v1:127.0.0.1:6813/2863524259] exists,up 1ea42267-4213-4f60-b55e-8aa4376e3c52 2026-02-17T04:20:07.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:126: TEST_allow_oper_initiated_scrub_during_recovery: local poolname=rbd 2026-02-17T04:20:07.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:127: TEST_allow_oper_initiated_scrub_during_recovery: create_rbd_pool 2026-02-17T04:20:07.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:20:07.516 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:20:07.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:20:07.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:20:07.735 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:20:07.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:20:08.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:20:09.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:128: TEST_allow_oper_initiated_scrub_during_recovery: wait_for_clean 2026-02-17T04:20:09.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:09.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:09.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:09.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:09.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:09.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:09.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:09.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:09.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:09.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:09.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:09.281 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:20:09.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:09.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:09.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:09.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-17T04:20:09.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-17T04:20:09.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T04:20:09.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:09.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:20:09.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:20:09.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669' 2026-02-17T04:20:09.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:09.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-17T04:20:09.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:09.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:09.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-17T04:20:09.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:09.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-17T04:20:09.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T04:20:09.404 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836486 2026-02-17T04:20:09.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:09.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-17T04:20:09.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:10.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:10.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:10.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836486 2026-02-17T04:20:10.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:10.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:20:10.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:10.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:10.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:20:10.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:10.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:20:10.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:20:10.746 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:20:10.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:10.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705669 2026-02-17T04:20:10.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:10.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:10.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:11.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:20:11.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:11.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:11.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:11.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:11.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:11.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:11.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:11.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:20:11.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:11.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:11.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:20:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:20:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:20:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:130: TEST_allow_oper_initiated_scrub_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:20:11.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:20:11.748 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:20:11.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:20:11.953 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:20:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:20:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:20:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:131: TEST_allow_oper_initiated_scrub_during_recovery: get_not_primary rbd SOMETHING 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:11.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:20:12.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:20:12.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:12.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:20:12.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:131: TEST_allow_oper_initiated_scrub_during_recovery: oper_scrub_and_schedule td/osd-scrub-repair rbd 0 2026-02-17T04:20:12.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:180: oper_scrub_and_schedule: local dir=td/osd-scrub-repair 2026-02-17T04:20:12.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:181: oper_scrub_and_schedule: local poolname=rbd 2026-02-17T04:20:12.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:182: oper_scrub_and_schedule: local osd=0 2026-02-17T04:20:12.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:187: oper_scrub_and_schedule: get_pg rbd SOMETHING 2026-02-17T04:20:12.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-17T04:20:12.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:20:12.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:12.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:20:12.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:187: oper_scrub_and_schedule: local pg=1.3 2026-02-17T04:20:12.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:188: oper_scrub_and_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:20:12.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:12.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:12.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:12.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:12.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:188: oper_scrub_and_schedule: local last_scrub=2026-02-17T04:20:07.734163+0000 2026-02-17T04:20:12.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:189: oper_scrub_and_schedule: ceph tell 1.3 scrub 2026-02-17T04:20:12.721 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:20:12.721 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:20:12.721 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:20:12.721 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:20:12.721 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:20:12.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:194: oper_scrub_and_schedule: sleep 3 2026-02-17T04:20:15.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:195: oper_scrub_and_schedule: (( i=0 )) 2026-02-17T04:20:15.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:195: oper_scrub_and_schedule: (( i < 3 )) 2026-02-17T04:20:15.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:196: oper_scrub_and_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:20:15.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:15.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:15.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:15.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:196: oper_scrub_and_schedule: test 2026-02-17T04:20:13.313357+0000 '>' 2026-02-17T04:20:07.734163+0000 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:197: oper_scrub_and_schedule: break 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:208: oper_scrub_and_schedule: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:20:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:20:15.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:15.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:15.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:15.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:15.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:15.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:15.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:20:15.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:20:15.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:20:15.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:20:15.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:20:15.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:20:15.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-17T04:20:16.061 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:20:16.062 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:20:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:16.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:20:16.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:20:16.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:20:16.106 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:20:16.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:20:16.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:20:16.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:20:16.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:20:16.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:20:16.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:20:16.116 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:16.115+0000 7f0dc3fe1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:16.118 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:16.116+0000 7f0dc3fe1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:16.118 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:16.117+0000 7f0dc3fe1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:16.245 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:16.243+0000 7f0dc3fe1780 -1 Falling back to public interface 2026-02-17T04:20:16.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:16.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:20:16.565 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:16.563+0000 7f0dc3fe1780 -1 osd.0 19 log_to_monitors true 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:17.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:17.602 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/2602759540,v1:127.0.0.1:6801/2602759540] [v2:127.0.0.1:6802/2602759540,v1:127.0.0.1:6803/2602759540] exists,up 1959e8b7-0baa-4d6b-b4b2-5206f66f5789 2026-02-17T04:20:17.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:20:17.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:20:17.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:17.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:17.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:17.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:17.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:17.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:17.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:17.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:17.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:17.855 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:20:17.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:17.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:17.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:17.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247811 2026-02-17T04:20:17.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247811 2026-02-17T04:20:17.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811' 2026-02-17T04:20:17.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:17.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:17.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705679 2026-02-17T04:20:17.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705679 2026-02-17T04:20:17.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811 1-38654705679' 2026-02-17T04:20:17.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:17.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247811 2026-02-17T04:20:17.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:17.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:17.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247811 2026-02-17T04:20:17.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:17.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247811 2026-02-17T04:20:17.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247811' 2026-02-17T04:20:17.977 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247811 2026-02-17T04:20:17.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 98784247811 2026-02-17T04:20:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:19.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:19.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:19.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247811 -lt 98784247811 2026-02-17T04:20:19.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705679 2026-02-17T04:20:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:19.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:19.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705679 2026-02-17T04:20:19.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705679 2026-02-17T04:20:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705679' 2026-02-17T04:20:19.313 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705679 2026-02-17T04:20:19.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:19.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705679 -lt 38654705679 2026-02-17T04:20:19.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:19.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:19.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:19.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:20:19.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:19.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:19.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:20:19.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:19.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:19.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:20:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:20:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:20:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:209: oper_scrub_and_schedule: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:20:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:210: oper_scrub_and_schedule: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:20:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:20:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:20:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:20:20.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:20.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:20.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:20.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:20.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:20.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:20.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:20:20.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:20:20.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:20:20.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:20:20.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:20:20.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:20:20.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:20.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:20:20.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:20:20.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:20.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:20:20.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:20:20.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:20:20.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:20:20.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:20:20.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:20:20.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:20:20.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:20:20.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:20.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:20.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:20.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:20:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:20:20.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:20:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:20:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:20:20.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:20:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:20:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:20:20.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:20:20.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:20:20.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:20:20.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:20:20.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:20:20.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:20:20.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:20:20.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:20:20.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:20:20.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:20:20.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_allow_repair_during_recovery td/osd-scrub-repair 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:138: TEST_allow_repair_during_recovery: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:139: TEST_allow_repair_during_recovery: local poolname=rbd 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:141: TEST_allow_repair_during_recovery: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:20:20.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:20:20.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:20:20.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:20:20.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:20.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:20:20.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:20:20.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:20:20.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:20:20.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:20:20.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:20:20.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:20:20.267 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:20:20.267 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:20:20.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:20:20.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:20:20.315 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:20:20.315 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.316 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.316 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:20:20.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:20:20.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:142: TEST_allow_repair_during_recovery: run_mgr td/osd-scrub-repair x 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:20:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:20:20.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:20:20.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:20.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:20.442 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:20.442 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.442 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:20.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:20:20.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:143: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 0 --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:20:20.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:20.462 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:20:20.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:20:20.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=86394267-248b-4aa2-b1a9-74b23cdc168b 2026-02-17T04:20:20.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 86394267-248b-4aa2-b1a9-74b23cdc168b' 2026-02-17T04:20:20.465 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 86394267-248b-4aa2-b1a9-74b23cdc168b 2026-02-17T04:20:20.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:20:20.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCE7JNpMNcHHBAAztIzcm/iQC228OuM9+phzw== 2026-02-17T04:20:20.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCE7JNpMNcHHBAAztIzcm/iQC228OuM9+phzw=="}' 2026-02-17T04:20:20.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 86394267-248b-4aa2-b1a9-74b23cdc168b -i td/osd-scrub-repair/0/new.json 2026-02-17T04:20:20.552 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:20:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true --mkfs --key AQCE7JNpMNcHHBAAztIzcm/iQC228OuM9+phzw== --osd-uuid 86394267-248b-4aa2-b1a9-74b23cdc168b 2026-02-17T04:20:20.577 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:20.575+0000 7f3184630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:20.578 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:20.576+0000 7f3184630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:20.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:20.577+0000 7f3184630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:20.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:20.577+0000 7f3184630780 -1 bdev(0x3a5cc00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:20.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:20.578+0000 7f3184630780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:20:21.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:20:21.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:20:21.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:20:21.044 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:20:21.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:20:21.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:20:21.130 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:20:21.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-17T04:20:21.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:20:21.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:20:21.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:20:21.145 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:21.144+0000 7fc02b017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:21.147 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:21.145+0000 7fc02b017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:21.148 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:21.146+0000 7fc02b017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:20:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:20:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:20:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:20:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:20:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:21.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:20:21.214 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:21.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:21.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:20:21.321 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:21.320+0000 7fc02b017780 -1 Falling back to public interface 2026-02-17T04:20:21.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:21.674+0000 7fc02b017780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:20:22.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:20:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:20:22.296 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:22.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:22.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:22.378 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/271002076,v1:127.0.0.1:6801/271002076] [v2:127.0.0.1:6802/271002076,v1:127.0.0.1:6803/271002076] exists,up 86394267-248b-4aa2-b1a9-74b23cdc168b 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:145: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 1 --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:20:22.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:20:22.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:20:22.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=743b9ea5-8700-4ff3-b317-707fc2f11f19 2026-02-17T04:20:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 743b9ea5-8700-4ff3-b317-707fc2f11f19' 2026-02-17T04:20:22.386 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 743b9ea5-8700-4ff3-b317-707fc2f11f19 2026-02-17T04:20:22.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:20:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCG7JNpv9FeFxAAYRMy3BXc63bPMxyzR3NmLg== 2026-02-17T04:20:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCG7JNpv9FeFxAAYRMy3BXc63bPMxyzR3NmLg=="}' 2026-02-17T04:20:22.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 743b9ea5-8700-4ff3-b317-707fc2f11f19 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:20:22.475 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:22.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:20:22.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true --mkfs --key AQCG7JNpv9FeFxAAYRMy3BXc63bPMxyzR3NmLg== --osd-uuid 743b9ea5-8700-4ff3-b317-707fc2f11f19 2026-02-17T04:20:22.500 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:22.498+0000 7f4309238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:22.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:22.499+0000 7f4309238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:22.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:22.500+0000 7f4309238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:22.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:22.501+0000 7f4309238780 -1 bdev(0x248ec00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:22.503 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:22.501+0000 7f4309238780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:20:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:20:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:20:22.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:20:22.846 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:20:22.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:20:23.060 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:20:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:20:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-17T04:20:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:20:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:20:23.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:20:23.076 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:23.074+0000 7f5a709d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:23.077 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:23.076+0000 7f5a709d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:23.078 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:23.076+0000 7f5a709d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:23.213 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:23.211+0000 7f5a709d8780 -1 Falling back to public interface 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:23.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:20:23.224 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:23.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:23.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:20:23.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:20:23.516 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:23.515+0000 7f5a709d8780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:20:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:20:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:20:24.395 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:24.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:24.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:20:24.561 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1944650601,v1:127.0.0.1:6811/1944650601] [v2:127.0.0.1:6812/1944650601,v1:127.0.0.1:6813/1944650601] exists,up 743b9ea5-8700-4ff3-b317-707fc2f11f19 2026-02-17T04:20:24.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:20:24.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:20:24.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:20:24.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:147: TEST_allow_repair_during_recovery: create_rbd_pool 2026-02-17T04:20:24.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:20:24.722 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:20:24.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:20:24.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:20:24.943 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:20:24.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:20:25.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:20:26.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:148: TEST_allow_repair_during_recovery: wait_for_clean 2026-02-17T04:20:26.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:26.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:26.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:26.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:26.234 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:26.234 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:26.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:26.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:26.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:26.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:26.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:26.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:26.489 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:20:26.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:26.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:26.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:26.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:20:26.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:20:26.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:20:26.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:26.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705667' 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:20:26.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:26.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:20:26.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:26.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:20:26.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:20:26.614 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:20:26.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:26.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:20:26.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:27.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:27.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:27.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:20:27.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:28.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:20:28.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:29.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-17T04:20:29.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:29.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:20:29.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:29.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:29.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:20:29.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:29.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:20:29.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:20:29.123 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:20:29.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:29.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:20:29.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:29.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:29.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:29.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:29.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:29.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:20:29.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:29.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:29.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:29.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:20:29.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:20:29.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:20:29.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:150: TEST_allow_repair_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:20:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:20:30.098 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:20:30.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:20:30.367 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:20:30.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:20:30.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:20:30.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:20:30.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:151: TEST_allow_repair_during_recovery: get_not_primary rbd SOMETHING 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:30.397 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:20:30.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:20:30.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:30.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:20:30.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:151: TEST_allow_repair_during_recovery: corrupt_and_repair_one td/osd-scrub-repair rbd 0 2026-02-17T04:20:30.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=0 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:20:30.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:30.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:30.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:20:30.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:20:30.947 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:20:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:20:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:20:30.995 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:20:30.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:20:30.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:20:30.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:20:30.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:20:30.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:20:30.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:20:31.006 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:31.005+0000 7fb127271780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:31.007 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:31.006+0000 7fb127271780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:31.008 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:31.007+0000 7fb127271780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:31.150 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:31.149+0000 7fb127271780 -1 Falling back to public interface 2026-02-17T04:20:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:20:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:20:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:31.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:20:31.420 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:31.419+0000 7fb127271780 -1 osd.0 20 log_to_monitors true 2026-02-17T04:20:32.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:20:32.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:32.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:20:32.324 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:20:32.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:32.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:20:32.488 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 24 up_thru 24 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/2892931426,v1:127.0.0.1:6801/2892931426] [v2:127.0.0.1:6802/2892931426,v1:127.0.0.1:6803/2892931426] exists,up 86394267-248b-4aa2-b1a9-74b23cdc168b 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:32.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:32.490 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:32.490 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:32.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:32.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:32.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:32.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:32.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:32.744 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:20:32.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:32.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:32.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:32.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:20:32.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:20:32.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-17T04:20:32.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:32.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:32.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:20:32.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:20:32.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-38654705669' 2026-02-17T04:20:32.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:32.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-17T04:20:32.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:32.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:32.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-17T04:20:32.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:32.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:20:32.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-17T04:20:32.865 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 103079215106 2026-02-17T04:20:32.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:20:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:34.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:34.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:20:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:35.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:20:35.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:35.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:20:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:35.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:20:35.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:35.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:35.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:20:35.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:35.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:20:35.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:20:35.370 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705669 2026-02-17T04:20:35.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:35.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T04:20:35.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:35.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:35.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:20:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:35.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:35.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:20:35.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:35.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:35.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:36.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:20:36.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-17T04:20:36.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:20:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-17T04:20:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:36.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:36.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-17T04:20:36.622 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:20:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:20:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:20:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:24.942130+0000 '>' 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:20:37.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:20:37.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:20:37.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:20:37.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:37.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:37.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:37.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:37.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:24.942130+0000 '>' 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:37.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:20:38.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:20:38.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:20:38.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:20:38.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:38.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:38.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:38.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:39.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:24.942130+0000 '>' 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:39.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:20:40.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:20:40.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:20:40.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:20:40.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:40.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:40.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:40.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:40.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:24.942130+0000 '>' 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:40.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:20:41.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:20:41.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:20:41.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:20:41.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:20:41.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:20:41.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:20:41.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:20:41.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:37.552461+0000 '>' 2026-02-17T04:20:24.942130+0000 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:41.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:41.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:20:41.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:20:41.622 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:20:41.622 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:20:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:20:41.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:20:41.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:20:41.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:41.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:41.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:41.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:20:41.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:20:41.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:20:41.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:20:41.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:20:41.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:20:41.674 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:41.674+0000 7f3052262780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:41.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:41.675+0000 7f3052262780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:41.677 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:41.676+0000 7f3052262780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:41.814 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:41.813+0000 7f3052262780 -1 Falling back to public interface 2026-02-17T04:20:41.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:20:41.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:20:41.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:20:41.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:20:41.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:20:41.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:41.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:20:41.834 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:20:41.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:41.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:20:41.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:20:42.122 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:42.121+0000 7f3052262780 -1 osd.1 28 log_to_monitors true 2026-02-17T04:20:42.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:20:42.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:20:42.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:20:42.999 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:20:43.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:20:43.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:20:43.165 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 31 up_thru 31 down_at 28 last_clean_interval [9,28) [v2:127.0.0.1:6810/2224643936,v1:127.0.0.1:6811/2224643936] [v2:127.0.0.1:6812/2224643936,v1:127.0.0.1:6813/2224643936] exists,up 743b9ea5-8700-4ff3-b317-707fc2f11f19 2026-02-17T04:20:43.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:43.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:43.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:43.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:43.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:43.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:43.414 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:20:43.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:43.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:43.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-17T04:20:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-17T04:20:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109' 2026-02-17T04:20:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:43.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:43.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-17T04:20:43.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-17T04:20:43.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109 1-133143986178' 2026-02-17T04:20:43.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:43.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215109 2026-02-17T04:20:43.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:43.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:43.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215109 2026-02-17T04:20:43.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:43.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215109 2026-02-17T04:20:43.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215109' 2026-02-17T04:20:43.536 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 103079215109 2026-02-17T04:20:43.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:43.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215109 2026-02-17T04:20:43.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:44.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:44.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:44.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-17T04:20:44.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:44.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986178 2026-02-17T04:20:44.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:44.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:44.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986178 2026-02-17T04:20:44.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:44.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-17T04:20:44.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986178' 2026-02-17T04:20:44.871 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 133143986178 2026-02-17T04:20:44.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:45.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986178 -lt 133143986178 2026-02-17T04:20:45.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:45.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:45.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:45.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:45.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:45.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:20:45.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:45.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:45.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:20:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:20:45.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:20:45.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:20:45.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:20:45.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:20:45.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:20:45.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:20:45.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:20:45.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:45.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:45.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:45.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:45.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:45.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:45.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:20:45.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:20:45.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:20:45.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:20:45.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:20:45.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:20:45.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:45.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:20:45.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:20:45.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:45.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:20:45.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:20:45.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:20:45.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:20:45.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:45.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:45.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:20:45.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:20:45.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:20:45.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:20:45.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:20:45.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:20:45.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:20:45.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:20:45.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:20:45.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:20:45.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:45.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:20:45.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:20:45.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:20:45.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:20:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:20:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:20:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:20:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:20:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:20:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:20:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:20:45.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:20:45.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:20:45.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:20:45.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:20:45.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_basic td/osd-scrub-repair 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:498: TEST_auto_repair_bluestore_basic: local dir=td/osd-scrub-repair 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:499: TEST_auto_repair_bluestore_basic: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='1' ['pool_name']='testpool' ['extras']=' --osd_scrub_auto_repair=true') 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:499: TEST_auto_repair_bluestore_basic: local -A cluster_conf 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:505: TEST_auto_repair_bluestore_basic: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-17T04:20:45.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=1 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=testpool 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=testpool 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_scrub_auto_repair=true' 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:20:45.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:20:46.023 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 56709d6b-f238-459d-b599-6cd7abae5122 2026-02-17T04:20:46.110 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:46.139 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.138+0000 7f87f8e45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.140 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.140+0000 7f87f8e45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.141 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.140+0000 7f87f8e45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.142 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.141+0000 7f87f8e45780 -1 bdev(0x30cec00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:46.142 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.141+0000 7f87f8e45780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:20:46.546 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:20:46.630 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:20:46.650 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.649+0000 7f68d7442780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.651 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.650+0000 7f68d7442780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.651+0000 7f68d7442780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:46.711 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:46.835 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:46.834+0000 7f68d7442780 -1 Falling back to public interface 2026-02-17T04:20:47.147 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:47.145+0000 7f68d7442780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:20:47.795 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:47.877 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3523706914,v1:127.0.0.1:6801/3523706914] [v2:127.0.0.1:6802/3523706914,v1:127.0.0.1:6803/3523706914] exists,up 56709d6b-f238-459d-b599-6cd7abae5122 2026-02-17T04:20:47.881 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 0c71dff9-8898-4607-8ff9-fc9ebf1c94a7 2026-02-17T04:20:47.971 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:48.000 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:47.999+0000 7f6207229780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.002 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.000+0000 7f6207229780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.001+0000 7f6207229780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.001+0000 7f6207229780 -1 bdev(0x3a44c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:48.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.002+0000 7f6207229780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:20:48.345 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:20:48.554 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:20:48.573 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.571+0000 7fcc8fa43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.574 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.572+0000 7fcc8fa43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.575 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.573+0000 7fcc8fa43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:48.720 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.718+0000 7fcc8fa43780 -1 Falling back to public interface 2026-02-17T04:20:48.722 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:48.990 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:48.988+0000 7fcc8fa43780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:20:49.889 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:50.051 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/355749789,v1:127.0.0.1:6811/355749789] [v2:127.0.0.1:6812/355749789,v1:127.0.0.1:6813/355749789] exists,up 0c71dff9-8898-4607-8ff9-fc9ebf1c94a7 2026-02-17T04:20:50.055 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 b066f695-f92f-4dd5-a877-fad3c741d2e6 2026-02-17T04:20:50.225 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:20:50.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.254+0000 7f4e6e868780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.255+0000 7f4e6e868780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.256+0000 7f4e6e868780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.256+0000 7f4e6e868780 -1 bdev(0x398cc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:20:50.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.256+0000 7f4e6e868780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:20:50.588 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:20:50.800 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:20:50.820 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.818+0000 7fb7ede66780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.821 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.820+0000 7fb7ede66780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.822 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:50.821+0000 7fb7ede66780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:20:50.966 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:20:51.016 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:51.014+0000 7fb7ede66780 -1 Falling back to public interface 2026-02-17T04:20:51.317 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:20:51.315+0000 7fb7ede66780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:20:52.133 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:20:52.304 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3190331909,v1:127.0.0.1:6819/3190331909] [v2:127.0.0.1:6820/3190331909,v1:127.0.0.1:6821/3190331909] exists,up b066f695-f92f-4dd5-a877-fad3c741d2e6 2026-02-17T04:20:52.516 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:20:53.962 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:20:54.128 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705670 2026-02-17T04:20:54.297 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T04:20:56.224 INFO:tasks.workunit.client.0.trial090.stdout:standard_scrub_cluster: dbg: test pool is testpool 1 2026-02-17T04:20:56.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:506: TEST_auto_repair_bluestore_basic: local poolid=1 2026-02-17T04:20:56.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:507: TEST_auto_repair_bluestore_basic: local poolname=testpool 2026-02-17T04:20:56.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:509: TEST_auto_repair_bluestore_basic: ceph osd pool set testpool size 2 2026-02-17T04:20:56.436 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:20:56.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:510: TEST_auto_repair_bluestore_basic: wait_for_clean 2026-02-17T04:20:56.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:20:56.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:20:56.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:20:56.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:20:56.447 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:20:56.447 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:20:56.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:20:56.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:20:56.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:20:56.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:20:56.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:20:56.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:20:56.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:20:56.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:20:56.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:20:56.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:20:56.702 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:20:56.702 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:20:56.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:20:56.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:56.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:20:56.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:20:56.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:20:56.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:20:56.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:56.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:20:56.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:20:56.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:20:56.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T04:20:56.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:20:56.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:20:56.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T04:20:56.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T04:20:56.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542151' 2026-02-17T04:20:56.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:56.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:20:56.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:56.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:20:56.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:20:56.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:56.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:20:56.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:20:56.881 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836491 2026-02-17T04:20:56.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:57.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-17T04:20:57.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:20:58.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:20:58.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:20:58.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836491 2026-02-17T04:20:58.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:58.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:20:58.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:58.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:20:58.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:20:58.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:58.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:20:58.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:20:58.221 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T04:20:58.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:20:58.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705674 2026-02-17T04:20:58.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:20:58.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T04:20:58.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:20:58.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:20:58.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T04:20:58.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:20:58.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T04:20:58.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T04:20:58.393 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542151 2026-02-17T04:20:58.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:20:58.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-17T04:20:58.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:20:58.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:58.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:58.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:20:58.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:58.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:58.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:58.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:58.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:58.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:58.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:58.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T04:20:58.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:58.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:58.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:59.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T04:20:59.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T04:20:59.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T04:20:59.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T04:20:59.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T04:20:59.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T04:20:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T04:20:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:20:59.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:20:59.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:20:59.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:20:59.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:20:59.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:20:59.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:20:59.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T04:20:59.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:20:59.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:20:59.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:20:59.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T04:20:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T04:20:59.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T04:20:59.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T04:20:59.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-17T04:20:59.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T04:20:59.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T04:21:00.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T04:21:00.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:00.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:00.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:00.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:00.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:00.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:00.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:00.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:00.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:513: TEST_auto_repair_bluestore_basic: local payload=ABCDEF 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:514: TEST_auto_repair_bluestore_basic: echo ABCDEF 2026-02-17T04:21:00.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:515: TEST_auto_repair_bluestore_basic: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:519: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:00.428 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:00.429 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:00.429 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:00.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:21:00.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:00.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:21:00.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:519: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:21:00.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:00.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:00.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:00.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:00.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:21:00.975 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:01.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:21:01.011 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:21:01.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:21:01.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:21:01.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:21:01.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:01.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:01.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:01.025 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:01.023+0000 7f8a26e71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:01.027 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:01.025+0000 7f8a26e71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:01.028 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:01.026+0000 7f8a26e71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:01.175 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:01.173+0000 7f8a26e71780 -1 Falling back to public interface 2026-02-17T04:21:01.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:21:01.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:01.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:01.445 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:01.443+0000 7f8a26e71780 -1 osd.0 19 log_to_monitors true 2026-02-17T04:21:02.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:02.349 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:02.513 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/2621772372,v1:127.0.0.1:6801/2621772372] [v2:127.0.0.1:6802/2621772372,v1:127.0.0.1:6803/2621772372] exists,up 56709d6b-f238-459d-b599-6cd7abae5122 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:02.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:02.515 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:02.515 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:02.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:02.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:02.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:02.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:02.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:02.764 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:02.764 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:02.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:02.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:02.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:02.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247811 2026-02-17T04:21:02.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247811 2026-02-17T04:21:02.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811' 2026-02-17T04:21:02.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:02.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:02.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705681 2026-02-17T04:21:02.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705681 2026-02-17T04:21:02.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811 1-38654705681' 2026-02-17T04:21:02.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:02.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:02.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-17T04:21:02.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-17T04:21:02.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811 1-38654705681 2-60129542158' 2026-02-17T04:21:02.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:02.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247811 2026-02-17T04:21:02.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:02.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:02.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247811 2026-02-17T04:21:02.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247811 2026-02-17T04:21:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247811' 2026-02-17T04:21:02.947 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247811 2026-02-17T04:21:02.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:03.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247811 2026-02-17T04:21:03.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:04.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:04.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:04.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247811 2026-02-17T04:21:04.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:04.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705681 2026-02-17T04:21:04.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:04.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:04.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705681 2026-02-17T04:21:04.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:04.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705681 2026-02-17T04:21:04.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705681' 2026-02-17T04:21:04.283 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705681 2026-02-17T04:21:04.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:04.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705682 -lt 38654705681 2026-02-17T04:21:04.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:04.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-17T04:21:04.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:04.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:04.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-17T04:21:04.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:04.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-17T04:21:04.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-17T04:21:04.453 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542158 2026-02-17T04:21:04.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:04.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542159 -lt 60129542158 2026-02-17T04:21:04.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:04.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:04.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:04.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:04.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:04.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:04.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:04.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:04.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:04.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:04.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:04.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:04.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:04.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:04.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:05.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:05.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:05.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:05.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:520: TEST_auto_repair_bluestore_basic: ceph tell 'osd.*' config set osd_scrub_auto_repair true 2026-02-17T04:21:05.262 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:21:05.262 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:21:05.262 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:21:05.270 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:21:05.270 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:21:05.270 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:21:05.277 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:21:05.278 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:21:05.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:21:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:522: TEST_auto_repair_bluestore_basic: get_pg testpool SOMETHING 2026-02-17T04:21:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:21:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:21:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:21:05.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:522: TEST_auto_repair_bluestore_basic: local pgid=1.0 2026-02-17T04:21:05.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:523: TEST_auto_repair_bluestore_basic: get_primary testpool SOMETHING 2026-02-17T04:21:05.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:05.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:05.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:05.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:523: TEST_auto_repair_bluestore_basic: local primary=1 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:524: TEST_auto_repair_bluestore_basic: get_last_scrub_stamp 1.0 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:05.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:524: TEST_auto_repair_bluestore_basic: local last_scrub_stamp=2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:05.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:527: TEST_auto_repair_bluestore_basic: ceph tell 1.0 schedule-deep-scrub 2026-02-17T04:21:05.836 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:21:05.837 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:21:05.837 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:21:05.837 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T23:32:55.835721+0000" 2026-02-17T04:21:05.837 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:21:05.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:530: TEST_auto_repair_bluestore_basic: wait_for_scrub 1.0 2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:05.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:21:05.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:05.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:05.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:06.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:52.514648+0000 '>' 2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:06.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:07.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:07.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:07.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:07.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:07.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:07.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:07.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:07.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:20:52.514648+0000 '>' 2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:07.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:08.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:08.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:08.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:08.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:08.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:08.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:08.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:08.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:05.913195+0000 '>' 2026-02-17T04:20:52.514648+0000 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:531: TEST_auto_repair_bluestore_basic: wait_for_clean 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:08.349 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:08.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:08.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:08.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:08.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:08.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:08.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:08.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:08.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247818 2026-02-17T04:21:08.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247818 2026-02-17T04:21:08.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247818' 2026-02-17T04:21:08.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:08.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:08.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705688 2026-02-17T04:21:08.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705688 2026-02-17T04:21:08.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247818 1-38654705688' 2026-02-17T04:21:08.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:08.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542165 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542165 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247818 1-38654705688 2-60129542165' 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247818 2026-02-17T04:21:08.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:08.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:08.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247818 2026-02-17T04:21:08.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247818 2026-02-17T04:21:08.779 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 98784247818 2026-02-17T04:21:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247818' 2026-02-17T04:21:08.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:08.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247816 -lt 98784247818 2026-02-17T04:21:08.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:09.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:09.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:10.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247819 -lt 98784247818 2026-02-17T04:21:10.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:10.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705688 2026-02-17T04:21:10.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:10.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:10.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705688 2026-02-17T04:21:10.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:10.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705688 2026-02-17T04:21:10.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705688' 2026-02-17T04:21:10.121 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705688 2026-02-17T04:21:10.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:10.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705689 -lt 38654705688 2026-02-17T04:21:10.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:10.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542165 2026-02-17T04:21:10.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:10.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:10.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542165 2026-02-17T04:21:10.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:10.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542165 2026-02-17T04:21:10.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542165' 2026-02-17T04:21:10.290 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542165 2026-02-17T04:21:10.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:10.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542166 -lt 60129542165 2026-02-17T04:21:10.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:10.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:10.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:10.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:10.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:10.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:10.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:10.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:10.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:10.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:11.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:11.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:532: TEST_auto_repair_bluestore_basic: ceph pg dump pgs 2026-02-17T04:21:11.216 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:21:11.216 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-17T04:21:05.914367+0000 19'1 25:70 [1,0] 1 [1,0] 1 19'1 2026-02-17T04:21:05.913195+0000 19'1 2026-02-17T04:21:05.913195+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:21:05.913195+0000 1 0 2026-02-17T04:21:11.216 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:21:11.216 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:21:11.217 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:535: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:11.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:11.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:21:11.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:11.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:535: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:11.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:11.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:11.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-17T04:21:11.709 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:21:11.709 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:21:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:21:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:21:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:11.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:11.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:21:11.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:21:11.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:11.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:11.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:11.760 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:11.759+0000 7ff26f63b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:11.762 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:11.760+0000 7ff26f63b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:11.763 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:11.761+0000 7ff26f63b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:11.915 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:11.913+0000 7ff26f63b780 -1 Falling back to public interface 2026-02-17T04:21:12.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:12.195 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:12.193+0000 7ff26f63b780 -1 osd.0 25 log_to_monitors true 2026-02-17T04:21:13.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:13.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:13.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:13.081 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:13.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:13.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:13.245 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [23,25) [v2:127.0.0.1:6800/294580922,v1:127.0.0.1:6801/294580922] [v2:127.0.0.1:6802/294580922,v1:127.0.0.1:6803/294580922] exists,up 56709d6b-f238-459d-b599-6cd7abae5122 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:13.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:13.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:13.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:13.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:13.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:13.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:13.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:13.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:13.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:13.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:13.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:13.497 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:13.497 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:13.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:13.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:13.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:13.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051587 2026-02-17T04:21:13.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051587 2026-02-17T04:21:13.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051587' 2026-02-17T04:21:13.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:13.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:13.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-17T04:21:13.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-17T04:21:13.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051587 1-38654705694' 2026-02-17T04:21:13.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:13.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:13.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542171 2026-02-17T04:21:13.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542171 2026-02-17T04:21:13.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051587 1-38654705694 2-60129542171' 2026-02-17T04:21:13.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:13.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051587 2026-02-17T04:21:13.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:13.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:13.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051587 2026-02-17T04:21:13.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:13.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051587 2026-02-17T04:21:13.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051587' 2026-02-17T04:21:13.677 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 124554051587 2026-02-17T04:21:13.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247821 -lt 124554051587 2026-02-17T04:21:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:14.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:14.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:15.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051587 2026-02-17T04:21:15.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:15.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-17T04:21:15.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:15.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:15.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-17T04:21:15.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:15.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-17T04:21:15.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-17T04:21:15.013 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705694 2026-02-17T04:21:15.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:15.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705694 -lt 38654705694 2026-02-17T04:21:15.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:15.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542171 2026-02-17T04:21:15.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:15.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:15.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542171 2026-02-17T04:21:15.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:15.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542171 2026-02-17T04:21:15.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542171' 2026-02-17T04:21:15.187 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542171 2026-02-17T04:21:15.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:15.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542171 -lt 60129542171 2026-02-17T04:21:15.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:15.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:15.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:15.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:15.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:15.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:15.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:15.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:15.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:15.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:536: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:15.944 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:15.945 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:15.945 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:16.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:21:16.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:16.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:21:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:536: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:21:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:16.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:16.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:16.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:16.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:16.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:16.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:21:16.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:16.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:21:16.482 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:21:16.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:21:16.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:21:16.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:21:16.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:16.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:16.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:16.496 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:16.494+0000 7f88cd22d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:16.497 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:16.495+0000 7f88cd22d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:16.498 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:16.496+0000 7f88cd22d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:16.649 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:16.648+0000 7f88cd22d780 -1 Falling back to public interface 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:16.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:16.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:16.964 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:16.962+0000 7f88cd22d780 -1 osd.0 30 log_to_monitors true 2026-02-17T04:21:17.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:17.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:17.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:17.820 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:17.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:17.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:17.984 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 34 up_thru 0 down_at 31 last_clean_interval [29,30) [v2:127.0.0.1:6800/2271623139,v1:127.0.0.1:6801/2271623139] [v2:127.0.0.1:6802/2271623139,v1:127.0.0.1:6803/2271623139] exists,up 56709d6b-f238-459d-b599-6cd7abae5122 2026-02-17T04:21:17.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:17.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:17.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:17.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:17.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:18.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:18.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:18.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:18.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:18.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:18.238 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:18.239 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:18.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:18.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:18.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:18.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-17T04:21:18.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-17T04:21:18.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067' 2026-02-17T04:21:18.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:18.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:18.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705700 2026-02-17T04:21:18.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705700 2026-02-17T04:21:18.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067 1-38654705700' 2026-02-17T04:21:18.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:18.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:18.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542176 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542176 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067 1-38654705700 2-60129542176' 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888067 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:18.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:18.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888067 2026-02-17T04:21:18.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:18.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-17T04:21:18.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888067' 2026-02-17T04:21:18.418 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 146028888067 2026-02-17T04:21:18.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:18.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888066 -lt 146028888067 2026-02-17T04:21:18.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:19.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:19.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888066 -lt 146028888067 2026-02-17T04:21:19.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:20.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:21:20.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:20.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888069 -lt 146028888067 2026-02-17T04:21:20.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:20.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705700 2026-02-17T04:21:20.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:20.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:20.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705700 2026-02-17T04:21:20.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:20.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705700 2026-02-17T04:21:20.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705700' 2026-02-17T04:21:20.921 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705700 2026-02-17T04:21:20.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:21.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705701 -lt 38654705700 2026-02-17T04:21:21.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:21.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542176 2026-02-17T04:21:21.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:21.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:21.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542176 2026-02-17T04:21:21.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:21.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542176 2026-02-17T04:21:21.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542176' 2026-02-17T04:21:21.088 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542176 2026-02-17T04:21:21.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542178 -lt 60129542176 2026-02-17T04:21:21.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:21.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:21.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:21.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:21.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:21.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:21.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:21.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:21.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:21.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:21.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:21.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:21.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:21.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:21.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:21.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:21.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:537: TEST_auto_repair_bluestore_basic: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:21:21.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:538: TEST_auto_repair_bluestore_basic: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:21:21.838 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:05.911+0000 7fcc6d29a640 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:21:21.838 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:05.911+0000 7fcc6d29a640 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:21:21.838 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:05.911+0000 7fcc6d29a640 15 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-17T04:21:21.838 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:05.911+0000 7fcc6d29a640 20 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-17T04:21:21.838 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:05.911+0000 7fcc6d29a640 19 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:21:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:21:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:21:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:21:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:21:21.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:21.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:21.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:21.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:21.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:21.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:21.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:21:21.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:21:21.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:21:21.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:21:21.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:21:21.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:21:21.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:21:21.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:21:21.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:21:21.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:21:21.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:21:21.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:21:21.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:21:21.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:21:21.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:21.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:21.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:21:21.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:21.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:21.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:21.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:21.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:21.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:21:21.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:21:21.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:21:21.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:21:21.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:21:21.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:21:21.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:21:21.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:21:21.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:21:21.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:21:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:21:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:21:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:21:21.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:21:21.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:21.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:21:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:21:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:21:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:21:21.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:21:21.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:21.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:21.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:21:21.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:21:21.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:21:21.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:21:21.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:21:21.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_failed td/osd-scrub-repair 2026-02-17T04:21:21.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:598: TEST_auto_repair_bluestore_failed: local dir=td/osd-scrub-repair 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:599: TEST_auto_repair_bluestore_failed: local poolname=testpool 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:602: TEST_auto_repair_bluestore_failed: run_mon td/osd-scrub-repair a 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:21:21.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:21:21.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:21:21.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:21.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:21.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:21.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:21.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:21.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:21.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:21:22.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:21:22.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:21:22.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:21:22.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:21:22.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:22.023 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:21:22.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:21:22.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:21:22.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:21:22.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:21:22.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:21:22.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:21:22.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:21:22.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:21:22.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:603: TEST_auto_repair_bluestore_failed: run_mgr td/osd-scrub-repair x 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:21:22.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:21:22.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:21:22.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:21:22.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:22.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:22.193 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:22.193 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:22.193 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:22.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:22.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:21:22.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:21:22.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:606: TEST_auto_repair_bluestore_failed: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:22.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: seq 0 2 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:22.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:21:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:21:22.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:22.213 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:22.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 dd9e9c7a-4b69-4d51-bc09-63f16eecd100' 2026-02-17T04:21:22.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:21:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDC7JNpRAg2DRAAR8TCHW2CcjO9MPAvOnzsOQ== 2026-02-17T04:21:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDC7JNpRAg2DRAAR8TCHW2CcjO9MPAvOnzsOQ=="}' 2026-02-17T04:21:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dd9e9c7a-4b69-4d51-bc09-63f16eecd100 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:21:22.302 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:21:22.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:21:22.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDC7JNpRAg2DRAAR8TCHW2CcjO9MPAvOnzsOQ== --osd-uuid dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:22.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.325+0000 7efd8142f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.326+0000 7efd8142f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.327+0000 7efd8142f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.327+0000 7efd8142f780 -1 bdev(0x2f24c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:21:22.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.327+0000 7efd8142f780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:21:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:21:22.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:21:22.772 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:21:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:21:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:21:22.856 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:21:22.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:21:22.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:22.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:21:22.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:21:22.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:21:22.872 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.870+0000 7f13e8236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.874 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.872+0000 7f13e8236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.875 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:22.873+0000 7f13e8236780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:21:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:22.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:22.940 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:21:22.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:22.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:23.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:23.051 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:23.050+0000 7f13e8236780 -1 Falling back to public interface 2026-02-17T04:21:23.392 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:23.390+0000 7f13e8236780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:24.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:24.097 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1659558606,v1:127.0.0.1:6801/1659558606] [v2:127.0.0.1:6802/1659558606,v1:127.0.0.1:6803/1659558606] exists,up dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:24.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:21:24.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:21:24.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:21:24.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3' 2026-02-17T04:21:24.103 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:21:24.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:21:24.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDE7JNped2SBhAAa87Hanhlx8OeHa1V0KBK6A== 2026-02-17T04:21:24.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDE7JNped2SBhAAa87Hanhlx8OeHa1V0KBK6A=="}' 2026-02-17T04:21:24.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:21:24.192 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:21:24.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:21:24.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDE7JNped2SBhAAa87Hanhlx8OeHa1V0KBK6A== --osd-uuid 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:21:24.217 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.215+0000 7f2c85e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.218 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.217+0000 7f2c85e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.217+0000 7f2c85e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.218+0000 7f2c85e2f780 -1 bdev(0x2672c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:21:24.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.218+0000 7f2c85e2f780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:21:24.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:21:24.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:21:24.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:21:24.568 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:21:24.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:21:24.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:21:24.780 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:21:24.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:24.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:21:24.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:21:24.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:21:24.795 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.794+0000 7f77d4e1f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.797 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.795+0000 7f77d4e1f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.798 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.796+0000 7f77d4e1f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:24.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:21:24.980 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:24.979+0000 7f77d4e1f780 -1 Falling back to public interface 2026-02-17T04:21:25.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:25.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:25.254+0000 7f77d4e1f780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:21:26.290 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2329715316,v1:127.0.0.1:6811/2329715316] [v2:127.0.0.1:6812/2329715316,v1:127.0.0.1:6813/2329715316] exists,up 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:21:26.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:26.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:26.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:26.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:21:26.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=33cadb67-e212-4b61-a10a-49b61fd4a9fe 2026-02-17T04:21:26.298 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 33cadb67-e212-4b61-a10a-49b61fd4a9fe 2026-02-17T04:21:26.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 33cadb67-e212-4b61-a10a-49b61fd4a9fe' 2026-02-17T04:21:26.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:21:26.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDG7JNpaG0REhAA8gTCwf6gj1z9Hb+9W09Cig== 2026-02-17T04:21:26.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDG7JNpaG0REhAA8gTCwf6gj1z9Hb+9W09Cig=="}' 2026-02-17T04:21:26.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 33cadb67-e212-4b61-a10a-49b61fd4a9fe -i td/osd-scrub-repair/2/new.json 2026-02-17T04:21:26.466 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:21:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:21:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDG7JNpaG0REhAA8gTCwf6gj1z9Hb+9W09Cig== --osd-uuid 33cadb67-e212-4b61-a10a-49b61fd4a9fe 2026-02-17T04:21:26.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:26.490+0000 7ffb6882e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:26.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:26.492+0000 7ffb6882e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:26.494 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:26.493+0000 7ffb6882e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:26.495 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:26.493+0000 7ffb6882e780 -1 bdev(0x410cc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:21:26.495 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:26.493+0000 7ffb6882e780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:21:26.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:21:26.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:21:26.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:21:26.807 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:21:26.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:21:27.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:21:27.031 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:21:27.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:27.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:21:27.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:21:27.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:21:27.047 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:27.045+0000 7f5c10c50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:27.048 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:27.046+0000 7f5c10c50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:27.049 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:27.047+0000 7f5c10c50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:27.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:27.176+0000 7f5c10c50780 -1 Falling back to public interface 2026-02-17T04:21:27.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:27.196 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:21:27.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:27.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:21:27.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:27.486 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:27.484+0000 7f5c10c50780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:21:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:28.362 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:21:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:28.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:28.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:21:28.529 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3972965270,v1:127.0.0.1:6819/3972965270] [v2:127.0.0.1:6820/3972965270,v1:127.0.0.1:6821/3972965270] exists,up 33cadb67-e212-4b61-a10a-49b61fd4a9fe 2026-02-17T04:21:28.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:28.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:28.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:28.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:611: TEST_auto_repair_bluestore_failed: create_pool testpool 1 1 2026-02-17T04:21:28.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-17T04:21:28.742 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:21:28.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:21:29.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:612: TEST_auto_repair_bluestore_failed: ceph osd pool set testpool size 2 2026-02-17T04:21:29.964 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:21:29.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:613: TEST_auto_repair_bluestore_failed: wait_for_clean 2026-02-17T04:21:29.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:29.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:29.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:29.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:30.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:30.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:30.233 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:30.233 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:30.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:30.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:30.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:30.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:21:30.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:21:30.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:21:30.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:30.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:30.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:21:30.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:21:30.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:21:30.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:30.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-64424509443' 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:21:30.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:30.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:30.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:21:30.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:30.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:21:30.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:21:30.414 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:21:30.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:30.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:21:30.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:31.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:31.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:31.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:21:31.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:32.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:21:32.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:32.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:21:32.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:32.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:21:32.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:32.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:32.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:21:32.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:32.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:21:32.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:21:32.916 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:21:32.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:33.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-17T04:21:33.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:33.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-17T04:21:33.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:33.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:33.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-17T04:21:33.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:33.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-17T04:21:33.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-17T04:21:33.083 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509443 2026-02-17T04:21:33.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-17T04:21:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:33.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:33.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:33.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:33.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:33.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:33.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:33.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:33.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:33.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:33.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:33.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:616: TEST_auto_repair_bluestore_failed: local payload=ABCDEF 2026-02-17T04:21:33.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:617: TEST_auto_repair_bluestore_failed: echo ABCDEF 2026-02-17T04:21:33.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: seq 1 10 2026-02-17T04:21:33.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:33.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-17T04:21:33.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:21:34.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:625: TEST_auto_repair_bluestore_failed: get_not_primary testpool SOMETHING 2026-02-17T04:21:34.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:21:34.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:21:34.004 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:21:34.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:34.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:34.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:34.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:34.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:21:34.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:34.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:21:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:625: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:21:34.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:34.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:34.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:34.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 remove 2026-02-17T04:21:34.758 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:21:34.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:34.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:34.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:34.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:21:34.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:34.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:34.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:34.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:21:34.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:21:34.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:34.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:34.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:34.812 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:34.811+0000 7fbdbb208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:34.813 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:34.813+0000 7fbdbb208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:34.814 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:34.813+0000 7fbdbb208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:34.954 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:34.953+0000 7fbdbb208780 -1 Falling back to public interface 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:34.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:34.964 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:35.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:35.237 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:35.236+0000 7fbdbb208780 -1 osd.0 20 log_to_monitors true 2026-02-17T04:21:36.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:36.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:36.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:36.130 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:36.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:36.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/2193788318,v1:127.0.0.1:6801/2193788318] [v2:127.0.0.1:6802/2193788318,v1:127.0.0.1:6803/2193788318] exists,up dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:36.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:36.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:36.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:36.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:36.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:36.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:36.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:36.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:21:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:21:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-17T04:21:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:36.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:36.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-17T04:21:36.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-17T04:21:36.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-42949672965' 2026-02-17T04:21:36.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:36.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509445 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509445 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-42949672965 2-64424509445' 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-17T04:21:36.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:36.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:36.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-17T04:21:36.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:36.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:21:36.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-17T04:21:36.731 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 103079215106 2026-02-17T04:21:36.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:21:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:37.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:37.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:38.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:21:38.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:39.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:21:39.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:39.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:21:39.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:39.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-17T04:21:39.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:39.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:39.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-17T04:21:39.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:39.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-17T04:21:39.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T04:21:39.241 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 42949672965 2026-02-17T04:21:39.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:39.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672965 2026-02-17T04:21:39.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:39.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509445 2026-02-17T04:21:39.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:39.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:39.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509445 2026-02-17T04:21:39.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:39.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509445 2026-02-17T04:21:39.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2026-02-17T04:21:39.408 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509445 2026-02-17T04:21:39.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:39.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509445 -lt 64424509445 2026-02-17T04:21:39.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:39.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:39.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:39.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:39.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:39.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:39.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:39.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:39.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:39.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:40.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:627: TEST_auto_repair_bluestore_failed: get_not_primary testpool SOMETHING 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:40.156 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:40.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:21:40.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:40.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:21:40.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:627: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:40.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:21:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:40.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:21:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-17T04:21:40.692 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:104778fc:::obj2:head# 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:40.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:40.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:21:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:40.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:21:40.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:21:40.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:40.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:40.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:40.745 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:40.745+0000 7f7a5100f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:40.747 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:40.746+0000 7f7a5100f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:40.748 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:40.747+0000 7f7a5100f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:40.890 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:40.890+0000 7f7a5100f780 -1 Falling back to public interface 2026-02-17T04:21:40.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:21:40.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:40.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:21:40.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:40.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:40.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:40.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:40.899 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:40.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:40.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:41.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:41.161 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:41.161+0000 7f7a5100f780 -1 osd.0 25 log_to_monitors true 2026-02-17T04:21:42.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:42.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:42.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:42.066 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:42.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:42.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [24,25) [v2:127.0.0.1:6800/1031030285,v1:127.0.0.1:6801/1031030285] [v2:127.0.0.1:6802/1031030285,v1:127.0.0.1:6803/1031030285] exists,up dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:42.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:42.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:42.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:42.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:42.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:42.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:42.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:42.481 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:42.481 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:42.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:42.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-17T04:21:42.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-17T04:21:42.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586' 2026-02-17T04:21:42.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:42.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-17T04:21:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-17T04:21:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-42949672967' 2026-02-17T04:21:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:42.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509447 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509447 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-42949672967 2-64424509447' 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051586 2026-02-17T04:21:42.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:42.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:42.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051586 2026-02-17T04:21:42.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:42.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-17T04:21:42.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051586' 2026-02-17T04:21:42.665 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 124554051586 2026-02-17T04:21:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:42.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 124554051586 2026-02-17T04:21:42.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:43.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:43.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:43.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 124554051586 2026-02-17T04:21:43.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:44.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:21:44.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:45.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-17T04:21:45.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:45.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-17T04:21:45.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:45.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:45.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-17T04:21:45.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:45.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-17T04:21:45.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-17T04:21:45.173 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 42949672967 2026-02-17T04:21:45.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:45.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-17T04:21:45.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:45.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509447 2026-02-17T04:21:45.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:45.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:45.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509447 2026-02-17T04:21:45.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:45.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509447 2026-02-17T04:21:45.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2026-02-17T04:21:45.341 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509447 2026-02-17T04:21:45.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:45.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509448 -lt 64424509447 2026-02-17T04:21:45.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:45.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:45.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:45.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:45.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:45.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:45.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:45.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:45.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:45.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:46.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:46.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:46.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:46.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:628: TEST_auto_repair_bluestore_failed: get_primary testpool SOMETHING 2026-02-17T04:21:46.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:46.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:21:46.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:21:46.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:628: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:21:46.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:21:46.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:21:46.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:21:46.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 rm-attr _ 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:21:46.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:21:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:21:46.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:21:46.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:21:46.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:21:46.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:21:46.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:21:46.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:21:46.722 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:46.722+0000 7f25b2e1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:46.724 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:46.723+0000 7f25b2e1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:46.725 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:46.724+0000 7f25b2e1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:21:46.903 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:46.903+0000 7f25b2e1d780 -1 Falling back to public interface 2026-02-17T04:21:47.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:21:47.186 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:21:47.185+0000 7f25b2e1d780 -1 osd.1 30 log_to_monitors true 2026-02-17T04:21:48.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:21:48.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:21:48.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:21:48.037 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:48.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:21:48.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 34 up_thru 34 down_at 31 last_clean_interval [10,30) [v2:127.0.0.1:6810/346226119,v1:127.0.0.1:6811/346226119] [v2:127.0.0.1:6812/346226119,v1:127.0.0.1:6813/346226119] exists,up 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:21:48.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:48.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:48.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:48.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:48.202 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:48.202 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:48.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:48.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:48.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:48.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:48.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:48.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:48.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051588 2026-02-17T04:21:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051588 2026-02-17T04:21:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588' 2026-02-17T04:21:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:48.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:48.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888066 2026-02-17T04:21:48.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888066 2026-02-17T04:21:48.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-146028888066' 2026-02-17T04:21:48.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:48.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:48.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509450 2026-02-17T04:21:48.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509450 2026-02-17T04:21:48.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-146028888066 2-64424509450' 2026-02-17T04:21:48.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:48.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051588 2026-02-17T04:21:48.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:48.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:48.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051588 2026-02-17T04:21:48.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:48.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051588 2026-02-17T04:21:48.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051588' 2026-02-17T04:21:48.636 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 124554051588 2026-02-17T04:21:48.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:48.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051588 2026-02-17T04:21:48.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:49.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:21:49.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:49.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051588 2026-02-17T04:21:49.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:21:50.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:21:50.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:51.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051588 -lt 124554051588 2026-02-17T04:21:51.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:51.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888066 2026-02-17T04:21:51.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:51.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:21:51.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888066 2026-02-17T04:21:51.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:51.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888066 2026-02-17T04:21:51.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888066' 2026-02-17T04:21:51.140 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 146028888066 2026-02-17T04:21:51.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:21:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888066 -lt 146028888066 2026-02-17T04:21:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:51.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509450 2026-02-17T04:21:51.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:51.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:21:51.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509450 2026-02-17T04:21:51.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509450 2026-02-17T04:21:51.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2026-02-17T04:21:51.311 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509450 2026-02-17T04:21:51.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:21:51.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509450 -lt 64424509450 2026-02-17T04:21:51.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:21:51.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:51.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:51.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:21:51.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:21:51.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:21:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:21:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:21:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:21:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:21:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:21:51.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:21:51.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:21:51.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:21:51.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:630: TEST_auto_repair_bluestore_failed: get_pg testpool obj1 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-17T04:21:52.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-17T04:21:52.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:21:52.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:630: TEST_auto_repair_bluestore_failed: local pgid=1.0 2026-02-17T04:21:52.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:631: TEST_auto_repair_bluestore_failed: get_primary testpool obj1 2026-02-17T04:21:52.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:21:52.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:21:52.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:21:52.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:631: TEST_auto_repair_bluestore_failed: local primary=1 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:632: TEST_auto_repair_bluestore_failed: get_last_scrub_stamp 1.0 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:52.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:52.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:632: TEST_auto_repair_bluestore_failed: local last_scrub_stamp=2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:52.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:633: TEST_auto_repair_bluestore_failed: ceph tell 1.0 schedule-deep-scrub 2026-02-17T04:21:52.610 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:21:52.610 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:21:52.610 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:21:52.611 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T23:33:42.609718+0000" 2026-02-17T04:21:52.611 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:636: TEST_auto_repair_bluestore_failed: wait_for_scrub 1.0 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:21:52.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:52.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:52.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:52.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:52.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:52.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:52.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:28.741119+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:52.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:53.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:53.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:53.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:53.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:53.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:53.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:53.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:53.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:28.741119+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:53.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:54.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:54.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:54.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:54.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:54.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:55.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:28.741119+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:55.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:56.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:56.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:56.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:28.741119+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:56.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:57.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:57.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:28.741119+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:21:58.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:21:58.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:21:58.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:21:58.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:21:58.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:21:58.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:21:58.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:21:58.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:57.152219+0000 '>' 2026-02-17T04:21:28.741119+0000 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:637: TEST_auto_repair_bluestore_failed: wait_for_clean 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:21:58.625 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:21:58.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:21:58.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:21:58.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:21:58.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:21:58.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:21:58.880 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:21:58.880 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:21:58.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:21:58.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:58.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:21:58.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051591 2026-02-17T04:21:58.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051591 2026-02-17T04:21:58.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591' 2026-02-17T04:21:58.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:58.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:21:58.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888069 2026-02-17T04:21:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888069 2026-02-17T04:21:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591 1-146028888069' 2026-02-17T04:21:58.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:21:58.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:21:59.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509453 2026-02-17T04:21:59.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509453 2026-02-17T04:21:59.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591 1-146028888069 2-64424509453' 2026-02-17T04:21:59.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:21:59.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051591 2026-02-17T04:21:59.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:21:59.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:21:59.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051591 2026-02-17T04:21:59.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:21:59.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051591 2026-02-17T04:21:59.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051591' 2026-02-17T04:21:59.061 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 124554051591 2026-02-17T04:21:59.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:21:59.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051590 -lt 124554051591 2026-02-17T04:21:59.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:00.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:00.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:00.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051591 -lt 124554051591 2026-02-17T04:22:00.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:00.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888069 2026-02-17T04:22:00.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:00.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:00.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888069 2026-02-17T04:22:00.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888069 2026-02-17T04:22:00.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888069' 2026-02-17T04:22:00.401 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 146028888069 2026-02-17T04:22:00.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:00.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888069 -lt 146028888069 2026-02-17T04:22:00.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:00.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509453 2026-02-17T04:22:00.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:00.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:00.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509453 2026-02-17T04:22:00.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:00.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509453 2026-02-17T04:22:00.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2026-02-17T04:22:00.569 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509453 2026-02-17T04:22:00.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:00.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509453 -lt 64424509453 2026-02-17T04:22:00.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:00.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:00.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:00.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:00.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:00.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:01.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:01.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:01.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:01.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:638: TEST_auto_repair_bluestore_failed: flush_pg_stats 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:01.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:01.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:01.483 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:01.484 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:01.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:01.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:01.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:01.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051593 2026-02-17T04:22:01.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051593 2026-02-17T04:22:01.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051593' 2026-02-17T04:22:01.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:01.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:01.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888070 2026-02-17T04:22:01.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888070 2026-02-17T04:22:01.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051593 1-146028888070' 2026-02-17T04:22:01.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:01.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509454 2026-02-17T04:22:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509454 2026-02-17T04:22:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051593 1-146028888070 2-64424509454' 2026-02-17T04:22:01.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:01.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051593 2026-02-17T04:22:01.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:01.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:01.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051593 2026-02-17T04:22:01.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:01.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051593 2026-02-17T04:22:01.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051593' 2026-02-17T04:22:01.664 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 124554051593 2026-02-17T04:22:01.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:01.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051591 -lt 124554051593 2026-02-17T04:22:01.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:02.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:02.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:03.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051593 -lt 124554051593 2026-02-17T04:22:03.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:03.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888070 2026-02-17T04:22:03.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:03.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:03.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888070 2026-02-17T04:22:03.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:03.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888070 2026-02-17T04:22:03.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888070' 2026-02-17T04:22:03.011 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 146028888070 2026-02-17T04:22:03.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:03.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888071 -lt 146028888070 2026-02-17T04:22:03.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:03.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509454 2026-02-17T04:22:03.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:03.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:03.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509454 2026-02-17T04:22:03.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:03.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509454 2026-02-17T04:22:03.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509454' 2026-02-17T04:22:03.179 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509454 2026-02-17T04:22:03.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:03.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509454 -lt 64424509454 2026-02-17T04:22:03.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:639: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 15 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 20 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:03.347 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-17T04:22:03.348 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:03.348 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-17T04:22:03.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:640: TEST_auto_repair_bluestore_failed: grep -q 'scrub_finish.*still present after re-scrub' td/osd-scrub-repair/osd.1.log 2026-02-17T04:22:03.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:641: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-17T04:22:03.505 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:22:03.505 INFO:tasks.workunit.client.0.trial090.stdout:1.0 10 0 0 0 0 63 0 0 10 0 10 active+clean+inconsistent+failed_repair 2026-02-17T04:21:58.177742+0000 20'10 35:112 [1,0] 1 [1,0] 1 20'10 2026-02-17T04:21:58.177610+0000 20'10 2026-02-17T04:21:58.177610+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:21:58.177610+0000 10 0 2026-02-17T04:22:03.505 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:22:03.505 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:22:03.505 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:22:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:642: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-17T04:22:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:642: TEST_auto_repair_bluestore_failed: grep -q '^1.0.*+failed_repair' 2026-02-17T04:22:03.669 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:22:03.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:646: TEST_auto_repair_bluestore_failed: get_not_primary testpool obj1 2026-02-17T04:22:03.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:22:03.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T04:22:03.678 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-17T04:22:03.679 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:03.679 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:22:03.679 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:22:03.679 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:03.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:22:03.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-17T04:22:03.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:646: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj1 list-attrs 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 list-attrs 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:22:04.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:04.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:04.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:04.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:04.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:04.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:04.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 list-attrs 2026-02-17T04:22:04.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:04.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:04.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:22:04.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:04.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:04.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 list-attrs 2026-02-17T04:22:04.173 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:22:04.173 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:22:04.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:04.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:04.216 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:04.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:04.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:22:04.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:22:04.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:04.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:04.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:04.229 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:04.228+0000 7f9166a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:04.231 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:04.229+0000 7f9166a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:04.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:04.230+0000 7f9166a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:04.350 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:04.348+0000 7f9166a14780 -1 Falling back to public interface 2026-02-17T04:22:04.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:04.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:04.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:04.644 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:04.642+0000 7f9166a14780 -1 osd.0 35 log_to_monitors true 2026-02-17T04:22:05.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:05.551 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:05.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 39 up_thru 31 down_at 36 last_clean_interval [29,35) [v2:127.0.0.1:6800/2303061748,v1:127.0.0.1:6801/2303061748] [v2:127.0.0.1:6802/2303061748,v1:127.0.0.1:6803/2303061748] exists,up dd9e9c7a-4b69-4d51-bc09-63f16eecd100 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:05.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:05.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:05.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:05.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:05.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:05.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:05.971 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:05.972 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:05.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:05.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:05.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:06.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T04:22:06.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T04:22:06.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724546' 2026-02-17T04:22:06.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:06.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:06.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888072 2026-02-17T04:22:06.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888072 2026-02-17T04:22:06.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724546 1-146028888072' 2026-02-17T04:22:06.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:06.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:06.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509456 2026-02-17T04:22:06.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509456 2026-02-17T04:22:06.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724546 1-146028888072 2-64424509456' 2026-02-17T04:22:06.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-167503724546 2026-02-17T04:22:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:06.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:06.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-167503724546 2026-02-17T04:22:06.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:06.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T04:22:06.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 167503724546' 2026-02-17T04:22:06.153 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 167503724546 2026-02-17T04:22:06.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:06.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T04:22:06.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:06.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888072 2026-02-17T04:22:06.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:06.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:06.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888072 2026-02-17T04:22:06.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:06.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888072 2026-02-17T04:22:06.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888072' 2026-02-17T04:22:06.326 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 146028888072 2026-02-17T04:22:06.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:06.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888072 -lt 146028888072 2026-02-17T04:22:06.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:06.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509456 2026-02-17T04:22:06.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:06.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:06.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509456 2026-02-17T04:22:06.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:06.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509456 2026-02-17T04:22:06.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509456' 2026-02-17T04:22:06.497 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509456 2026-02-17T04:22:06.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:06.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509456 -lt 64424509456 2026-02-17T04:22:06.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:06.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:06.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:06.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:06.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:07.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:07.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:07.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:07.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:647: TEST_auto_repair_bluestore_failed: rados --pool testpool get obj1 td/osd-scrub-repair/COPY 2026-02-17T04:22:07.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:648: TEST_auto_repair_bluestore_failed: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:22:07.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:649: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 15 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 20 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:07.270 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-17T04:22:07.271 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:07.271 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-17T04:22:07.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:652: TEST_auto_repair_bluestore_failed: get_primary testpool SOMETHING 2026-02-17T04:22:07.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:07.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:22:07.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:07.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:07.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:652: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 1 obj2 remove 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 remove 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:22:07.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:07.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:07.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:07.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:07.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 remove 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 remove 2026-02-17T04:22:07.643 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-17T04:22:07.643 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:104778fc:::obj2:head# 2026-02-17T04:22:07.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:07.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:07.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:07.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:07.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:07.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:07.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:07.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:07.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:07.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:07.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:22:07.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:07.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:07.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:07.703 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:07.701+0000 7f5db041b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:07.705 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:07.703+0000 7f5db041b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:07.706 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:07.704+0000 7f5db041b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:07.846 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:07.844+0000 7f5db041b780 -1 Falling back to public interface 2026-02-17T04:22:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:22:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:22:07.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:07.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:08.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:08.171 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:08.169+0000 7f5db041b780 -1 osd.1 40 log_to_monitors true 2026-02-17T04:22:09.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:09.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:09.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:09.021 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:09.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:09.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:09.187 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 41 last_clean_interval [34,40) [v2:127.0.0.1:6810/2878240895,v1:127.0.0.1:6811/2878240895] [v2:127.0.0.1:6812/2878240895,v1:127.0.0.1:6813/2878240895] exists,up 3ecc27bf-e151-4da5-8d98-f8ac6ab5fad3 2026-02-17T04:22:09.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:09.188 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:09.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:09.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:09.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:09.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:09.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:09.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:09.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:09.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:09.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:09.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:09.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-17T04:22:09.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-17T04:22:09.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547' 2026-02-17T04:22:09.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:09.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:09.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-17T04:22:09.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-17T04:22:09.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547 1-188978561026' 2026-02-17T04:22:09.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:09.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509458 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509458 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547 1-188978561026 2-64424509458' 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-167503724547 2026-02-17T04:22:09.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:09.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:09.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-167503724547 2026-02-17T04:22:09.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:09.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-17T04:22:09.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 167503724547' 2026-02-17T04:22:09.630 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 167503724547 2026-02-17T04:22:09.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:09.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724547 2026-02-17T04:22:09.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:10.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:10.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:10.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724548 -lt 167503724547 2026-02-17T04:22:10.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:10.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-188978561026 2026-02-17T04:22:10.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:10.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:10.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-188978561026 2026-02-17T04:22:10.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:10.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-17T04:22:10.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 188978561026' 2026-02-17T04:22:10.964 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 188978561026 2026-02-17T04:22:10.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:11.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-17T04:22:11.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:11.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509458 2026-02-17T04:22:11.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:11.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:11.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509458 2026-02-17T04:22:11.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:11.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509458 2026-02-17T04:22:11.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509458' 2026-02-17T04:22:11.136 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509458 2026-02-17T04:22:11.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:11.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509458 -lt 64424509458 2026-02-17T04:22:11.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:11.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:11.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:11.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:653: TEST_auto_repair_bluestore_failed: repair 1.0 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:12.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:12.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T04:22:12.214 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:22:12.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:12.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:22:12.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:12.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:12.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:58.177610+0000 '>' 2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:12.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:13.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:13.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:13.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:13.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:13.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:13.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:13.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:13.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:21:58.177610+0000 '>' 2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:13.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:14.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:14.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:14.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:14.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:14.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:14.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:14.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:14.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:13.148390+0000 '>' 2026-02-17T04:21:58.177610+0000 2026-02-17T04:22:14.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:22:14.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:654: TEST_auto_repair_bluestore_failed: sleep 2 2026-02-17T04:22:16.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:656: TEST_auto_repair_bluestore_failed: flush_pg_stats 2026-02-17T04:22:16.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:16.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:16.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:16.892 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:16.892 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:16.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:16.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:16.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:16.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724550 2026-02-17T04:22:16.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724550 2026-02-17T04:22:16.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724550' 2026-02-17T04:22:16.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:16.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:17.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561028 2026-02-17T04:22:17.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561028 2026-02-17T04:22:17.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724550 1-188978561028' 2026-02-17T04:22:17.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:17.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509460 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509460 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724550 1-188978561028 2-64424509460' 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-167503724550 2026-02-17T04:22:17.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:17.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:17.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-167503724550 2026-02-17T04:22:17.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:17.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724550 2026-02-17T04:22:17.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 167503724550' 2026-02-17T04:22:17.073 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 167503724550 2026-02-17T04:22:17.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:17.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724549 -lt 167503724550 2026-02-17T04:22:17.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:18.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:18.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:18.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724550 -lt 167503724550 2026-02-17T04:22:18.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:18.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-188978561028 2026-02-17T04:22:18.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:18.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:18.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-188978561028 2026-02-17T04:22:18.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:18.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561028 2026-02-17T04:22:18.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 188978561028' 2026-02-17T04:22:18.416 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 188978561028 2026-02-17T04:22:18.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:18.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561029 -lt 188978561028 2026-02-17T04:22:18.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:18.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509460 2026-02-17T04:22:18.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:18.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:18.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509460 2026-02-17T04:22:18.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:18.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509460 2026-02-17T04:22:18.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509460' 2026-02-17T04:22:18.587 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509460 2026-02-17T04:22:18.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:18.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509460 -lt 64424509460 2026-02-17T04:22:18.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:657: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-17T04:22:18.909 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:22:18.909 INFO:tasks.workunit.client.0.trial090.stdout:1.0 9 0 0 0 0 63 0 0 10 0 10 active+clean 2026-02-17T04:22:13.148432+0000 20'10 45:152 [1,0] 1 [1,0] 1 20'10 2026-02-17T04:22:13.148390+0000 20'10 2026-02-17T04:22:13.148390+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:22:13.148390+0000 9 0 2026-02-17T04:22:18.909 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:22:18.909 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:22:18.909 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:22:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:658: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-17T04:22:18.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:658: TEST_auto_repair_bluestore_failed: grep -q -e '^1.0.* active+clean ' -e '^1.0.* active+clean+wait ' 2026-02-17T04:22:19.077 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:22:19.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:659: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:22:19.087 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 15 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 20 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:57.150+0000 7f2590760640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 19 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:21:58.176+0000 7f2594768640 10 osd.1 pg_epoch: 35 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=34/35 n=10 ec=16/16 lis/c=34/34 les/c/f=35/35/0 sis=34) [1,0] r=0 lpr=34 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:22:13.147+0000 7f5d8dd57640 10 osd.1 pg_epoch: 45 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=44/45 n=10 ec=16/16 lis/c=44/44 les/c/f=45/45/0 sis=44) [1,0] r=0 lpr=44 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: repair. deep_scrub_on_error: 0 2026-02-17T04:22:19.088 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:22:13.147+0000 7f5d8dd57640 10 osd.1 pg_epoch: 45 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=44/45 n=10 ec=16/16 lis/c=44/44 les/c/f=45/45/0 sis=44) [1,0] r=0 lpr=44 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:22:19.089 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:22:13.147+0000 7f5d8dd57640 15 osd.1 pg_epoch: 45 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=44/45 n=9 ec=16/16 lis/c=44/44 les/c/f=45/45/0 sis=44) [1,0] r=0 lpr=44 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-17T04:22:19.089 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:22:13.147+0000 7f5d8dd57640 20 osd.1 pg_epoch: 45 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=44/45 n=9 ec=16/16 lis/c=44/44 les/c/f=45/45/0 sis=44) [1,0] r=0 lpr=44 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish All may be fixed 2026-02-17T04:22:19.089 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:22:13.147+0000 7f5d8dd57640 19 osd.1 pg_epoch: 45 pg[1.0( v 20'10 (0'0,20'10] local-lis/les=44/45 n=9 ec=16/16 lis/c=44/44 les/c/f=45/45/0 sis=44) [1,0] r=0 lpr=44 crt=20'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:19.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:19.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:19.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:19.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:22:19.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:22:19.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:22:19.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:22:19.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:22:19.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:22:19.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:22:19.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:22:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:22:19.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:22:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:22:19.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:22:19.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:22:19.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:22:19.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:19.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:19.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:19.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:22:19.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:22:19.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:22:19.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:22:19.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:22:19.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:22:19.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:22:19.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:22:19.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:22:19.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:22:19.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:22:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:22:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:22:19.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:22:19.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:22:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:22:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:22:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:22:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:22:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:22:19.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_failed_norecov td/osd-scrub-repair 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:663: TEST_auto_repair_bluestore_failed_norecov: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:664: TEST_auto_repair_bluestore_failed_norecov: local poolname=testpool 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:667: TEST_auto_repair_bluestore_failed_norecov: run_mon td/osd-scrub-repair a 2026-02-17T04:22:19.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:22:19.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:22:19.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:22:19.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:22:19.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:19.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:22:19.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:22:19.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:22:19.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:22:19.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:22:19.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:22:19.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:22:19.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:22:19.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:22:19.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:22:19.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:22:19.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:22:19.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:22:19.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:22:19.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:22:19.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.319 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:22:19.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:22:19.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:22:19.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:668: TEST_auto_repair_bluestore_failed_norecov: run_mgr td/osd-scrub-repair x 2026-02-17T04:22:19.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:22:19.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:22:19.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:22:19.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:22:19.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:22:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:22:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:19.444 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:19.444 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.444 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:19.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:22:19.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:22:19.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:671: TEST_auto_repair_bluestore_failed_norecov: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:19.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: seq 0 2 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:19.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:19.465 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:19.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:19.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:19.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:22:19.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:19.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:22:19.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:22:19.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:19.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a22880b7-b94d-4c2d-b1be-cdd305e7c7b6' 2026-02-17T04:22:19.468 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:19.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:22:19.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD77JNpyBg4HBAAgQnjIdAp6vftUizMzSepVA== 2026-02-17T04:22:19.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD77JNpyBg4HBAAgQnjIdAp6vftUizMzSepVA=="}' 2026-02-17T04:22:19.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:22:19.553 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:22:19.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:22:19.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQD77JNpyBg4HBAAgQnjIdAp6vftUizMzSepVA== --osd-uuid a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:19.576 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:19.574+0000 7f777f625780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:19.577 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:19.576+0000 7f777f625780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:19.578 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:19.577+0000 7f777f625780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:19.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:19.577+0000 7f777f625780 -1 bdev(0x2f46c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:22:19.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:19.577+0000 7f777f625780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:22:20.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:22:20.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:22:20.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:22:20.016 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:22:20.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:22:20.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:22:20.103 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:22:20.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:20.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:22:20.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:22:20.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:22:20.119 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:20.117+0000 7f1a4b669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:20.120 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:20.118+0000 7f1a4b669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:20.121 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:20.119+0000 7f1a4b669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:22:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:22:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:20.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:20.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:20.182 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:22:20.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:20.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:20.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:20.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:20.322 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:20.320+0000 7f1a4b669780 -1 Falling back to public interface 2026-02-17T04:22:20.750 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:20.748+0000 7f1a4b669780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:22:21.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:21.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:21.263 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:22:21.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:21.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:21.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:21.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:22.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:22.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:22.345 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:22:22.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T04:22:22.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:22.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:22.509 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/515643505,v1:127.0.0.1:6801/515643505] [v2:127.0.0.1:6802/515643505,v1:127.0.0.1:6803/515643505] exists,up a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:22.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:22.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:22.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e3ee09e1-9184-4451-9529-4045de34e046' 2026-02-17T04:22:22.518 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:22.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:22:22.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD+7JNpjm4sHxAA7DvAtNcHIMckSQiKPA3T4A== 2026-02-17T04:22:22.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD+7JNpjm4sHxAA7DvAtNcHIMckSQiKPA3T4A=="}' 2026-02-17T04:22:22.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e3ee09e1-9184-4451-9529-4045de34e046 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:22:22.686 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:22:22.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:22:22.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQD+7JNpjm4sHxAA7DvAtNcHIMckSQiKPA3T4A== --osd-uuid e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:22.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:22.711+0000 7f740fa4e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:22.714 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:22.712+0000 7f740fa4e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:22.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:22.713+0000 7f740fa4e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:22.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:22.713+0000 7f740fa4e780 -1 bdev(0x3be6c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:22:22.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:22.714+0000 7f740fa4e780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:22:23.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:22:23.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:22:23.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:22:23.052 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:22:23.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:22:23.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:22:23.267 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:22:23.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:23.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:22:23.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:22:23.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:22:23.284 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:23.283+0000 7f38ba831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:23.286 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:23.284+0000 7f38ba831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:23.286 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:23.285+0000 7f38ba831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:23.415 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:23.413+0000 7f38ba831780 -1 Falling back to public interface 2026-02-17T04:22:23.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:22:23.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:23.433 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:22:23.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:23.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:23.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:23.737 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:23.735+0000 7f38ba831780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:22:24.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:24.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:24.602 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:22:24.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:24.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:24.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:24.769 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3083635612,v1:127.0.0.1:6811/3083635612] [v2:127.0.0.1:6812/3083635612,v1:127.0.0.1:6813/3083635612] exists,up e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:24.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:24.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:24.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:24.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-17T04:22:24.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:22:24.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:24.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b33f1be8-1c13-4460-9370-4cc64e1f7aef 2026-02-17T04:22:24.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b33f1be8-1c13-4460-9370-4cc64e1f7aef' 2026-02-17T04:22:24.777 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 b33f1be8-1c13-4460-9370-4cc64e1f7aef 2026-02-17T04:22:24.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:22:24.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAA7ZNpbi2dLhAAQnhXLTE2YuHfyJLGBNly2g== 2026-02-17T04:22:24.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAA7ZNpbi2dLhAAQnhXLTE2YuHfyJLGBNly2g=="}' 2026-02-17T04:22:24.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b33f1be8-1c13-4460-9370-4cc64e1f7aef -i td/osd-scrub-repair/2/new.json 2026-02-17T04:22:24.948 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:22:24.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:22:24.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAA7ZNpbi2dLhAAQnhXLTE2YuHfyJLGBNly2g== --osd-uuid b33f1be8-1c13-4460-9370-4cc64e1f7aef 2026-02-17T04:22:24.975 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:24.973+0000 7f1ba37d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:24.976 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:24.974+0000 7f1ba37d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:24.977 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:24.975+0000 7f1ba37d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:24.977 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:24.975+0000 7f1ba37d4780 -1 bdev(0x307cc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:22:24.977 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:24.975+0000 7f1ba37d4780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:22:25.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:22:25.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:22:25.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:22:25.289 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:22:25.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:22:25.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:22:25.504 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:22:25.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:25.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:22:25.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:22:25.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:22:25.519 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:25.517+0000 7fc45c435780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:25.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:25.519+0000 7fc45c435780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:25.521 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:25.520+0000 7fc45c435780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:25.640 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:25.639+0000 7fc45c435780 -1 Falling back to public interface 2026-02-17T04:22:25.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:25.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:22:25.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:25.929 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:25.927+0000 7fc45c435780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:22:27.003 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3483600473,v1:127.0.0.1:6819/3483600473] [v2:127.0.0.1:6820/3483600473,v1:127.0.0.1:6821/3483600473] exists,up b33f1be8-1c13-4460-9370-4cc64e1f7aef 2026-02-17T04:22:27.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:27.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:27.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:27.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:676: TEST_auto_repair_bluestore_failed_norecov: create_pool testpool 1 1 2026-02-17T04:22:27.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-17T04:22:27.216 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:22:27.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:22:28.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:677: TEST_auto_repair_bluestore_failed_norecov: ceph osd pool set testpool size 2 2026-02-17T04:22:28.441 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:678: TEST_auto_repair_bluestore_failed_norecov: wait_for_clean 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:28.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:28.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:28.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:28.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:28.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:28.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:28.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:22:28.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:22:28.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:22:28.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:28.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:28.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:22:28.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:22:28.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:22:28.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:28.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:28.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:22:28.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:22:28.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542146' 2026-02-17T04:22:28.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:28.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:22:28.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:28.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:28.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:22:28.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:28.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:22:28.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:22:28.891 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:22:28.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:29.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:22:29.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:30.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:30.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:30.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:22:30.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:30.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:22:30.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:30.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:30.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:22:30.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:30.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:22:30.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:22:30.225 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:22:30.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:30.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-17T04:22:30.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:30.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:22:30.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:30.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:30.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:22:30.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:30.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:22:30.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:22:30.394 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:22:30.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:30.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-17T04:22:30.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:30.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:30.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:30.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:30.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:30.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:30.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:30.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:30.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:30.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:30.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:30.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:30.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:30.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:30.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:31.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:681: TEST_auto_repair_bluestore_failed_norecov: local payload=ABCDEF 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:682: TEST_auto_repair_bluestore_failed_norecov: echo ABCDEF 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: seq 1 10 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-17T04:22:31.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:22:31.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:691: TEST_auto_repair_bluestore_failed_norecov: get_not_primary testpool SOMETHING 2026-02-17T04:22:31.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:22:31.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:22:31.304 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:22:31.305 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:31.305 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:22:31.305 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:31.305 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:31.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:22:31.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:31.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:691: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:22:31.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:31.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:31.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 remove 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 remove 2026-02-17T04:22:31.842 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:22:31.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:31.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:31.890 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:31.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:22:31.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:22:31.892 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:22:31.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:31.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:22:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:22:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:31.903 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:31.902+0000 7f21f3c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:31.905 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:31.903+0000 7f21f3c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:31.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:31.904+0000 7f21f3c19780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:32.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:22:32.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:32.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:32.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:32.098 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:32.096+0000 7f21f3c19780 -1 Falling back to public interface 2026-02-17T04:22:32.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:32.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:32.384+0000 7f21f3c19780 -1 osd.0 19 log_to_monitors true 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:33.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:33.381 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/4102832382,v1:127.0.0.1:6801/4102832382] [v2:127.0.0.1:6802/4102832382,v1:127.0.0.1:6803/4102832382] exists,up a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:33.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:33.382 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:33.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:33.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:33.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:33.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:33.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-17T04:22:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-17T04:22:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810' 2026-02-17T04:22:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:33.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:33.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:22:33.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:22:33.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-42949672964' 2026-02-17T04:22:33.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:33.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:33.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:22:33.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:22:33.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-42949672964 2-60129542148' 2026-02-17T04:22:33.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:33.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247810 2026-02-17T04:22:33.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:33.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:33.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247810 2026-02-17T04:22:33.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:33.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-17T04:22:33.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247810' 2026-02-17T04:22:33.814 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247810 2026-02-17T04:22:33.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:33.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-17T04:22:33.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:34.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:34.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:35.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-17T04:22:35.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:36.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:22:36.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:36.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-17T04:22:36.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:36.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:22:36.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:36.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:36.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:22:36.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:36.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:22:36.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:22:36.317 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 42949672964 2026-02-17T04:22:36.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:36.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672964 2026-02-17T04:22:36.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:36.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:22:36.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:36.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:36.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:22:36.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:36.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:22:36.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:22:36.490 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542148 2026-02-17T04:22:36.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:36.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:22:36.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:36.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:36.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:36.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:36.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:36.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:37.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:37.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:37.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:37.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:692: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool SOMETHING 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:692: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-17T04:22:37.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:37.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:37.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 rm-attr _ 2026-02-17T04:22:37.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:37.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:37.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:37.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:37.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:37.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:22:37.681 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:37.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:37.693 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:37.691+0000 7f375a23d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:37.694 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:37.692+0000 7f375a23d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:37.695 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:37.693+0000 7f375a23d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:37.839 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:37.837+0000 7f375a23d780 -1 Falling back to public interface 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:37.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:37.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:38.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:38.117 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:38.115+0000 7f375a23d780 -1 osd.1 24 log_to_monitors true 2026-02-17T04:22:39.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:39.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:39.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:39.008 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:39.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:39.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:39.178 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 25 last_clean_interval [10,24) [v2:127.0.0.1:6810/1123042293,v1:127.0.0.1:6811/1123042293] [v2:127.0.0.1:6812/1123042293,v1:127.0.0.1:6813/1123042293] exists,up e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:39.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:39.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:39.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:39.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:39.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:39.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:39.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:39.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:39.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:39.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:39.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:39.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247812 2026-02-17T04:22:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247812 2026-02-17T04:22:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247812' 2026-02-17T04:22:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:39.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:39.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T04:22:39.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T04:22:39.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247812 1-120259084290' 2026-02-17T04:22:39.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:39.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:39.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T04:22:39.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T04:22:39.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247812 1-120259084290 2-60129542150' 2026-02-17T04:22:39.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:39.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247812 2026-02-17T04:22:39.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:39.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:39.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247812 2026-02-17T04:22:39.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:39.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247812 2026-02-17T04:22:39.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247812' 2026-02-17T04:22:39.608 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247812 2026-02-17T04:22:39.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:39.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247812 2026-02-17T04:22:39.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:39.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-17T04:22:39.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:39.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:39.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-17T04:22:39.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:39.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T04:22:39.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-17T04:22:39.775 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084290 2026-02-17T04:22:39.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:39.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 120259084290 2026-02-17T04:22:39.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:40.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:40.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:41.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 120259084290 2026-02-17T04:22:41.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:42.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:22:42.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:42.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T04:22:42.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:42.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T04:22:42.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:42.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:42.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T04:22:42.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:42.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T04:22:42.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T04:22:42.284 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542150 2026-02-17T04:22:42.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T04:22:42.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:42.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:42.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:42.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:42.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:42.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:42.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:42.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:42.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:43.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:43.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:43.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:43.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:694: TEST_auto_repair_bluestore_failed_norecov: get_not_primary testpool SOMETHING 2026-02-17T04:22:43.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:22:43.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:22:43.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:22:43.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:43.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:22:43.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:43.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:43.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:22:43.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:43.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:694: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:43.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:43.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:43.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:22:43.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:43.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:43.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:22:43.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:43.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:43.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-17T04:22:43.586 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:104778fc:::obj2:head# 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:43.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:43.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:43.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:43.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:22:43.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:22:43.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:43.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:43.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:43.639 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:43.638+0000 7fbce0a21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:43.640 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:43.640+0000 7fbce0a21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:43.641 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:43.641+0000 7fbce0a21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:43.775 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:43.775+0000 7fbce0a21780 -1 Falling back to public interface 2026-02-17T04:22:43.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:43.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:43.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:44.049 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:44.049+0000 7fbce0a21780 -1 osd.0 30 log_to_monitors true 2026-02-17T04:22:44.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:44.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:44.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:44.960 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:44.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:44.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 34 up_thru 25 down_at 31 last_clean_interval [23,30) [v2:127.0.0.1:6800/3711188037,v1:127.0.0.1:6801/3711188037] [v2:127.0.0.1:6802/3711188037,v1:127.0.0.1:6803/3711188037] exists,up a22880b7-b94d-4c2d-b1be-cdd305e7c7b6 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:45.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:45.129 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:45.129 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:45.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:45.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:45.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:45.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:45.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:45.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:45.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:45.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:45.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:45.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:45.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888066 2026-02-17T04:22:45.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888066 2026-02-17T04:22:45.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888066' 2026-02-17T04:22:45.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:45.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:45.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084292 2026-02-17T04:22:45.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084292 2026-02-17T04:22:45.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888066 1-120259084292' 2026-02-17T04:22:45.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:45.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888066 1-120259084292 2-60129542152' 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888066 2026-02-17T04:22:45.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:45.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:45.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888066 2026-02-17T04:22:45.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:45.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888066 2026-02-17T04:22:45.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888066' 2026-02-17T04:22:45.563 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 146028888066 2026-02-17T04:22:45.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888066 -lt 146028888066 2026-02-17T04:22:45.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:45.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084292 2026-02-17T04:22:45.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:45.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:45.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084292 2026-02-17T04:22:45.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:45.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084292 2026-02-17T04:22:45.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084292' 2026-02-17T04:22:45.736 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084292 2026-02-17T04:22:45.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:45.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084292 2026-02-17T04:22:45.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:45.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-17T04:22:45.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:45.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:45.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-17T04:22:45.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:45.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-17T04:22:45.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-17T04:22:45.913 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542152 2026-02-17T04:22:45.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:46.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542152 2026-02-17T04:22:46.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:47.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:47.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:47.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542152 2026-02-17T04:22:47.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:48.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:22:48.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-17T04:22:48.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:48.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:48.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:48.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:48.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:48.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:48.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:48.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:49.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:49.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:49.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:49.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:695: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool SOMETHING 2026-02-17T04:22:49.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:49.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:22:49.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:22:49.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:49.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:695: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:22:49.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:22:49.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:22:49.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:22:49.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:22:49.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:22:49.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 rm-attr _ 2026-02-17T04:22:49.376 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-17T04:22:49.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:49.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:22:49.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:22:49.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:22:49.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:22:49.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:22:49.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:22:49.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:22:49.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:22:49.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:22:49.435 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:49.434+0000 7fa701c44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:49.436 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:49.436+0000 7fa701c44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:49.437 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:49.436+0000 7fa701c44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:22:49.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:49.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:49.621 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:49.621+0000 7fa701c44780 -1 Falling back to public interface 2026-02-17T04:22:49.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:22:49.901 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:22:49.900+0000 7fa701c44780 -1 osd.1 35 log_to_monitors true 2026-02-17T04:22:50.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:22:50.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:22:50.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:22:50.758 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:50.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:22:50.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [28,35) [v2:127.0.0.1:6810/4114078744,v1:127.0.0.1:6811/4114078744] [v2:127.0.0.1:6812/4114078744,v1:127.0.0.1:6813/4114078744] exists,up e3ee09e1-9184-4451-9529-4045de34e046 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:22:50.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:22:50.924 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:22:50.925 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:22:50.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:22:50.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:22:50.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:22:51.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:22:51.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:22:51.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:22:51.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:22:51.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:22:51.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:22:51.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:22:51.179 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:22:51.179 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:22:51.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:22:51.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:51.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:22:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888068 2026-02-17T04:22:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888068 2026-02-17T04:22:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888068' 2026-02-17T04:22:51.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:51.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:22:51.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T04:22:51.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T04:22:51.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888068 1-167503724546' 2026-02-17T04:22:51.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:22:51.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:22:51.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-17T04:22:51.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-17T04:22:51.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888068 1-167503724546 2-60129542154' 2026-02-17T04:22:51.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:51.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888068 2026-02-17T04:22:51.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:51.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:22:51.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888068 2026-02-17T04:22:51.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888068 2026-02-17T04:22:51.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888068' 2026-02-17T04:22:51.360 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 146028888068 2026-02-17T04:22:51.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:51.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888067 -lt 146028888068 2026-02-17T04:22:51.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:22:52.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:22:52.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:22:52.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888068 -lt 146028888068 2026-02-17T04:22:52.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:52.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724546 2026-02-17T04:22:52.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:52.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:22:52.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724546 2026-02-17T04:22:52.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:52.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T04:22:52.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724546' 2026-02-17T04:22:52.705 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 167503724546 2026-02-17T04:22:52.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:22:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T04:22:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:22:52.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-17T04:22:52.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:22:52.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:22:52.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-17T04:22:52.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:22:52.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-17T04:22:52.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-17T04:22:52.881 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542154 2026-02-17T04:22:52.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:22:53.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-17T04:22:53.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:22:53.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:53.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:53.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:22:53.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:22:53.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:22:53.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:22:53.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:22:53.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:22:53.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:22:53.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:22:53.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:22:53.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:22:53.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:22:53.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:22:53.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:22:53.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:22:53.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:22:53.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:696: TEST_auto_repair_bluestore_failed_norecov: ceph tell 'osd.*' config set osd_scrub_auto_repair true 2026-02-17T04:22:53.693 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:22:53.693 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:22:53.694 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:22:53.703 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:22:53.703 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:22:53.703 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:22:53.710 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:22:53.711 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-17T04:22:53.711 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:22:53.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:698: TEST_auto_repair_bluestore_failed_norecov: get_pg testpool obj1 2026-02-17T04:22:53.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:22:53.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-17T04:22:53.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-17T04:22:53.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:22:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:698: TEST_auto_repair_bluestore_failed_norecov: local pgid=1.0 2026-02-17T04:22:53.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:699: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool obj1 2026-02-17T04:22:53.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:22:53.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:22:53.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:22:53.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:22:54.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:699: TEST_auto_repair_bluestore_failed_norecov: local primary=1 2026-02-17T04:22:54.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:700: TEST_auto_repair_bluestore_failed_norecov: get_last_scrub_stamp 1.0 2026-02-17T04:22:54.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:54.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:54.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:54.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:54.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:700: TEST_auto_repair_bluestore_failed_norecov: local last_scrub_stamp=2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:54.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:701: TEST_auto_repair_bluestore_failed_norecov: ceph tell 1.0 schedule-deep-scrub 2026-02-17T04:22:54.271 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:22:54.271 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:22:54.271 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:22:54.271 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T23:34:44.270521+0000" 2026-02-17T04:22:54.271 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:704: TEST_auto_repair_bluestore_failed_norecov: wait_for_scrub 1.0 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:54.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:54.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:54.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:54.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:54.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:54.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:54.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:55.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:55.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:55.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:55.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:55.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:55.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:55.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:55.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:55.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:56.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:56.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:56.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:56.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:56.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:56.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:56.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:56.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:56.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:57.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:57.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:57.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:57.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:57.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:57.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:57.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:57.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:57.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:22:58.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:22:58.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:22:58.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:22:58.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:22:58.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:22:58.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:22:58.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:22:59.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:22:59.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:00.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:00.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:00.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:00.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:00.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:00.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:00.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:00.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:23:00.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:01.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:01.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:01.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:01.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:01.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:01.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:01.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:01.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:27.215107+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:23:01.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:02.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:02.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:02.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:02.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:02.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:02.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:02.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:02.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:22:55.754048+0000 '>' 2026-02-17T04:22:27.215107+0000 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:705: TEST_auto_repair_bluestore_failed_norecov: wait_for_clean 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:02.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:02.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:02.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:02.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:02.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:02.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888071 2026-02-17T04:23:02.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888071 2026-02-17T04:23:02.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888071' 2026-02-17T04:23:02.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:02.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:02.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724549 2026-02-17T04:23:02.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724549 2026-02-17T04:23:02.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888071 1-167503724549' 2026-02-17T04:23:02.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:02.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:03.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-17T04:23:03.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-17T04:23:03.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888071 1-167503724549 2-60129542158' 2026-02-17T04:23:03.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:03.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888071 2026-02-17T04:23:03.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:03.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:03.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888071 2026-02-17T04:23:03.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:03.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888071 2026-02-17T04:23:03.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888071' 2026-02-17T04:23:03.059 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 146028888071 2026-02-17T04:23:03.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:03.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888070 -lt 146028888071 2026-02-17T04:23:03.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:04.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:04.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:04.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888071 -lt 146028888071 2026-02-17T04:23:04.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:04.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724549 2026-02-17T04:23:04.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:04.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:04.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724549 2026-02-17T04:23:04.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:04.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724549 2026-02-17T04:23:04.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724549' 2026-02-17T04:23:04.400 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 167503724549 2026-02-17T04:23:04.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:04.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724549 -lt 167503724549 2026-02-17T04:23:04.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:04.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-17T04:23:04.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:04.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:04.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-17T04:23:04.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-17T04:23:04.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-17T04:23:04.577 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542158 2026-02-17T04:23:04.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:04.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542158 2026-02-17T04:23:04.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:04.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:04.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:04.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:04.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:05.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:23:05.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:05.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:05.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:706: TEST_auto_repair_bluestore_failed_norecov: flush_pg_stats 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:05.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:05.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:05.509 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:05.509 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:05.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:05.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:05.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888073 2026-02-17T04:23:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888073 2026-02-17T04:23:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888073' 2026-02-17T04:23:05.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:05.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:05.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724551 2026-02-17T04:23:05.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724551 2026-02-17T04:23:05.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888073 1-167503724551' 2026-02-17T04:23:05.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:05.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542159 2026-02-17T04:23:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542159 2026-02-17T04:23:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888073 1-167503724551 2-60129542159' 2026-02-17T04:23:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:05.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888073 2026-02-17T04:23:05.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:05.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888073 2026-02-17T04:23:05.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888073 2026-02-17T04:23:05.688 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 146028888073 2026-02-17T04:23:05.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888073' 2026-02-17T04:23:05.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:05.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888072 -lt 146028888073 2026-02-17T04:23:05.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:06.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:06.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888072 -lt 146028888073 2026-02-17T04:23:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:08.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:23:08.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:08.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888073 -lt 146028888073 2026-02-17T04:23:08.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:08.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724551 2026-02-17T04:23:08.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:08.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:08.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724551 2026-02-17T04:23:08.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:08.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724551 2026-02-17T04:23:08.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724551' 2026-02-17T04:23:08.199 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 167503724551 2026-02-17T04:23:08.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:08.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724551 -lt 167503724551 2026-02-17T04:23:08.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:08.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542159 2026-02-17T04:23:08.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:08.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:08.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542159 2026-02-17T04:23:08.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:08.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542159 2026-02-17T04:23:08.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542159' 2026-02-17T04:23:08.374 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542159 2026-02-17T04:23:08.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:08.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542160 -lt 60129542159 2026-02-17T04:23:08.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:707: TEST_auto_repair_bluestore_failed_norecov: grep -q 'scrub_finish.*present with no repair possible' td/osd-scrub-repair/osd.1.log 2026-02-17T04:23:08.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:708: TEST_auto_repair_bluestore_failed_norecov: ceph pg dump pgs 2026-02-17T04:23:08.700 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:23:08.700 INFO:tasks.workunit.client.0.trial090.stdout:1.0 10 0 0 0 0 56 0 0 10 0 10 active+clean+inconsistent+failed_repair 2026-02-17T04:22:55.754103+0000 19'10 40:111 [1,0] 1 [1,0] 1 19'10 2026-02-17T04:22:55.754048+0000 19'10 2026-02-17T04:22:55.754048+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:22:55.754048+0000 10 0 2026-02-17T04:23:08.700 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:23:08.700 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:23:08.700 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:08.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:709: TEST_auto_repair_bluestore_failed_norecov: ceph pg dump pgs 2026-02-17T04:23:08.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:709: TEST_auto_repair_bluestore_failed_norecov: grep -q '^1.0.*+failed_repair' 2026-02-17T04:23:08.865 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:08.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:23:08.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:23:08.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:23:08.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:23:08.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:08.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:08.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:08.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:08.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:08.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:23:08.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:23:08.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:23:08.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:23:08.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:23:08.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:23:08.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:08.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:23:08.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:23:08.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:08.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:23:08.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:23:08.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:23:08.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:23:08.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:08.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:08.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:23:08.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:09.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:09.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:09.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:23:09.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:23:09.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:23:09.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:23:09.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:23:09.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:23:09.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:09.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:23:09.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:23:09.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:09.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:23:09.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:23:09.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:23:09.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:23:09.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:23:09.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:23:09.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:23:09.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:23:09.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:23:09.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:23:09.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_scrub td/osd-scrub-repair 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:542: TEST_auto_repair_bluestore_scrub: local dir=td/osd-scrub-repair 2026-02-17T04:23:09.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:543: TEST_auto_repair_bluestore_scrub: local poolname=testpool 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:546: TEST_auto_repair_bluestore_scrub: run_mon td/osd-scrub-repair a 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:23:09.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:09.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:23:09.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:23:09.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:23:09.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:23:09.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:23:09.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.058 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.059 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:23:09.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:23:09.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:23:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:23:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:23:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:23:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:23:09.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:23:09.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:23:09.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:23:09.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:547: TEST_auto_repair_bluestore_scrub: run_mgr td/osd-scrub-repair x 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:23:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:09.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:23:09.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:23:09.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:551: TEST_auto_repair_bluestore_scrub: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:09.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: seq 0 2 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:09.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:09.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:23:09.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:09.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:09.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b44bb781-ba4c-42a6-b231-1a6ebee00e42' 2026-02-17T04:23:09.251 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:09.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAt7ZNpCJsuDxAA4Ia8v4y7yjzQdnpZBUPBZQ== 2026-02-17T04:23:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAt7ZNpCJsuDxAA4Ia8v4y7yjzQdnpZBUPBZQ=="}' 2026-02-17T04:23:09.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b44bb781-ba4c-42a6-b231-1a6ebee00e42 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:23:09.334 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:09.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:23:09.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQAt7ZNpCJsuDxAA4Ia8v4y7yjzQdnpZBUPBZQ== --osd-uuid b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:09.358 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.356+0000 7f7ce522c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.360 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.358+0000 7f7ce522c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.360 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.359+0000 7f7ce522c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.361 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.359+0000 7f7ce522c780 -1 bdev(0x2ca8c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:09.361 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.359+0000 7f7ce522c780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:23:09.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:23:09.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:09.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:23:09.790 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:23:09.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:09.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.892+0000 7f561ee3e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.895 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.893+0000 7f561ee3e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.896 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:09.894+0000 7f561ee3e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:09.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:09.956 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:09.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:09.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:09.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:10.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:10.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:10.090+0000 7f561ee3e780 -1 Falling back to public interface 2026-02-17T04:23:10.542 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:10.540+0000 7f561ee3e780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:23:11.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:11.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:11.037 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:11.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:11.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:11.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:11.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:12.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:12.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:12.122 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:23:12.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T04:23:12.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:12.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:12.285 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/587181196,v1:127.0.0.1:6801/587181196] [v2:127.0.0.1:6802/587181196,v1:127.0.0.1:6803/587181196] exists,up b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:12.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:12.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:12.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:12.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-17T04:23:12.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:23:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eade0e71-e130-4fbf-bc38-190b61688dd9 2026-02-17T04:23:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 eade0e71-e130-4fbf-bc38-190b61688dd9' 2026-02-17T04:23:12.293 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 eade0e71-e130-4fbf-bc38-190b61688dd9 2026-02-17T04:23:12.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:12.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAw7ZNptVnCERAAhuHC/jy4Ex8qztBgtBhdkg== 2026-02-17T04:23:12.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAw7ZNptVnCERAAhuHC/jy4Ex8qztBgtBhdkg=="}' 2026-02-17T04:23:12.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eade0e71-e130-4fbf-bc38-190b61688dd9 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:23:12.463 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:12.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:23:12.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQAw7ZNptVnCERAAhuHC/jy4Ex8qztBgtBhdkg== --osd-uuid eade0e71-e130-4fbf-bc38-190b61688dd9 2026-02-17T04:23:12.489 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:12.487+0000 7f9f7982f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:12.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:12.489+0000 7f9f7982f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:12.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:12.490+0000 7f9f7982f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:12.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:12.490+0000 7f9f7982f780 -1 bdev(0x3ad6c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:12.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:12.490+0000 7f9f7982f780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:23:12.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:23:12.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:12.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:23:12.808 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:23:12.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:13.016 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:23:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:23:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:13.033 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:13.032+0000 7f7302213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:13.035 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:13.033+0000 7f7302213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:13.036 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:13.034+0000 7f7302213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:13.167 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:13.166+0000 7f7302213780 -1 Falling back to public interface 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:13.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:13.185 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:13.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:13.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:23:13.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:13.453 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:13.451+0000 7f7302213780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:23:14.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:14.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:14.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:14.353 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:14.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:14.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:23:14.520 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2008260127,v1:127.0.0.1:6811/2008260127] [v2:127.0.0.1:6812/2008260127,v1:127.0.0.1:6813/2008260127] exists,up eade0e71-e130-4fbf-bc38-190b61688dd9 2026-02-17T04:23:14.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:14.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:14.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:14.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:14.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:14.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:14.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91f297e9-15d3-43d6-8665-541fca8747cf 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 91f297e9-15d3-43d6-8665-541fca8747cf' 2026-02-17T04:23:14.528 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 91f297e9-15d3-43d6-8665-541fca8747cf 2026-02-17T04:23:14.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:14.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAy7ZNpWOPFHxAAm/KbOkkqUAvezmnYKdN3XQ== 2026-02-17T04:23:14.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAy7ZNpWOPFHxAAm/KbOkkqUAvezmnYKdN3XQ=="}' 2026-02-17T04:23:14.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91f297e9-15d3-43d6-8665-541fca8747cf -i td/osd-scrub-repair/2/new.json 2026-02-17T04:23:14.697 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:23:14.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:23:14.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQAy7ZNpWOPFHxAAm/KbOkkqUAvezmnYKdN3XQ== --osd-uuid 91f297e9-15d3-43d6-8665-541fca8747cf 2026-02-17T04:23:14.722 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:14.720+0000 7feac1652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:14.723 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:14.722+0000 7feac1652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:14.724 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:14.722+0000 7feac1652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:14.725 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:14.723+0000 7feac1652780 -1 bdev(0x398cc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:14.725 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:14.723+0000 7feac1652780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:23:15.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:23:15.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:15.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:23:15.045 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:23:15.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:15.258 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:23:15.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:23:15.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:15.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:15.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:15.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:15.274 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:15.272+0000 7fe7f4234780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:15.275 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:15.273+0000 7fe7f4234780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:15.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:15.274+0000 7fe7f4234780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:15.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:23:15.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:15.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:23:15.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:15.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:15.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:15.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:15.432 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:15.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:23:15.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:15.451 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:15.449+0000 7fe7f4234780 -1 Falling back to public interface 2026-02-17T04:23:15.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:15.770 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:15.768+0000 7fe7f4234780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:23:16.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:16.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:16.595 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:23:16.760 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/755462915,v1:127.0.0.1:6819/755462915] [v2:127.0.0.1:6820/755462915,v1:127.0.0.1:6821/755462915] exists,up 91f297e9-15d3-43d6-8665-541fca8747cf 2026-02-17T04:23:16.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:16.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:16.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:16.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:556: TEST_auto_repair_bluestore_scrub: create_pool testpool 1 1 2026-02-17T04:23:16.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-17T04:23:16.973 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:23:16.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:23:17.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:557: TEST_auto_repair_bluestore_scrub: ceph osd pool set testpool size 2 2026-02-17T04:23:18.191 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:23:18.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:558: TEST_auto_repair_bluestore_scrub: wait_for_clean 2026-02-17T04:23:18.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:18.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:18.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:18.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:18.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:18.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:18.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:18.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:18.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:18.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:18.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:18.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:18.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:18.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:18.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:18.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:18.455 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:18.455 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:18.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:18.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:18.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:18.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:23:18.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:23:18.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:23:18.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:18.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-17T04:23:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-17T04:23:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-17T04:23:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:18.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:18.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-60129542146' 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:18.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:18.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:23:18.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:18.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:23:18.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:23:18.638 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:23:18.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:18.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:23:18.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:19.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:19.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:19.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:23:19.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:19.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-17T04:23:19.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:19.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:19.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-17T04:23:19.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-17T04:23:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T04:23:19.981 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672963 2026-02-17T04:23:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:20.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T04:23:20.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:20.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:23:20.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:20.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:20.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:23:20.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:23:20.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:23:20.151 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:23:20.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:20.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-17T04:23:20.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:20.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:20.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:20.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:20.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T04:23:20.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:20.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:20.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T04:23:20.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T04:23:21.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T04:23:21.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:21.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:21.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:21.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:21.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:21.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:21.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:21.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T04:23:21.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:21.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:21.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:21.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T04:23:21.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T04:23:21.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T04:23:21.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T04:23:21.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T04:23:21.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T04:23:21.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T04:23:21.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T04:23:21.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T04:23:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T04:23:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T04:23:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-17T04:23:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T04:23:21.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T04:23:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T04:23:21.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:21.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:21.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:21.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:21.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:21.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:21.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:21.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:23:21.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:21.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:21.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:23:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:23:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:23:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:561: TEST_auto_repair_bluestore_scrub: local payload=ABCDEF 2026-02-17T04:23:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:562: TEST_auto_repair_bluestore_scrub: echo ABCDEF 2026-02-17T04:23:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:563: TEST_auto_repair_bluestore_scrub: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:567: TEST_auto_repair_bluestore_scrub: get_not_primary testpool SOMETHING 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:23:22.208 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:23:22.209 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:22.209 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:23:22.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:23:22.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:22.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:23:22.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:567: TEST_auto_repair_bluestore_scrub: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:23:22.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:22.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:22.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:22.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:22.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:23:22.762 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:23:22.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:22.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:22.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:22.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:23:22.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:23:22.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:23:22.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:23:22.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:23:22.822 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:22.820+0000 7fc43a231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:22.823 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:22.822+0000 7fc43a231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:22.824 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:22.822+0000 7fc43a231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:22.960 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:22.958+0000 7fc43a231780 -1 Falling back to public interface 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:22.974 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:23:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:23.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:23.236 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:23.234+0000 7fc43a231780 -1 osd.0 20 log_to_monitors true 2026-02-17T04:23:24.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:24.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:24.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:24.138 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:24.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:24.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:24.306 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/484584010,v1:127.0.0.1:6801/484584010] [v2:127.0.0.1:6802/484584010,v1:127.0.0.1:6803/484584010] exists,up b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:24.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:24.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:24.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:24.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:24.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:24.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:24.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:24.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:24.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:24.561 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:24.561 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:24.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:24.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:24.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:23:24.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:23:24.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-17T04:23:24.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:24.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:24.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T04:23:24.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T04:23:24.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-42949672966' 2026-02-17T04:23:24.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:24.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:24.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:23:24.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:23:24.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-42949672966 2-60129542148' 2026-02-17T04:23:24.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:24.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-17T04:23:24.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:24.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:24.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-17T04:23:24.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:24.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:23:24.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-17T04:23:24.743 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 103079215106 2026-02-17T04:23:24.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:24.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:23:24.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:25.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:25.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:26.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:23:26.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:26.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T04:23:26.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:26.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:26.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T04:23:26.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:26.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T04:23:26.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T04:23:26.082 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 42949672966 2026-02-17T04:23:26.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:26.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T04:23:26.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:26.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:23:26.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:26.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:26.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:23:26.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:26.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:23:26.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:23:26.255 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542148 2026-02-17T04:23:26.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:26.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:23:26.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:26.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:26.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:26.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:26.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:23:26.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:26.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:26.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:27.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:569: TEST_auto_repair_bluestore_scrub: get_pg testpool SOMETHING 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:23:27.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:27.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:569: TEST_auto_repair_bluestore_scrub: local pgid=1.0 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:570: TEST_auto_repair_bluestore_scrub: get_primary testpool SOMETHING 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:27.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:23:27.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:570: TEST_auto_repair_bluestore_scrub: local primary=1 2026-02-17T04:23:27.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:571: TEST_auto_repair_bluestore_scrub: get_last_scrub_stamp 1.0 2026-02-17T04:23:27.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:27.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:27.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:27.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:27.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:571: TEST_auto_repair_bluestore_scrub: local last_scrub_stamp=2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:27.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:572: TEST_auto_repair_bluestore_scrub: ceph tell 1.0 schedule-scrub 2026-02-17T04:23:27.576 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:23:27.576 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:23:27.576 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:23:27.576 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:23:27.575691+0000" 2026-02-17T04:23:27.576 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:575: TEST_auto_repair_bluestore_scrub: wait_for_scrub 1.0 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:27.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:27.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:27.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:27.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:27.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:27.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:23:16.972064+0000 '>' 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:27.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:28.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:28.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:28.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:23:16.972064+0000 '>' 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:28.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:29.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:29.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:29.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:29.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:29.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:29.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:29.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:30.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:23:16.972064+0000 '>' 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:30.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:31.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:31.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:31.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:31.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:31.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:31.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:23:16.972064+0000 '>' 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:31.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:23:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:23:32.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:23:32.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:23:32.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:23:32.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:23:32.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:23:32.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:23:32.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:23:29.374779+0000 '>' 2026-02-17T04:23:16.972064+0000 2026-02-17T04:23:32.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:23:32.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:576: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-17T04:23:32.568 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:23:32.568 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-17T04:23:29.376321+0000 20'1 25:69 [1,0] 1 [1,0] 1 20'1 2026-02-17T04:23:29.374779+0000 20'1 2026-02-17T04:23:29.374779+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:23:29.374779+0000 1 0 2026-02-17T04:23:32.569 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:23:32.569 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:23:32.569 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:32.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:578: TEST_auto_repair_bluestore_scrub: sleep 2 2026-02-17T04:23:34.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:579: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-17T04:23:34.736 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:23:34.736 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-17T04:23:29.376321+0000 20'1 25:69 [1,0] 1 [1,0] 1 20'1 2026-02-17T04:23:29.374779+0000 20'1 2026-02-17T04:23:29.374779+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:23:29.374779+0000 1 0 2026-02-17T04:23:34.736 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:23:34.737 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:23:34.737 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:34.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:580: TEST_auto_repair_bluestore_scrub: sleep 2 2026-02-17T04:23:36.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:581: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-17T04:23:36.906 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:23:36.906 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-17T04:23:29.376321+0000 20'1 25:69 [1,0] 1 [1,0] 1 20'1 2026-02-17T04:23:29.374779+0000 20'1 2026-02-17T04:23:29.374779+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:23:29.374779+0000 1 0 2026-02-17T04:23:36.906 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:23:36.906 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:23:36.906 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:36.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:582: TEST_auto_repair_bluestore_scrub: sleep 5 2026-02-17T04:23:41.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:583: TEST_auto_repair_bluestore_scrub: wait_for_clean 2026-02-17T04:23:41.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:41.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:41.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:41.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:41.917 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:41.917 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:41.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:41.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:41.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:42.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:42.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:42.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:42.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:42.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:42.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:42.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:42.172 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:42.172 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:42.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:42.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:42.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:42.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-17T04:23:42.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-17T04:23:42.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110' 2026-02-17T04:23:42.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:42.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-17T04:23:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-17T04:23:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-42949672970' 2026-02-17T04:23:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:42.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T04:23:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T04:23:42.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-42949672970 2-60129542153' 2026-02-17T04:23:42.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:42.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215110 2026-02-17T04:23:42.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:42.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:42.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215110 2026-02-17T04:23:42.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:42.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215110 2026-02-17T04:23:42.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215110' 2026-02-17T04:23:42.356 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215110 2026-02-17T04:23:42.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:42.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215110 2026-02-17T04:23:42.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:43.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:43.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:43.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215111 -lt 103079215110 2026-02-17T04:23:43.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:43.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-17T04:23:43.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:43.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:43.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-17T04:23:43.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:43.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-17T04:23:43.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T04:23:43.695 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672970 2026-02-17T04:23:43.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:43.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T04:23:43.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:43.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T04:23:43.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:43.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:43.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T04:23:43.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T04:23:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T04:23:43.864 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542153 2026-02-17T04:23:43.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:44.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T04:23:44.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:44.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:44.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:44.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:23:44.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:44.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:44.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:23:44.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:44.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:44.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:23:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:23:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:23:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:584: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-17T04:23:44.775 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:23:44.776 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-17T04:23:29.376321+0000 20'1 25:69 [1,0] 1 [1,0] 1 20'1 2026-02-17T04:23:29.374779+0000 20'1 2026-02-17T04:23:29.374779+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:23:29.374779+0000 1 0 2026-02-17T04:23:44.776 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:23:44.776 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:23:44.776 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:23:44.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:587: TEST_auto_repair_bluestore_scrub: get_not_primary testpool SOMETHING 2026-02-17T04:23:44.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:23:44.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:23:44.783 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:23:44.784 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:23:44.784 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:23:44.784 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:44.784 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:23:44.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:23:44.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:23:44.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:23:45.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:587: TEST_auto_repair_bluestore_scrub: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:23:45.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:23:45.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:23:45.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:23:45.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:45.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:45.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:45.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:45.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-17T04:23:45.267 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:23:45.267 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:23:45.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:45.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:45.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:23:45.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:23:45.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:23:45.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:23:45.314 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:23:45.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-17T04:23:45.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:23:45.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:23:45.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:23:45.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:23:45.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:23:45.327 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:45.325+0000 7fb64240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:45.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:45.327+0000 7fb64240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:45.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:45.327+0000 7fb64240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:45.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:45.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:45.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:45.500+0000 7fb64240e780 -1 Falling back to public interface 2026-02-17T04:23:45.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:45.815 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:45.813+0000 7fb64240e780 -1 osd.0 25 log_to_monitors true 2026-02-17T04:23:46.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:46.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:46.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:46.643 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:46.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:46.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [24,25) [v2:127.0.0.1:6800/2883805761,v1:127.0.0.1:6801/2883805761] [v2:127.0.0.1:6802/2883805761,v1:127.0.0.1:6803/2883805761] exists,up b44bb781-ba4c-42a6-b231-1a6ebee00e42 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:23:46.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:46.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:46.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:46.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:46.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:46.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:46.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:46.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:46.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:46.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:46.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:46.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:46.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:46.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:46.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:47.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:47.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-17T04:23:47.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-17T04:23:47.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586' 2026-02-17T04:23:47.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:47.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:47.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672972 2026-02-17T04:23:47.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672972 2026-02-17T04:23:47.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-42949672972' 2026-02-17T04:23:47.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:47.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:47.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-17T04:23:47.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-17T04:23:47.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-42949672972 2-60129542155' 2026-02-17T04:23:47.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:47.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051586 2026-02-17T04:23:47.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:47.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:47.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051586 2026-02-17T04:23:47.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:47.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-17T04:23:47.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051586' 2026-02-17T04:23:47.254 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 124554051586 2026-02-17T04:23:47.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:47.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-17T04:23:47.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:47.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672972 2026-02-17T04:23:47.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:47.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:47.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672972 2026-02-17T04:23:47.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:47.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672972 2026-02-17T04:23:47.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-17T04:23:47.423 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 42949672972 2026-02-17T04:23:47.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:47.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-17T04:23:47.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:47.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-17T04:23:47.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:47.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:47.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-17T04:23:47.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:47.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-17T04:23:47.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-17T04:23:47.592 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542155 2026-02-17T04:23:47.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:47.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-17T04:23:47.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:47.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:47.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:23:47.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:23:47.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:23:48.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:23:48.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:23:48.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:48.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:23:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:23:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:23:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:23:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:588: TEST_auto_repair_bluestore_scrub: rados --pool testpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:23:48.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:589: TEST_auto_repair_bluestore_scrub: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:23:48.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:590: TEST_auto_repair_bluestore_scrub: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:28.385+0000 7f72e3b57640 10 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular,deep-scrub-on-error)] scrubber: scrub_finish before flags: DEEP_SCRUB_ON_ERROR. repair state: no-repair. deep_scrub_on_error: 1 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:28.385+0000 7f72e3b57640 10 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular,deep-scrub-on-error)] scrubber: scrub_finish: will initiate a deep scrub to fix 1 errors 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:28.385+0000 7f72e3b57640 10 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:29.373+0000 7f72e3b57640 10 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+repair(repairing,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: repair. deep_scrub_on_error: 0 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:29.373+0000 7f72e3b57640 10 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+repair(repairing,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:29.373+0000 7f72e3b57640 15 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-17T04:23:48.366 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:29.373+0000 7f72e3b57640 20 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-17T04:23:48.367 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:23:29.373+0000 7f72e3b57640 19 osd.1 pg_epoch: 25 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:23:48.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: ceph pg 1.0 query 2026-02-17T04:23:48.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: jq .info.stats.stat_sum.num_objects_repaired 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: COUNT=1 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:594: TEST_auto_repair_bluestore_scrub: test 1 = 1 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:48.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:48.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:48.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:48.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:48.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:48.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:23:48.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:23:48.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:23:48.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:23:48.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:23:48.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:23:48.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:48.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:23:48.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:23:48.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:48.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:23:48.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:23:48.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:23:48.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:23:48.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:23:48.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:23:48.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:23:48.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:23:48.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:23:48.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:23:48.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:23:48.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:23:48.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:23:48.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:23:48.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:23:48.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:23:48.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:48.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:23:48.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:23:48.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:23:48.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:23:48.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:23:48.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:23:48.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:23:48.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:23:48.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:23:48.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:23:48.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:23:48.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:23:48.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:23:48.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:23:48.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:23:48.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:23:48.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_tag td/osd-scrub-repair 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:443: TEST_auto_repair_bluestore_tag: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:444: TEST_auto_repair_bluestore_tag: local poolname=testpool 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:447: TEST_auto_repair_bluestore_tag: run_mon td/osd-scrub-repair a 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:23:48.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:23:48.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:48.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:23:48.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:23:48.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:23:48.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:23:48.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:23:48.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:23:48.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:23:48.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:23:48.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:23:48.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:23:48.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:23:48.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:23:48.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:23:48.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:23:48.653 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:23:48.653 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:23:48.653 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:23:48.653 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:23:48.654 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.654 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.654 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:23:48.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:23:48.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:23:48.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:448: TEST_auto_repair_bluestore_tag: run_mgr td/osd-scrub-repair x 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:23:48.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:48.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:23:48.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:23:48.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:455: TEST_auto_repair_bluestore_tag: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:23:48.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: seq 0 2 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:23:48.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:48.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:48.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:23:48.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:48.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:23:48.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a3eda605-a49d-4d78-a95a-2a63af8172e7' 2026-02-17T04:23:48.800 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:23:48.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:48.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBU7ZNpFMcNMBAAtXA70qYBEZb/4/5XcFXEaA== 2026-02-17T04:23:48.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBU7ZNpFMcNMBAAtXA70qYBEZb/4/5XcFXEaA=="}' 2026-02-17T04:23:48.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3eda605-a49d-4d78-a95a-2a63af8172e7 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:23:48.889 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:48.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:23:48.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBU7ZNpFMcNMBAAtXA70qYBEZb/4/5XcFXEaA== --osd-uuid a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:23:48.914 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:48.912+0000 7f19db9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:48.915 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:48.914+0000 7f19db9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:48.916 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:48.915+0000 7f19db9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:48.917 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:48.915+0000 7f19db9fd780 -1 bdev(0x32acc00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:48.917 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:48.915+0000 7f19db9fd780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:23:49.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:23:49.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:49.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:23:49.308 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:23:49.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:49.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:23:49.395 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:23:49.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:49.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:49.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:49.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:49.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:49.409+0000 7f84ce20a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:49.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:49.410+0000 7f84ce20a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:49.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:49.411+0000 7f84ce20a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:49.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:49.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:49.611 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:49.609+0000 7f84ce20a780 -1 Falling back to public interface 2026-02-17T04:23:49.966 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:49.964+0000 7f84ce20a780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:50.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:23:50.641 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/561676600,v1:127.0.0.1:6801/561676600] [v2:127.0.0.1:6802/561676600,v1:127.0.0.1:6803/561676600] exists,up a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:50.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:50.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:23:50.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:23:50.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:50.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a60aaf3d-e706-4b9f-bb12-2fc26ea94385 2026-02-17T04:23:50.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a60aaf3d-e706-4b9f-bb12-2fc26ea94385' 2026-02-17T04:23:50.647 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 a60aaf3d-e706-4b9f-bb12-2fc26ea94385 2026-02-17T04:23:50.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:50.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBW7ZNp2Fv9JhAA2GVoyANsfqGem3H6jU7elw== 2026-02-17T04:23:50.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBW7ZNp2Fv9JhAA2GVoyANsfqGem3H6jU7elw=="}' 2026-02-17T04:23:50.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a60aaf3d-e706-4b9f-bb12-2fc26ea94385 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:23:50.736 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:50.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:23:50.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBW7ZNp2Fv9JhAA2GVoyANsfqGem3H6jU7elw== --osd-uuid a60aaf3d-e706-4b9f-bb12-2fc26ea94385 2026-02-17T04:23:50.762 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:50.760+0000 7f45d3067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:50.764 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:50.762+0000 7f45d3067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:50.765 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:50.763+0000 7f45d3067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:50.765 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:50.763+0000 7f45d3067780 -1 bdev(0x4198c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:50.765 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:50.763+0000 7f45d3067780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:23:51.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:23:51.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:51.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:23:51.114 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:23:51.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:23:51.339 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:23:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:51.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:51.354 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:51.353+0000 7fe171c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:51.356 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:51.354+0000 7fe171c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:51.356 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:51.355+0000 7fe171c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:51.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:51.493+0000 7fe171c0d780 -1 Falling back to public interface 2026-02-17T04:23:51.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:51.507 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:51.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:51.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:23:51.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:51.809 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:51.807+0000 7fe171c0d780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:23:52.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:52.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:52.669 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:52.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:52.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:52.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:23:52.831 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/436326846,v1:127.0.0.1:6811/436326846] [v2:127.0.0.1:6812/436326846,v1:127.0.0.1:6813/436326846] exists,up a60aaf3d-e706-4b9f-bb12-2fc26ea94385 2026-02-17T04:23:52.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:52.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:52.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:23:52.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:23:52.837 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:23:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=01587179-a65c-4ef7-a548-7c820aad425e 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 01587179-a65c-4ef7-a548-7c820aad425e' 2026-02-17T04:23:52.839 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 01587179-a65c-4ef7-a548-7c820aad425e 2026-02-17T04:23:52.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:23:52.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBY7ZNpaYNWMhAA3vOP1Y1NQYfK68cuc8eQXg== 2026-02-17T04:23:52.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBY7ZNpaYNWMhAA3vOP1Y1NQYfK68cuc8eQXg=="}' 2026-02-17T04:23:52.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 01587179-a65c-4ef7-a548-7c820aad425e -i td/osd-scrub-repair/2/new.json 2026-02-17T04:23:53.008 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:23:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:23:53.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBY7ZNpaYNWMhAA3vOP1Y1NQYfK68cuc8eQXg== --osd-uuid 01587179-a65c-4ef7-a548-7c820aad425e 2026-02-17T04:23:53.034 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.033+0000 7f99a361f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.035 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.035+0000 7f99a361f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.036 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.036+0000 7f99a361f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.037 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.036+0000 7f99a361f780 -1 bdev(0x401ec00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:23:53.037 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.036+0000 7f99a361f780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:23:53.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:23:53.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:23:53.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:23:53.372 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:23:53.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:23:53.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:23:53.581 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:23:53.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:23:53.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:23:53.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:23:53.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:23:53.597 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.596+0000 7f49d7034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.598 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.598+0000 7f49d7034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.599 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.598+0000 7f49d7034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:23:53.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:23:53.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:23:53.763 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:53.762+0000 7f49d7034780 -1 Falling back to public interface 2026-02-17T04:23:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:23:54.069 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:23:54.068+0000 7f49d7034780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:23:54.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:23:54.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:23:54.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:23:54.920 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:23:54.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:23:54.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:23:55.083 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2201846311,v1:127.0.0.1:6819/2201846311] [v2:127.0.0.1:6820/2201846311,v1:127.0.0.1:6821/2201846311] exists,up 01587179-a65c-4ef7-a548-7c820aad425e 2026-02-17T04:23:55.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:23:55.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:23:55.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:23:55.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:460: TEST_auto_repair_bluestore_tag: create_pool testpool 1 1 2026-02-17T04:23:55.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-17T04:23:55.300 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:23:55.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:23:56.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:461: TEST_auto_repair_bluestore_tag: ceph osd pool set testpool size 2 2026-02-17T04:23:56.517 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:23:56.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:462: TEST_auto_repair_bluestore_tag: wait_for_clean 2026-02-17T04:23:56.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:23:56.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:23:56.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:23:56.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:23:56.527 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:23:56.527 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:23:56.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:23:56.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:23:56.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:23:56.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:23:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:23:56.775 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:23:56.775 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:23:56.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:23:56.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:56.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:23:56.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:23:56.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:23:56.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:23:56.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:56.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:23:56.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-17T04:23:56.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-17T04:23:56.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666' 2026-02-17T04:23:56.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:23:56.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:23:56.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T04:23:56.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T04:23:56.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666 2-55834574851' 2026-02-17T04:23:56.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:56.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:23:56.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:56.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:23:56.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:23:56.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:56.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:23:56.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:23:56.954 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:23:56.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:23:57.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:23:57.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:57.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-17T04:23:57.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:57.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:23:57.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-17T04:23:57.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:57.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-17T04:23:57.124 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705666 2026-02-17T04:23:57.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-17T04:23:57.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705665 -lt 38654705666 2026-02-17T04:23:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:58.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:23:58.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:58.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705665 -lt 38654705666 2026-02-17T04:23:58.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:23:59.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:23:59.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:23:59.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705666 2026-02-17T04:23:59.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:23:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-17T04:23:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:23:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:23:59.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-17T04:23:59.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:23:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T04:23:59.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T04:23:59.624 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574851 2026-02-17T04:23:59.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:23:59.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T04:23:59.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:23:59.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:23:59.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:00.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:00.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:24:00.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:00.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:00.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:00.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:24:00.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:00.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:00.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:465: TEST_auto_repair_bluestore_tag: local payload=ABCDEF 2026-02-17T04:24:00.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:466: TEST_auto_repair_bluestore_tag: echo ABCDEF 2026-02-17T04:24:00.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:467: TEST_auto_repair_bluestore_tag: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:24:00.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:471: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:00.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:24:00.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:24:00.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:00.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:471: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:00.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:00.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:00.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:00.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:00.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:00.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:24:00.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:24:00.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:24:00.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:24:00.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:24:00.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:00.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:24:00.943 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:24:00.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:00.984 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:24:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:24:00.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:24:00.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:24:00.986 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:24:00.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:00.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:24:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:24:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:24:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:24:00.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:24:00.997 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:00.996+0000 7f43b442d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:00.998 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:00.998+0000 7f43b442d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:00.999 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:00.998+0000 7f43b442d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:01.128 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:01.127+0000 7f43b442d780 -1 Falling back to public interface 2026-02-17T04:24:01.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:24:01.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:01.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:01.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:01.404 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:01.403+0000 7f43b442d780 -1 osd.0 18 log_to_monitors true 2026-02-17T04:24:02.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:02.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:02.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:02.312 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:02.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:02.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 22 up_thru 0 down_at 19 last_clean_interval [5,18) [v2:127.0.0.1:6800/3138210277,v1:127.0.0.1:6801/3138210277] [v2:127.0.0.1:6802/3138210277,v1:127.0.0.1:6803/3138210277] exists,up a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:02.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:02.481 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:02.482 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:02.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:02.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:02.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:02.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:02.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:02.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280514 2026-02-17T04:24:02.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280514 2026-02-17T04:24:02.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280514' 2026-02-17T04:24:02.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:02.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:02.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:24:02.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:24:02.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280514 1-38654705668' 2026-02-17T04:24:02.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:02.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:02.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-17T04:24:02.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-17T04:24:02.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280514 1-38654705668 2-55834574853' 2026-02-17T04:24:02.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:02.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-94489280514 2026-02-17T04:24:02.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:02.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:02.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-94489280514 2026-02-17T04:24:02.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:02.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280514 2026-02-17T04:24:02.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 94489280514' 2026-02-17T04:24:02.920 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 94489280514 2026-02-17T04:24:02.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:03.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280514 -lt 94489280514 2026-02-17T04:24:03.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:03.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:24:03.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:03.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:03.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:24:03.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:03.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:24:03.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:24:03.088 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705668 2026-02-17T04:24:03.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705668 2026-02-17T04:24:03.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:04.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:04.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:04.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705668 2026-02-17T04:24:04.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:05.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:05.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705668 2026-02-17T04:24:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:05.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574853 2026-02-17T04:24:05.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:05.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:05.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574853 2026-02-17T04:24:05.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:05.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574853 2026-02-17T04:24:05.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574853' 2026-02-17T04:24:05.599 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574853 2026-02-17T04:24:05.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-17T04:24:05.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:05.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:05.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:05.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:05.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:06.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:24:06.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:06.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:06.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:473: TEST_auto_repair_bluestore_tag: get_pg testpool SOMETHING 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:24:06.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:06.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:24:06.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:473: TEST_auto_repair_bluestore_tag: local pgid=1.0 2026-02-17T04:24:06.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:474: TEST_auto_repair_bluestore_tag: get_primary testpool SOMETHING 2026-02-17T04:24:06.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:24:06.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:24:06.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:06.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:24:06.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:474: TEST_auto_repair_bluestore_tag: local primary=1 2026-02-17T04:24:06.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:475: TEST_auto_repair_bluestore_tag: echo 'Affected PG ' 1.0 ' w/ primary ' 1 2026-02-17T04:24:06.684 INFO:tasks.workunit.client.0.trial090.stdout:Affected PG 1.0 w/ primary 1 2026-02-17T04:24:06.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:476: TEST_auto_repair_bluestore_tag: get_last_scrub_stamp 1.0 2026-02-17T04:24:06.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:24:06.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:06.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:06.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:24:06.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:476: TEST_auto_repair_bluestore_tag: local last_scrub_stamp=2026-02-17T04:23:55.298889+0000 2026-02-17T04:24:06.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:477: TEST_auto_repair_bluestore_tag: initiate_and_fetch_state 1 1.0 3.0 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:382: initiate_and_fetch_state: local the_osd=osd.1 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:383: initiate_and_fetch_state: local pgid=1.0 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:384: initiate_and_fetch_state: get_last_scrub_stamp 1.0 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:06.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:24:07.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:384: initiate_and_fetch_state: local last_scrub=2026-02-17T04:23:55.298889+0000 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:386: initiate_and_fetch_state: set_config osd 1 osd_scrub_sleep 3.0 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_sleep 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=3.0 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:24:07.026 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:07.027 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:07.027 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:07.027 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:24:07.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set osd_scrub_sleep 3.0 2026-02-17T04:24:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:24:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:387: initiate_and_fetch_state: set_config osd 1 osd_scrub_auto_repair true 2026-02-17T04:24:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:24:07.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:24:07.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_auto_repair 2026-02-17T04:24:07.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:24:07.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:24:07.076 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:24:07.076 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:24:07.076 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:24:07.076 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:07.076 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:07.077 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:07.077 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:24:07.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set osd_scrub_auto_repair true 2026-02-17T04:24:07.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:24:07.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:389: initiate_and_fetch_state: flush_pg_stats 2026-02-17T04:24:07.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:07.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:07.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:07.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280516 2026-02-17T04:24:07.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280516 2026-02-17T04:24:07.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280516' 2026-02-17T04:24:07.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:07.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:07.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T04:24:07.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T04:24:07.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280516 1-38654705670' 2026-02-17T04:24:07.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:07.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280516 1-38654705670 2-55834574855' 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-94489280516 2026-02-17T04:24:07.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:07.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:07.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:07.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-94489280516 2026-02-17T04:24:07.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280516 2026-02-17T04:24:07.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 94489280516' 2026-02-17T04:24:07.470 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 94489280516 2026-02-17T04:24:07.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:07.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280515 -lt 94489280516 2026-02-17T04:24:07.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:08.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:08.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:08.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280515 -lt 94489280516 2026-02-17T04:24:08.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:09.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:09.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:09.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280516 -lt 94489280516 2026-02-17T04:24:09.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:09.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T04:24:09.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:09.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:09.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T04:24:09.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:09.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T04:24:09.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T04:24:09.977 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705670 2026-02-17T04:24:09.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:10.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-17T04:24:10.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:10.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-17T04:24:10.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:10.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:10.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-17T04:24:10.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:10.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-17T04:24:10.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-17T04:24:10.145 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574855 2026-02-17T04:24:10.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:10.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-17T04:24:10.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:390: initiate_and_fetch_state: date --rfc-3339=ns 2026-02-17T04:24:10.312 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17 04:24:10.312298506+00:00 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:393: initiate_and_fetch_state: get_asok_path osd.1 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:10.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:24:10.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:393: initiate_and_fetch_state: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok schedule-deep-scrub 1.0 2026-02-17T04:24:10.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i=0 )) 2026-02-17T04:24:10.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:10.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:10.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:10.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:10.424 INFO:tasks.workunit.client.0.trial090.stdout:{"deep":true,"must":false,"stamp":"2026-02-05T23:36:00.360244+0000"}0 ) state now: "active+clean" 2026-02-17T04:24:10.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 0 ') state now: ' '"active+clean"' 2026-02-17T04:24:10.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:10.425 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:10.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:10.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 0 == 4 ']' 2026-02-17T04:24:10.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:10.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:10.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:10.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:10.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:10.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:10.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 1 ') state now: ' '"active+clean"' 2026-02-17T04:24:10.788 INFO:tasks.workunit.client.0.trial090.stdout:1 ) state now: "active+clean" 2026-02-17T04:24:10.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:10.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:10.789 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:10.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 1 == 4 ']' 2026-02-17T04:24:10.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:11.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:11.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:11.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:11.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:11.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:11.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 2 ') state now: ' '"active+clean"' 2026-02-17T04:24:11.151 INFO:tasks.workunit.client.0.trial090.stdout:2 ) state now: "active+clean" 2026-02-17T04:24:11.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:11.152 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:11.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:11.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 2 == 4 ']' 2026-02-17T04:24:11.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:11.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:11.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:11.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:11.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:11.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:11.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 3 ') state now: ' '"active+clean"' 2026-02-17T04:24:11.514 INFO:tasks.workunit.client.0.trial090.stdout:3 ) state now: "active+clean" 2026-02-17T04:24:11.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:11.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:11.515 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:11.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 3 == 4 ']' 2026-02-17T04:24:11.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:11.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:11.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:11.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:11.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:11.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 4 ') state now: ' '"active+clean"' 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stdout:4 ) state now: "active+clean" 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 4 == 4 ']' 2026-02-17T04:24:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:410: initiate_and_fetch_state: echo 'loop --------> ' 4 2026-02-17T04:24:11.877 INFO:tasks.workunit.client.0.trial090.stdout:loop --------> 4 2026-02-17T04:24:11.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:12.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:12.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:12.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:12.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:12.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:12.238 INFO:tasks.workunit.client.0.trial090.stdout:5 ) state now: "active+clean" 2026-02-17T04:24:12.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 5 ') state now: ' '"active+clean"' 2026-02-17T04:24:12.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:12.239 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:12.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:12.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 5 == 4 ']' 2026-02-17T04:24:12.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:12.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:12.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:12.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:12.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:12.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-17T04:24:12.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 6 ') state now: ' '"active+clean"' 2026-02-17T04:24:12.600 INFO:tasks.workunit.client.0.trial090.stdout:6 ) state now: "active+clean" 2026-02-17T04:24:12.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:12.600 INFO:tasks.workunit.client.0.trial090.stdout:"active+clean" 2026-02-17T04:24:12.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-17T04:24:12.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 6 == 4 ']' 2026-02-17T04:24:12.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-17T04:24:12.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-17T04:24:12.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-17T04:24:12.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-17T04:24:12.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-17T04:24:12.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:12.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 7 ') state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:12.961 INFO:tasks.workunit.client.0.trial090.stdout:7 ) state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-17T04:24:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:403: initiate_and_fetch_state: echo 'found scrub' 2026-02-17T04:24:12.962 INFO:tasks.workunit.client.0.trial090.stdout:found scrub 2026-02-17T04:24:12.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:403: initiate_and_fetch_state: return 0 2026-02-17T04:24:12.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:478: TEST_auto_repair_bluestore_tag: r=0 2026-02-17T04:24:12.963 INFO:tasks.workunit.client.0.trial090.stdout:initiate_and_fetch_state ret: 0 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:479: TEST_auto_repair_bluestore_tag: echo 'initiate_and_fetch_state ret: ' 0 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:480: TEST_auto_repair_bluestore_tag: set_config osd td/osd-scrub-repair osd_scrub_sleep 0 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=td/osd-scrub-repair 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_sleep 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=0 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.td/osd-scrub-repair 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.td/osd-scrub-repair 2026-02-17T04:24:12.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.td/osd-scrub-repair ']' 2026-02-17T04:24:12.966 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:12.966 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:12.966 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:12.966 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.td/osd-scrub-repair.asok 2026-02-17T04:24:12.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.td/osd-scrub-repair.asok config set osd_scrub_sleep 0 2026-02-17T04:24:13.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test == true 2026-02-17T04:24:13.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh: line 1159: test: ==: unary operator expected 2026-02-17T04:24:13.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:481: TEST_auto_repair_bluestore_tag: '[' 0 -ne 0 ']' 2026-02-17T04:24:13.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:485: TEST_auto_repair_bluestore_tag: wait_end_of_scrub 1 1.0 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:420: wait_end_of_scrub: local the_osd=osd.1 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:421: wait_end_of_scrub: local pgid=1.0 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i=0 )) 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:13.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:13.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.060 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:13.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:13.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 0 == 4 ']' 2026-02-17T04:24:13.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-17T04:24:13.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-17T04:24:13.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:13.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:13.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:13.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.425 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 1 == 4 ']' 2026-02-17T04:24:13.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-17T04:24:13.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-17T04:24:13.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:13.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:13.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:13.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.790 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:13.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:13.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:13.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 2 == 4 ']' 2026-02-17T04:24:13.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-17T04:24:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-17T04:24:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:14.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:14.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:14.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:14.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:14.152 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:14.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:14.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 3 == 4 ']' 2026-02-17T04:24:14.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-17T04:24:14.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-17T04:24:14.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:14.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:14.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:14.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-17T04:24:14.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-17T04:24:14.516 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-17T04:24:14.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:14.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 4 == 4 ']' 2026-02-17T04:24:14.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:428: wait_end_of_scrub: flush_pg_stats 2026-02-17T04:24:14.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:14.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:14.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:14.682 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:14.682 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:14.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:14.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:14.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:14.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280518 2026-02-17T04:24:14.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280518 2026-02-17T04:24:14.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280518' 2026-02-17T04:24:14.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:14.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:14.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-17T04:24:14.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-17T04:24:14.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280518 1-38654705673' 2026-02-17T04:24:14.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:14.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-94489280518 1-38654705673 2-55834574857' 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-94489280518 2026-02-17T04:24:14.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:14.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:14.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-94489280518 2026-02-17T04:24:14.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:14.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280518 2026-02-17T04:24:14.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 94489280518' 2026-02-17T04:24:14.863 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 94489280518 2026-02-17T04:24:14.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:15.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280518 -lt 94489280518 2026-02-17T04:24:15.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:15.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-17T04:24:15.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:15.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:15.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-17T04:24:15.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:15.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-17T04:24:15.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-17T04:24:15.031 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705673 2026-02-17T04:24:15.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:15.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-17T04:24:15.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:15.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-17T04:24:15.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:15.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:15.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-17T04:24:15.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:15.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-17T04:24:15.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-17T04:24:15.204 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574857 2026-02-17T04:24:15.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:15.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574857 2026-02-17T04:24:15.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:16.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:16.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:16.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574857 2026-02-17T04:24:16.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:17.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:17.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:17.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574857 2026-02-17T04:24:17.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-17T04:24:18.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-17T04:24:18.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-17T04:24:18.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-17T04:24:18.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-17T04:24:18.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean"' 2026-02-17T04:24:18.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean"' 2026-02-17T04:24:18.072 INFO:tasks.workunit.client.0.trial090.stdout:wait-scrub-end state now: "active+clean" 2026-02-17T04:24:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: break 2026-02-17T04:24:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:433: wait_end_of_scrub: [[ "active+clean" =~ (.*scrubbing.*) ]] 2026-02-17T04:24:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:438: wait_end_of_scrub: return 0 2026-02-17T04:24:18.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:486: TEST_auto_repair_bluestore_tag: ceph pg dump pgs 2026-02-17T04:24:18.228 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:24:18.228 INFO:tasks.workunit.client.0.trial090.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean+scrubbing+deep 2026-02-17T04:24:12.646374+0000 18'1 24:54 [1,0] 1 [1,0] 1 0'0 2026-02-17T04:23:55.298889+0000 0'0 2026-02-05T23:36:00.360244+0000 0 0 deep scrubbing for 1s 0 0 2026-02-17T04:24:18.229 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:24:18.229 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:24:18.229 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:490: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:24:18.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:24:18.238 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:18.238 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:24:18.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:24:18.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:18.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:490: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:24:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:18.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:18.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:24:18.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:24:18.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:24:18.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:24:18.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:24:18.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:18.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-17T04:24:18.725 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:24:18.725 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:24:18.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:18.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:18.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:24:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:24:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:24:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:24:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:24:18.782 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:18.780+0000 7f8ada832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:18.783 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:18.781+0000 7f8ada832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:18.784 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:18.782+0000 7f8ada832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:18.926 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:18.924+0000 7f8ada832780 -1 Falling back to public interface 2026-02-17T04:24:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:24:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:18.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:18.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:19.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:19.228 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:19.226+0000 7f8ada832780 -1 osd.0 25 log_to_monitors true 2026-02-17T04:24:20.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:20.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:20.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:20.103 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:20.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:20.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:20.272 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 28 up_thru 0 down_at 25 last_clean_interval [22,25) [v2:127.0.0.1:6800/375418979,v1:127.0.0.1:6801/375418979] [v2:127.0.0.1:6802/375418979,v1:127.0.0.1:6803/375418979] exists,up a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:24:20.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:20.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:20.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:20.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:20.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:20.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:20.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:20.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:20.522 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:20.522 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:20.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:20.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:20.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:20.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T04:24:20.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T04:24:20.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290' 2026-02-17T04:24:20.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:20.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:20.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705675 2026-02-17T04:24:20.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705675 2026-02-17T04:24:20.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290 1-38654705675' 2026-02-17T04:24:20.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:20.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574860 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574860 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290 1-38654705675 2-55834574860' 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084290 2026-02-17T04:24:20.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:20.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:20.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084290 2026-02-17T04:24:20.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:20.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T04:24:20.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084290' 2026-02-17T04:24:20.700 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 120259084290 2026-02-17T04:24:20.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280519 -lt 120259084290 2026-02-17T04:24:20.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:21.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:21.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:22.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T04:24:22.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:22.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705675 2026-02-17T04:24:22.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:22.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:22.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705675 2026-02-17T04:24:22.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:22.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705675 2026-02-17T04:24:22.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-17T04:24:22.041 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705675 2026-02-17T04:24:22.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705675 2026-02-17T04:24:22.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:22.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574860 2026-02-17T04:24:22.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:22.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:22.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574860 2026-02-17T04:24:22.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574860 2026-02-17T04:24:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574860' 2026-02-17T04:24:22.210 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574860 2026-02-17T04:24:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:22.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574860 -lt 55834574860 2026-02-17T04:24:22.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:22.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:22.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:22.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:22.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:24:22.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:22.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:22.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:491: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:24:22.973 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-17T04:24:22.974 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:24:22.974 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:24:22.974 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:22.974 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:24:23.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:24:23.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-17T04:24:23.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:24:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:491: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:24:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:24:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:24:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:23.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:23.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:23.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:24:23.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-17T04:24:23.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:24:23.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:24:23.518 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:24:23.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-17T04:24:23.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:24:23.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:24:23.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:24:23.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:24:23.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:24:23.535 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:23.533+0000 7f7216039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:23.536 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:23.534+0000 7f7216039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:23.537 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:23.535+0000 7f7216039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:23.677 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:23.675+0000 7f7216039780 -1 Falling back to public interface 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:23.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:23.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:23.974 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:23.972+0000 7f7216039780 -1 osd.0 29 log_to_monitors true 2026-02-17T04:24:24.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:24.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:24.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:24.857 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:24.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:24.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [28,29) [v2:127.0.0.1:6800/2222272731,v1:127.0.0.1:6801/2222272731] [v2:127.0.0.1:6802/2222272731,v1:127.0.0.1:6803/2222272731] exists,up a3eda605-a49d-4d78-a95a-2a63af8172e7 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:25.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:25.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:25.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:25.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:25.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:25.284 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:25.284 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:25.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:25.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:25.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:25.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T04:24:25.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T04:24:25.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770' 2026-02-17T04:24:25.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:25.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705677 2026-02-17T04:24:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705677 2026-02-17T04:24:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770 1-38654705677' 2026-02-17T04:24:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:25.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:25.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574862 2026-02-17T04:24:25.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574862 2026-02-17T04:24:25.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770 1-38654705677 2-55834574862' 2026-02-17T04:24:25.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:25.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-141733920770 2026-02-17T04:24:25.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:25.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:25.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920770 2026-02-17T04:24:25.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:25.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T04:24:25.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920770' 2026-02-17T04:24:25.465 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 141733920770 2026-02-17T04:24:25.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:25.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 141733920770 2026-02-17T04:24:25.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:26.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:26.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:26.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 141733920770 2026-02-17T04:24:26.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:27.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:27.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:27.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920770 -lt 141733920770 2026-02-17T04:24:27.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:27.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705677 2026-02-17T04:24:27.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:27.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:27.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705677 2026-02-17T04:24:27.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:27.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705677 2026-02-17T04:24:27.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-17T04:24:27.972 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705677 2026-02-17T04:24:27.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:28.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705677 -lt 38654705677 2026-02-17T04:24:28.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:28.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574862 2026-02-17T04:24:28.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:28.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:28.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574862 2026-02-17T04:24:28.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:28.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574862 2026-02-17T04:24:28.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574862' 2026-02-17T04:24:28.147 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574862 2026-02-17T04:24:28.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:28.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574862 -lt 55834574862 2026-02-17T04:24:28.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:28.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:28.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:28.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:28.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:28.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:24:28.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:28.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:28.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:28.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:24:28.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:28.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:28.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:492: TEST_auto_repair_bluestore_tag: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:24:28.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:493: TEST_auto_repair_bluestore_tag: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-17T04:24:28.901 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:24:15.647+0000 7fe153557640 10 osd.1 pg_epoch: 24 pg[1.0( v 18'1 (0'0,18'1] local-lis/les=22/23 n=1 ec=14/14 lis/c=22/22 les/c/f=23/23/0 sis=22) [1,0] r=0 lpr=22 crt=18'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-17T04:24:28.901 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:24:15.647+0000 7fe153557640 10 osd.1 pg_epoch: 24 pg[1.0( v 18'1 (0'0,18'1] local-lis/les=22/23 n=1 ec=14/14 lis/c=22/22 les/c/f=23/23/0 sis=22) [1,0] r=0 lpr=22 crt=18'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-17T04:24:28.901 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:24:15.647+0000 7fe153557640 15 osd.1 pg_epoch: 24 pg[1.0( v 18'1 (0'0,18'1] local-lis/les=22/23 n=1 ec=14/14 lis/c=22/22 les/c/f=23/23/0 sis=22) [1,0] r=0 lpr=22 crt=18'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-17T04:24:28.901 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:24:15.647+0000 7fe153557640 20 osd.1 pg_epoch: 24 pg[1.0( v 18'1 (0'0,18'1] local-lis/les=22/23 n=1 ec=14/14 lis/c=22/22 les/c/f=23/23/0 sis=22) [1,0] r=0 lpr=22 crt=18'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-17T04:24:28.901 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:24:15.647+0000 7fe153557640 19 osd.1 pg_epoch: 24 pg[1.0( v 18'1 (0'0,18'1] local-lis/les=22/23 n=1 ec=14/14 lis/c=22/22 les/c/f=23/23/0 sis=22) [1,0] r=0 lpr=22 crt=18'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-17T04:24:28.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:24:28.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:24:28.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:24:28.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:24:28.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:28.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:28.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:28.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:28.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:29.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:29.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:24:29.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:24:29.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:24:29.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:24:29.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:24:29.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:24:29.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:24:29.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:24:29.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:24:29.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:24:29.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:24:29.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:24:29.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:24:29.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:24:29.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:24:29.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:24:29.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:24:29.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:24:29.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:29.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:29.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:29.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:24:29.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:24:29.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:24:29.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:24:29.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:24:29.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:24:29.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:24:29.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:24:29.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:24:29.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:24:29.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:24:29.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:24:29.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:24:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:24:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:24:29.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:24:29.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:24:29.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:24:29.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:24:29.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:24:29.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:24:29.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:24:29.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_erasure_coded_appends td/osd-scrub-repair 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:369: TEST_auto_repair_erasure_coded_appends: auto_repair_erasure_coded td/osd-scrub-repair false 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:328: auto_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:329: auto_repair_erasure_coded: local allow_overwrites=false 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:330: auto_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:24:29.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:333: auto_repair_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:24:29.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:29.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:24:29.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:24:29.085 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:24:29.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:24:29.131 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:24:29.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:334: auto_repair_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:24:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:24:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:24:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:29.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:29.259 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:29.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:29.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:24:29.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:24:29.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:339: auto_repair_erasure_coded: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:24:29.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: seq 0 2 2026-02-17T04:24:29.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:29.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:29.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:24:29.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:24:29.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:24:29.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:24:29.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3e2b5b26-1157-4b61-86ae-be1cf73d1ab1 2026-02-17T04:24:29.284 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 3e2b5b26-1157-4b61-86ae-be1cf73d1ab1 2026-02-17T04:24:29.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3e2b5b26-1157-4b61-86ae-be1cf73d1ab1' 2026-02-17T04:24:29.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:24:29.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB97ZNpN9RQERAAKu/f7yfiiPIKTNdlL2MkEQ== 2026-02-17T04:24:29.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB97ZNpN9RQERAAKu/f7yfiiPIKTNdlL2MkEQ=="}' 2026-02-17T04:24:29.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3e2b5b26-1157-4b61-86ae-be1cf73d1ab1 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:24:29.372 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:24:29.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:24:29.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQB97ZNpN9RQERAAKu/f7yfiiPIKTNdlL2MkEQ== --osd-uuid 3e2b5b26-1157-4b61-86ae-be1cf73d1ab1 2026-02-17T04:24:29.398 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.396+0000 7fd6bf80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.400 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.398+0000 7fd6bf80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.400 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.399+0000 7fd6bf80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.401 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.399+0000 7fd6bf80f780 -1 bdev(0x30b0c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:24:29.401 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.399+0000 7fd6bf80f780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:24:29.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:24:29.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:24:29.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:24:29.833 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:24:29.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:24:29.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:24:29.917 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:24:29.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:29.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:24:29.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:24:29.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:24:29.933 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.931+0000 7fc321020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.934 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.933+0000 7fc321020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.935 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:29.934+0000 7fc321020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:29.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:29.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:30.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:30.145 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:30.143+0000 7fc321020780 -1 Falling back to public interface 2026-02-17T04:24:30.569 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:30.567+0000 7fc321020780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:31.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:24:31.156 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1487482423,v1:127.0.0.1:6801/1487482423] [v2:127.0.0.1:6802/1487482423,v1:127.0.0.1:6803/1487482423] exists,up 3e2b5b26-1157-4b61-86ae-be1cf73d1ab1 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:24:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:24:31.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 840c2c12-78af-44ba-ba0d-8b2478a85fbe' 2026-02-17T04:24:31.165 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:24:31.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:24:31.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB/7ZNpJ8IQChAAfxXSzp8hOnMgcvxwT+cg7w== 2026-02-17T04:24:31.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB/7ZNpJ8IQChAAfxXSzp8hOnMgcvxwT+cg7w=="}' 2026-02-17T04:24:31.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 840c2c12-78af-44ba-ba0d-8b2478a85fbe -i td/osd-scrub-repair/1/new.json 2026-02-17T04:24:31.249 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:24:31.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:24:31.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQB/7ZNpJ8IQChAAfxXSzp8hOnMgcvxwT+cg7w== --osd-uuid 840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:24:31.273 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.272+0000 7fb7caa25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.275 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.273+0000 7fb7caa25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.274+0000 7fb7caa25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.274+0000 7fb7caa25780 -1 bdev(0x4140c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:24:31.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.274+0000 7fb7caa25780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:24:31.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:24:31.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:24:31.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:24:31.607 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:24:31.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:24:31.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:24:31.815 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:24:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:24:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:24:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:24:31.831 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.829+0000 7fac6220f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.832 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.831+0000 7fac6220f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.833 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.831+0000 7fac6220f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:31.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:24:31.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:31.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:24:31.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:31.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:31.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:31.978 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:24:31.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:31.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:31.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:24:31.999 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:31.997+0000 7fac6220f780 -1 Falling back to public interface 2026-02-17T04:24:32.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:32.284 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:32.282+0000 7fac6220f780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:24:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:33.143 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:24:33.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:33.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:33.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:24:33.311 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2089769123,v1:127.0.0.1:6811/2089769123] [v2:127.0.0.1:6812/2089769123,v1:127.0.0.1:6813/2089769123] exists,up 840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:24:33.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:33.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:33.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:33.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:33.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c746067e-2892-40eb-8862-d52614af483c 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c746067e-2892-40eb-8862-d52614af483c' 2026-02-17T04:24:33.319 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 c746067e-2892-40eb-8862-d52614af483c 2026-02-17T04:24:33.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:24:33.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCB7ZNp7nlmExAACnKxYJpXIcrY+zhDQW8yyg== 2026-02-17T04:24:33.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCB7ZNp7nlmExAACnKxYJpXIcrY+zhDQW8yyg=="}' 2026-02-17T04:24:33.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c746067e-2892-40eb-8862-d52614af483c -i td/osd-scrub-repair/2/new.json 2026-02-17T04:24:33.491 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:24:33.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:24:33.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCB7ZNp7nlmExAACnKxYJpXIcrY+zhDQW8yyg== --osd-uuid c746067e-2892-40eb-8862-d52614af483c 2026-02-17T04:24:33.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:33.516+0000 7f2b9be0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:33.519 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:33.517+0000 7f2b9be0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:33.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:33.518+0000 7f2b9be0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:33.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:33.518+0000 7f2b9be0f780 -1 bdev(0x43a2c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:24:33.521 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:33.519+0000 7f2b9be0f780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:24:33.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:24:33.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:24:33.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:24:33.854 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:24:33.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:24:34.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:24:34.070 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:24:34.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:34.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:24:34.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:24:34.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:24:34.086 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:34.085+0000 7facdb639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:34.088 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:34.086+0000 7facdb639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:34.089 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:34.087+0000 7facdb639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:34.223 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:34.221+0000 7facdb639780 -1 Falling back to public interface 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:34.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:34.240 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:24:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:24:34.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:34.515 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:34.513+0000 7facdb639780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:24:35.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:35.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:35.405 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:24:35.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:35.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:35.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:24:35.572 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1362788314,v1:127.0.0.1:6819/1362788314] [v2:127.0.0.1:6820/1362788314,v1:127.0.0.1:6821/1362788314] exists,up c746067e-2892-40eb-8862-d52614af483c 2026-02-17T04:24:35.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:35.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:35.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:35.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: auto_repair_erasure_coded: create_rbd_pool 2026-02-17T04:24:35.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:24:35.734 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:24:35.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:24:35.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:24:35.954 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:24:35.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:24:36.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:24:37.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: auto_repair_erasure_coded: wait_for_clean 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:37.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:37.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:37.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:37.499 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:37.499 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:37.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:37.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:37.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:37.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:24:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:24:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:24:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:37.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:37.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:24:37.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:24:37.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:24:37.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:37.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-64424509443' 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:24:37.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:37.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:37.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:24:37.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:37.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:24:37.677 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:24:37.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:24:37.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:37.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:24:37.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:38.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:38.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:39.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:24:39.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:40.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:40.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:40.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:24:40.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:40.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:24:40.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:40.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:40.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:24:40.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:40.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:24:40.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:24:40.187 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:24:40.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:40.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-17T04:24:40.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:40.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-17T04:24:40.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:40.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:40.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-17T04:24:40.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:40.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-17T04:24:40.355 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509443 2026-02-17T04:24:40.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-17T04:24:40.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:40.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509443 -lt 64424509443 2026-02-17T04:24:40.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:40.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:40.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:24:40.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:40.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:40.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:24:40.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:40.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:40.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:41.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:24:41.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:347: auto_repair_erasure_coded: create_ec_pool ecpool false k=2 m=1 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:24:41.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T04:24:41.330 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:24:41.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:24:41.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:24:41.635 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:24:41.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:24:42.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:24:42.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:24:42.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:42.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:42.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:42.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:42.648 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:42.648 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:42.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:42.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:42.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:42.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:42.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:42.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:24:42.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:24:42.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:24:42.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:42.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:43.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:24:43.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:24:43.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T04:24:43.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:43.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509445 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509445 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-64424509445' 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:24:43.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:43.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:43.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:24:43.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:43.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:24:43.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:24:43.079 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:24:43.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:43.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T04:24:43.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:44.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:44.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:44.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:24:44.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:44.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:24:44.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:44.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:44.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:24:44.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:44.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:24:44.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:24:44.413 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672964 2026-02-17T04:24:44.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:44.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T04:24:44.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:44.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509445 2026-02-17T04:24:44.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:44.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:44.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509445 2026-02-17T04:24:44.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:44.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509445 2026-02-17T04:24:44.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2026-02-17T04:24:44.581 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509445 2026-02-17T04:24:44.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:44.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509445 -lt 64424509445 2026-02-17T04:24:44.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:44.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:44.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:44.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:24:44.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:44.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:45.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:24:45.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:45.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:45.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:45.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:24:45.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:45.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:45.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:24:45.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:350: auto_repair_erasure_coded: local payload=ABCDEF 2026-02-17T04:24:45.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:351: auto_repair_erasure_coded: echo ABCDEF 2026-02-17T04:24:45.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:352: auto_repair_erasure_coded: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:24:45.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-17T04:24:45.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-17T04:24:45.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:24:45.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-17T04:24:45.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:24:45.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:24:45.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:24:45.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:24:45.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-17T04:24:45.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:24:45.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:24:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:24:45.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:24:45.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:24:45.905 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-17T04:24:45.906 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-17T04:24:45.906 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:24:45.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:24:45.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:24:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:24:45.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:24:45.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:24:45.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:24:45.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:24:45.968 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:45.966+0000 7f1e08242780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:45.969 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:45.967+0000 7f1e08242780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:45.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:45.968+0000 7f1e08242780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:24:46.115 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:46.112+0000 7f1e08242780 -1 Falling back to public interface 2026-02-17T04:24:46.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:24:46.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:46.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:24:46.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:24:46.434 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:24:46.432+0000 7f1e08242780 -1 osd.1 29 log_to_monitors true 2026-02-17T04:24:47.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:24:47.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:24:47.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:24:47.285 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:47.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:24:47.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 33 up_thru 33 down_at 30 last_clean_interval [10,29) [v2:127.0.0.1:6810/2174007488,v1:127.0.0.1:6811/2174007488] [v2:127.0.0.1:6812/2174007488,v1:127.0.0.1:6813/2174007488] exists,up 840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:24:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:24:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:24:47.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:24:47.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:24:47.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:24:47.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:24:47.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:24:47.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:47.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:24:47.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:24:47.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:24:47.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:24:47.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:47.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:24:47.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T04:24:47.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T04:24:47.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-141733920770' 2026-02-17T04:24:47.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:24:47.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509447 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509447 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-141733920770 2-64424509447' 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:24:47.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:47.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:24:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:24:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:47.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:24:47.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:24:47.882 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T04:24:47.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:24:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:49.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:24:49.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:49.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:24:49.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:24:50.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:24:50.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:24:50.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:24:50.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:50.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-141733920770 2026-02-17T04:24:50.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:50.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:24:50.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-141733920770 2026-02-17T04:24:50.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:50.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T04:24:50.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 141733920770' 2026-02-17T04:24:50.392 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 141733920770 2026-02-17T04:24:50.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:24:50.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920770 -lt 141733920770 2026-02-17T04:24:50.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:24:50.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509447 2026-02-17T04:24:50.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:24:50.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:24:50.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509447 2026-02-17T04:24:50.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:24:50.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509447 2026-02-17T04:24:50.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509447' 2026-02-17T04:24:50.561 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509447 2026-02-17T04:24:50.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:24:50.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509447 -lt 64424509447 2026-02-17T04:24:50.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:24:50.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:50.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:50.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:24:50.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:24:50.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:24:50.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:24:50.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:24:50.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:24:50.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:24:50.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:24:51.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:24:51.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:24:51.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:24:51.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:24:51.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: get_pg ecpool SOMETHING 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:24:51.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:24:51.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: local pgid=2.0 2026-02-17T04:24:51.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: get_last_scrub_stamp 2.0 2026-02-17T04:24:51.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:51.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:51.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:51.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:51.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: wait_for_scrub 2.0 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:51.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:24:51.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:51.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:51.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:51.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:51.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:52.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:52.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:52.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:52.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:52.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:52.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:52.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:52.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:53.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:53.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:53.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:53.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:53.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:53.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:53.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:54.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:54.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:55.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:55.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:55.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:55.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:55.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:55.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:55.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:55.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:55.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:56.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:56.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:56.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:56.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:56.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:56.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:56.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:56.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:56.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:57.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:57.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:57.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:57.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:57.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:57.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:57.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:57.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:57.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:58.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:58.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:58.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:58.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:58.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:58.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:58.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:58.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:58.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:24:59.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:24:59.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:24:59.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:24:59.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:24:59.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:24:59.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:24:59.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:24:59.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:24:59.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:00.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:00.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:00.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:01.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:01.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:01.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:01.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:01.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:01.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:02.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:02.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:02.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:02.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:02.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:02.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:02.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:02.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:02.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:03.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:03.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:03.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:03.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:03.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:03.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:03.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:03.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:03.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:04.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:04.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:04.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:04.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:04.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:04.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:04.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:04.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:04.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:05.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:05.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:05.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:05.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:05.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:06.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:06.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:06.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:06.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:06.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:06.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:06.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:07.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:24:47.646032+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:07.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:08.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:08.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:08.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:08.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:08.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:08.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:08.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:25:01.735204+0000 '>' 2026-02-17T04:24:47.646032+0000 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: auto_repair_erasure_coded: wait_for_clean 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:08.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:08.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:08.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:08.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:08.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:08.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:08.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:08.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:08.438 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:08.438 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:08.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:08.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:08.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:08.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:25:08.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:25:08.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:25:08.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:08.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:08.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920775 2026-02-17T04:25:08.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920775 2026-02-17T04:25:08.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-141733920775' 2026-02-17T04:25:08.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:08.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:08.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509452 2026-02-17T04:25:08.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509452 2026-02-17T04:25:08.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-141733920775 2-64424509452' 2026-02-17T04:25:08.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:08.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:25:08.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:08.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:08.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:25:08.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:08.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:25:08.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:25:08.617 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:25:08.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:08.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-17T04:25:08.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:09.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:09.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:09.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:25:09.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:09.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-141733920775 2026-02-17T04:25:09.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:09.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:09.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-141733920775 2026-02-17T04:25:09.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:09.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920775 2026-02-17T04:25:09.951 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 141733920775 2026-02-17T04:25:09.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 141733920775' 2026-02-17T04:25:09.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:10.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920775 -lt 141733920775 2026-02-17T04:25:10.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:10.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509452 2026-02-17T04:25:10.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:10.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:10.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509452 2026-02-17T04:25:10.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:10.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509452 2026-02-17T04:25:10.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2026-02-17T04:25:10.120 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509452 2026-02-17T04:25:10.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:10.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509452 -lt 64424509452 2026-02-17T04:25:10.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:10.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:10.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:10.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:10.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:10.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:10.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-17T04:25:10.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:25:10.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-17T04:25:10.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:25:10.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:25:10.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:10.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:25:11.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-17T04:25:11.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:11.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-17T04:25:11.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:11.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:25:11.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:11.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:11.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:25:11.367 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:25:11.368 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:25:11.368 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:25:11.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:11.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:11.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:25:11.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:25:11.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:11.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:25:11.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:25:11.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:25:11.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:25:11.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:25:11.429 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:11.428+0000 7f1ad5212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:11.430 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:11.429+0000 7f1ad5212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:11.431 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:11.430+0000 7f1ad5212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:11.577 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:11.576+0000 7f1ad5212780 -1 Falling back to public interface 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:11.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:11.878 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:11.877+0000 7f1ad5212780 -1 osd.1 36 log_to_monitors true 2026-02-17T04:25:12.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:12.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:12.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:12.748 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:12.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:12.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:12.918 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [33,36) [v2:127.0.0.1:6810/4113869196,v1:127.0.0.1:6811/4113869196] [v2:127.0.0.1:6812/4113869196,v1:127.0.0.1:6813/4113869196] exists,up 840c2c12-78af-44ba-ba0d-8b2478a85fbe 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:12.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:12.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:12.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:13.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:13.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:13.170 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:13.170 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:13.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:13.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:13.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:13.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-17T04:25:13.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-17T04:25:13.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T04:25:13.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:13.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:13.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T04:25:13.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T04:25:13.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-167503724546' 2026-02-17T04:25:13.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:13.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509454 2026-02-17T04:25:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509454 2026-02-17T04:25:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-167503724546 2-64424509454' 2026-02-17T04:25:13.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:13.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-17T04:25:13.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:13.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:13.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-17T04:25:13.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:13.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-17T04:25:13.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T04:25:13.351 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836494 2026-02-17T04:25:13.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:13.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T04:25:13.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:13.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724546 2026-02-17T04:25:13.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:13.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:13.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724546 2026-02-17T04:25:13.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:13.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T04:25:13.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724546' 2026-02-17T04:25:13.521 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 167503724546 2026-02-17T04:25:13.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:13.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T04:25:13.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:13.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509454 2026-02-17T04:25:13.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:13.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:13.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509454 2026-02-17T04:25:13.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:13.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509454 2026-02-17T04:25:13.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509454' 2026-02-17T04:25:13.690 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 64424509454 2026-02-17T04:25:13.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:13.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509453 -lt 64424509454 2026-02-17T04:25:13.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:14.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:14.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:15.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509453 -lt 64424509454 2026-02-17T04:25:15.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:16.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:25:16.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:16.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509454 -lt 64424509454 2026-02-17T04:25:16.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:16.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:16.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:16.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:16.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:16.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:16.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:16.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:16.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:16.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:16.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:16.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:364: auto_repair_erasure_coded: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:25:16.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:365: auto_repair_erasure_coded: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:16.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:16.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:16.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:25:16.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:25:16.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:25:16.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:25:16.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:25:16.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:25:16.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:16.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:25:16.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:25:16.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:16.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:25:16.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:25:16.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:25:16.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:25:16.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:16.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:16.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:25:16.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:25:16.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:25:16.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:25:16.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:16.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:16.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:25:16.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:25:16.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:25:16.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:25:16.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:25:16.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:25:16.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:16.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:25:16.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:25:16.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:16.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:25:16.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:25:16.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:25:16.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:25:16.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:16.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:16.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:25:16.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:25:16.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:25:16.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:25:16.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:25:16.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:16.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:16.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:25:16.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_erasure_coded_overwrites td/osd-scrub-repair 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:373: TEST_auto_repair_erasure_coded_overwrites: '[' true = true ']' 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:374: TEST_auto_repair_erasure_coded_overwrites: auto_repair_erasure_coded td/osd-scrub-repair true 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:328: auto_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:329: auto_repair_erasure_coded: local allow_overwrites=true 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:330: auto_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:333: auto_repair_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:25:16.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:25:16.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:25:16.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:16.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:16.960 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:16.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:16.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:16.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:16.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:25:16.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:25:16.986 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:25:16.987 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:16.987 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:16.987 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:25:16.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:25:16.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:25:17.032 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:25:17.033 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:25:17.033 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:17.034 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:17.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:25:17.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:25:17.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:334: auto_repair_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:25:17.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:25:17.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:25:17.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:25:17.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:17.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:17.157 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:17.158 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:17.158 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:17.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:17.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:25:17.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:25:17.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:339: auto_repair_erasure_coded: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:17.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: seq 0 2 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:25:17.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:17.180 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:17.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06365a1e-61b0-423f-bae7-2f65ece038d0 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 06365a1e-61b0-423f-bae7-2f65ece038d0' 2026-02-17T04:25:17.182 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 06365a1e-61b0-423f-bae7-2f65ece038d0 2026-02-17T04:25:17.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:17.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCt7ZNp6Wk2CxAAGyjJeGTrf3jLt1s1JTg4YA== 2026-02-17T04:25:17.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCt7ZNp6Wk2CxAAGyjJeGTrf3jLt1s1JTg4YA=="}' 2026-02-17T04:25:17.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06365a1e-61b0-423f-bae7-2f65ece038d0 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:25:17.272 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:17.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:25:17.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCt7ZNp6Wk2CxAAGyjJeGTrf3jLt1s1JTg4YA== --osd-uuid 06365a1e-61b0-423f-bae7-2f65ece038d0 2026-02-17T04:25:17.298 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.297+0000 7fc3ed830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.299 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.299+0000 7fc3ed830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.300 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.300+0000 7fc3ed830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.301 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.300+0000 7fc3ed830780 -1 bdev(0x3f26c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:17.301 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.300+0000 7fc3ed830780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:25:17.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:25:17.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:17.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:25:17.706 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:25:17.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:17.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:25:17.792 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:25:17.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:17.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:17.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:17.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:17.810 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.809+0000 7fc061e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.811 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.811+0000 7fc061e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.812 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:17.812+0000 7fc061e12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:17.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:25:17.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:17.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:25:17.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:17.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:17.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:17.874 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:17.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:17.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:17.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:25:17.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:18.045 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:18.044+0000 7fc061e12780 -1 Falling back to public interface 2026-02-17T04:25:18.460 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:18.460+0000 7fc061e12780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:25:18.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:18.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:18.954 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:18.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:25:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:20.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:20.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:20.040 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:25:20.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T04:25:20.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:20.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:25:20.206 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1480704187,v1:127.0.0.1:6801/1480704187] [v2:127.0.0.1:6802/1480704187,v1:127.0.0.1:6803/1480704187] exists,up 06365a1e-61b0-423f-bae7-2f65ece038d0 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:25:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:20.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:20.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b74da8d9-0516-4f91-ac8b-5042cce58dc7' 2026-02-17T04:25:20.214 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:20.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:20.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCw7ZNpYPgMDRAAR193zYI6/f9rdlZjWwpTkQ== 2026-02-17T04:25:20.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCw7ZNpYPgMDRAAR193zYI6/f9rdlZjWwpTkQ=="}' 2026-02-17T04:25:20.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b74da8d9-0516-4f91-ac8b-5042cce58dc7 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:25:20.380 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:20.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:25:20.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCw7ZNpYPgMDRAAR193zYI6/f9rdlZjWwpTkQ== --osd-uuid b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:20.408 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.407+0000 7fabee015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:20.409 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.409+0000 7fabee015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:20.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.410+0000 7fabee015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:20.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.410+0000 7fabee015780 -1 bdev(0x2b2ec00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:20.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.410+0000 7fabee015780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:25:20.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:25:20.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:20.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:25:20.738 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:25:20.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:20.950 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:25:20.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:25:20.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:20.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:20.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:20.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:20.968 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.967+0000 7f40fddd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:20.969 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.969+0000 7f40fddd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:20.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:20.969+0000 7f40fddd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:21.082 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:21.081+0000 7f40fddd4780 -1 Falling back to public interface 2026-02-17T04:25:21.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:21.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:21.117 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:21.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:21.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:21.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:21.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:21.389+0000 7f40fddd4780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:25:22.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:22.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:22.288 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:22.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:22.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:22.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:22.452 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3624447426,v1:127.0.0.1:6811/3624447426] [v2:127.0.0.1:6812/3624447426,v1:127.0.0.1:6813/3624447426] exists,up b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:22.453 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:22.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:25:22.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f9950e2c-90c6-40d1-8526-25f01b69811c 2026-02-17T04:25:22.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f9950e2c-90c6-40d1-8526-25f01b69811c' 2026-02-17T04:25:22.456 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 f9950e2c-90c6-40d1-8526-25f01b69811c 2026-02-17T04:25:22.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:22.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCy7ZNplHLOGxAALBrcbgeZYmcjEkUTgxsBMQ== 2026-02-17T04:25:22.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCy7ZNplHLOGxAALBrcbgeZYmcjEkUTgxsBMQ=="}' 2026-02-17T04:25:22.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f9950e2c-90c6-40d1-8526-25f01b69811c -i td/osd-scrub-repair/2/new.json 2026-02-17T04:25:22.630 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:25:22.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:25:22.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCy7ZNplHLOGxAALBrcbgeZYmcjEkUTgxsBMQ== --osd-uuid f9950e2c-90c6-40d1-8526-25f01b69811c 2026-02-17T04:25:22.657 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:22.656+0000 7fad4c03a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:22.658 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:22.657+0000 7fad4c03a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:22.659 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:22.658+0000 7fad4c03a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:22.659 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:22.659+0000 7fad4c03a780 -1 bdev(0x281ac00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:22.659 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:22.659+0000 7fad4c03a780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:25:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:25:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:22.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:25:22.975 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:25:22.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:23.187 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:25:23.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:25:23.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:23.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:23.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:23.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:23.203 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:23.202+0000 7f901563d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:23.204 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:23.203+0000 7f901563d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:23.205 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:23.204+0000 7f901563d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:23.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:25:23.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:23.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:25:23.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:23.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:23.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:23.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:23.356 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:23.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:23.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:25:23.403 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:23.402+0000 7f901563d780 -1 Falling back to public interface 2026-02-17T04:25:23.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:23.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:23.697+0000 7f901563d780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:25:24.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:24.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:24.521 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:24.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:25:24.688 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2781376254,v1:127.0.0.1:6819/2781376254] [v2:127.0.0.1:6820/2781376254,v1:127.0.0.1:6821/2781376254] exists,up f9950e2c-90c6-40d1-8526-25f01b69811c 2026-02-17T04:25:24.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:24.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:24.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:24.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: auto_repair_erasure_coded: create_rbd_pool 2026-02-17T04:25:24.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:25:24.852 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:25:24.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:25:24.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:25:25.077 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:25:25.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:25:26.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: auto_repair_erasure_coded: wait_for_clean 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:26.366 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:26.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:26.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:26.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:26.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:26.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:26.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:26.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:26.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:26.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:26.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:26.615 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:26.615 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:26.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:26.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:26.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:26.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:25:26.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:25:26.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:25:26.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:26.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:26.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:25:26.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:25:26.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-17T04:25:26.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:26.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:26.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:25:26.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:25:26.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-17T04:25:26.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:26.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:25:26.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:26.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:26.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:25:26.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:26.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:25:26.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:25:26.797 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:25:26.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:26.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:25:26.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:27.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:27.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:28.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:25:28.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:28.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:25:28.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:28.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:28.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:25:28.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:28.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:25:28.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:25:28.132 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:25:28.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:28.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:25:28.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:28.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:25:28.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:28.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:28.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:25:28.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:28.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:25:28.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:25:28.298 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:25:28.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:28.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-17T04:25:28.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:28.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:28.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:28.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:28.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:28.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:25:28.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:28.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:28.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:347: auto_repair_erasure_coded: create_ec_pool ecpool true k=2 m=1 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:25:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T04:25:29.303 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:25:29.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:25:29.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:25:29.607 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:25:29.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:25:30.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:25:30.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:25:30.833 INFO:tasks.workunit.client.0.trial090.stderr:set pool 2 allow_ec_overwrites to true 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:30.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:30.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:30.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:30.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:30.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:30.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:30.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:30.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:30.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:30.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:31.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:31.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:25:31.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:25:31.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:25:31.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:31.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:31.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:25:31.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:25:31.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705669' 2026-02-17T04:25:31.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:31.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705669 2-60129542148' 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:25:31.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:31.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:31.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:25:31.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:25:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:25:31.276 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:25:31.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:31.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:25:31.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:31.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:25:31.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:31.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:31.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:25:31.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:31.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:25:31.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:25:31.444 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:25:31.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:31.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:25:31.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:32.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:32.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:32.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:25:32.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:33.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:25:33.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705669 2026-02-17T04:25:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:33.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:25:33.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:33.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:33.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:25:33.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:33.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:25:33.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:25:33.951 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542148 2026-02-17T04:25:33.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:34.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:25:34.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:34.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:34.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:34.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:34.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:34.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:34.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:34.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:350: auto_repair_erasure_coded: local payload=ABCDEF 2026-02-17T04:25:34.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:351: auto_repair_erasure_coded: echo ABCDEF 2026-02-17T04:25:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:352: auto_repair_erasure_coded: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:25:34.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-17T04:25:34.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-17T04:25:34.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:25:34.727 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-17T04:25:34.727 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:25:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:25:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:25:34.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-17T04:25:34.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:34.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-17T04:25:35.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:25:35.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:25:35.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:35.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:35.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:35.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:35.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:35.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:25:35.290 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-17T04:25:35.290 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-17T04:25:35.291 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:25:35.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:35.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:25:35.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:35.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:25:35.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:25:35.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:25:35.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:25:35.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:25:35.351 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:35.350+0000 7f2f46ffb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:35.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:35.351+0000 7f2f46ffb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:35.354 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:35.352+0000 7f2f46ffb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:35.497+0000 7f2f46ffb780 -1 Falling back to public interface 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:35.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:35.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:35.816 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:35.814+0000 7f2f46ffb780 -1 osd.1 28 log_to_monitors true 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:36.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 32 up_thru 32 down_at 29 last_clean_interval [9,28) [v2:127.0.0.1:6810/1860030327,v1:127.0.0.1:6811/1860030327] [v2:127.0.0.1:6812/1860030327,v1:127.0.0.1:6813/1860030327] exists,up b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:36.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:36.831 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:36.831 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:36.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:36.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:36.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:36.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:37.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:37.079 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:37.079 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:37.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:37.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:37.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:25:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:25:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:25:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:37.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:37.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953474 2026-02-17T04:25:37.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953474 2026-02-17T04:25:37.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474' 2026-02-17T04:25:37.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:37.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:37.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T04:25:37.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T04:25:37.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474 2-60129542150' 2026-02-17T04:25:37.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:37.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:25:37.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:37.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:37.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:25:37.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:37.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:25:37.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:25:37.259 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T04:25:37.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:37.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:25:37.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:37.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953474 2026-02-17T04:25:37.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:37.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:37.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953474 2026-02-17T04:25:37.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:37.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953474 2026-02-17T04:25:37.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953474' 2026-02-17T04:25:37.428 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 137438953474 2026-02-17T04:25:37.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:37.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 137438953474 2026-02-17T04:25:37.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:38.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:38.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:38.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 137438953474 2026-02-17T04:25:38.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:39.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:25:39.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953474 -lt 137438953474 2026-02-17T04:25:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:39.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T04:25:39.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:39.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:39.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T04:25:39.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:39.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T04:25:39.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T04:25:39.930 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542150 2026-02-17T04:25:39.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:40.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T04:25:40.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:40.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:40.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:40.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:40.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:40.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:40.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:40.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:40.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:40.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:40.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:40.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:40.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:40.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:40.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:40.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:40.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:40.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: get_pg ecpool SOMETHING 2026-02-17T04:25:40.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:25:40.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:25:40.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:40.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: local pgid=2.0 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: get_last_scrub_stamp 2.0 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:41.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: wait_for_scrub 2.0 2026-02-17T04:25:29.604722+0000 2026-02-17T04:25:41.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:25:41.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:25:29.604722+0000 2026-02-17T04:25:41.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:41.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:41.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:25:29.604722+0000 '>' 2026-02-17T04:25:29.604722+0000 2026-02-17T04:25:41.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:25:42.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:25:42.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:25:42.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:25:42.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:25:42.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:25:42.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:25:42.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:25:38.677486+0000 '>' 2026-02-17T04:25:29.604722+0000 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: auto_repair_erasure_coded: wait_for_clean 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:42.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:42.345 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:42.345 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:42.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:42.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:42.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:42.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:42.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:42.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-17T04:25:42.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-17T04:25:42.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T04:25:42.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:42.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953476 2026-02-17T04:25:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953476 2026-02-17T04:25:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-137438953476' 2026-02-17T04:25:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:42.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-137438953476 2-60129542152' 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836489 2026-02-17T04:25:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:42.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:42.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-17T04:25:42.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:42.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836489 2026-02-17T04:25:42.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T04:25:42.778 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836489 2026-02-17T04:25:42.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:42.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836489 2026-02-17T04:25:42.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:43.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:43.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:44.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T04:25:44.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:44.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953476 2026-02-17T04:25:44.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:44.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953476 2026-02-17T04:25:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:44.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953476 2026-02-17T04:25:44.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953476' 2026-02-17T04:25:44.116 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 137438953476 2026-02-17T04:25:44.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:44.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953476 2026-02-17T04:25:44.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:44.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-17T04:25:44.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:44.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-17T04:25:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:44.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-17T04:25:44.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-17T04:25:44.285 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542152 2026-02-17T04:25:44.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:44.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542152 2026-02-17T04:25:44.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:44.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:44.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:44.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:44.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:44.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:44.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:44.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:44.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:45.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:45.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:45.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:45.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-17T04:25:45.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-17T04:25:45.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:25:45.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-17T04:25:45.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:25:45.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:25:45.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:45.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:25:45.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-17T04:25:45.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:25:45.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-17T04:25:45.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:45.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:25:45.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:25:45.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:25:45.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:45.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:45.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:45.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:45.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:25:45.738 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:25:45.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:25:45.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:45.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:25:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:25:45.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:25:45.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:25:45.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:25:45.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:25:45.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:25:45.791 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:45.789+0000 7fd43aa53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:45.792 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:45.791+0000 7fd43aa53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:45.793 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:45.792+0000 7fd43aa53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:45.918 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:45.916+0000 7fd43aa53780 -1 Falling back to public interface 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:45.938 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:25:45.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:45.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:46.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:46.198 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:46.196+0000 7fd43aa53780 -1 osd.1 35 log_to_monitors true 2026-02-17T04:25:47.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:47.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:47.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:47.105 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:47.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:47.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [32,35) [v2:127.0.0.1:6810/336071885,v1:127.0.0.1:6811/336071885] [v2:127.0.0.1:6812/336071885,v1:127.0.0.1:6813/336071885] exists,up b74da8d9-0516-4f91-ac8b-5042cce58dc7 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:25:47.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:25:47.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:25:47.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:25:47.273 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:25:47.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:25:47.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:25:47.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:25:47.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:25:47.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:25:47.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:25:47.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:25:47.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:25:47.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:47.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:25:47.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:25:47.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:25:47.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:25:47.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:47.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:25:47.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T04:25:47.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T04:25:47.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-167503724546' 2026-02-17T04:25:47.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:25:47.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:25:47.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-17T04:25:47.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-17T04:25:47.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-167503724546 2-60129542154' 2026-02-17T04:25:47.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:47.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:25:47.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:47.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:25:47.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:25:47.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:47.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:25:47.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:25:47.703 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836491 2026-02-17T04:25:47.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:47.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-17T04:25:47.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:25:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:49.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-17T04:25:49.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:25:50.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:25:50.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:25:50.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:25:50.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:50.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724546 2026-02-17T04:25:50.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:50.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:25:50.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724546 2026-02-17T04:25:50.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:50.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T04:25:50.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724546' 2026-02-17T04:25:50.213 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 167503724546 2026-02-17T04:25:50.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:25:50.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T04:25:50.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:25:50.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-17T04:25:50.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:25:50.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:25:50.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-17T04:25:50.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:25:50.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-17T04:25:50.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-17T04:25:50.383 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542154 2026-02-17T04:25:50.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:25:50.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-17T04:25:50.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:25:50.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:50.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:25:50.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:25:50.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:25:50.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:25:50.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:25:50.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:25:50.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:25:50.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:25:51.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:25:51.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:25:51.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:25:51.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:364: auto_repair_erasure_coded: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:25:51.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:365: auto_repair_erasure_coded: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:25:51.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:25:51.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:51.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:51.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:51.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:25:51.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:25:51.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:25:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:25:51.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:25:51.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:25:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:25:51.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:25:51.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:51.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:25:51.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:25:51.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:25:51.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:25:51.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:25:51.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:25:51.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:25:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:25:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:25:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:25:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:25:51.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:25:51.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:25:51.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:25:51.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:25:51.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:25:51.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:25:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:25:51.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:25:51.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:25:51.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:25:51.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:25:51.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:25:51.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:25:51.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:25:51.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:25:51.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:25:51.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:25:51.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:25:51.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:25:51.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:25:51.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:25:51.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_jerasure_appends td/osd-scrub-repair 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:874: TEST_corrupt_and_repair_jerasure_appends: corrupt_and_repair_jerasure td/osd-scrub-repair false 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:857: corrupt_and_repair_jerasure: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:858: corrupt_and_repair_jerasure: local allow_overwrites=false 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:859: corrupt_and_repair_jerasure: local poolname=ecpool 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:861: corrupt_and_repair_jerasure: run_mon td/osd-scrub-repair a 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:25:51.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:25:51.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:25:51.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:25:51.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:25:51.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:25:51.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:25:51.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:25:51.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:25:51.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:25:51.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:25:51.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:25:51.364 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:25:51.364 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:25:51.364 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:25:51.365 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:25:51.365 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.365 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.365 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:25:51.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:25:51.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:25:51.411 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:25:51.412 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:25:51.412 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:25:51.412 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.412 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.412 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:25:51.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:25:51.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:25:51.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:862: corrupt_and_repair_jerasure: run_mgr td/osd-scrub-repair x 2026-02-17T04:25:51.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:25:51.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:25:51.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:25:51.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:25:51.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:25:51.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:25:51.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:51.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:51.538 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:51.538 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.539 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:51.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:25:51.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:25:51.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: seq 0 3 2026-02-17T04:25:51.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:25:51.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 0 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:51.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:51.560 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:51.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:51.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:51.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:51.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:25:51.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:25:51.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:51.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=544fa42f-37e7-4438-b0dd-f37ed9bb02d8 2026-02-17T04:25:51.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 544fa42f-37e7-4438-b0dd-f37ed9bb02d8' 2026-02-17T04:25:51.563 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 544fa42f-37e7-4438-b0dd-f37ed9bb02d8 2026-02-17T04:25:51.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:51.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDP7ZNpM7n7IRAAtm98qsxzUIziPOK3XSPt6w== 2026-02-17T04:25:51.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDP7ZNpM7n7IRAAtm98qsxzUIziPOK3XSPt6w=="}' 2026-02-17T04:25:51.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 544fa42f-37e7-4438-b0dd-f37ed9bb02d8 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:25:51.653 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:51.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:25:51.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDP7ZNpM7n7IRAAtm98qsxzUIziPOK3XSPt6w== --osd-uuid 544fa42f-37e7-4438-b0dd-f37ed9bb02d8 2026-02-17T04:25:51.677 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:51.675+0000 7f779ce45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:51.678 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:51.677+0000 7f779ce45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:51.679 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:51.677+0000 7f779ce45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:51.680 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:51.678+0000 7f779ce45780 -1 bdev(0x3ac2c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:51.680 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:51.678+0000 7f779ce45780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:25:52.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:25:52.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:52.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:25:52.102 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:25:52.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:52.185 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:25:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:25:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:25:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:52.200 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:52.198+0000 7f60c682c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:52.202 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:52.200+0000 7f60c682c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:52.203 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:52.201+0000 7f60c682c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:52.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:25:52.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:52.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:25:52.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:52.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:52.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:52.267 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:52.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:52.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:52.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:25:52.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:52.402 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:52.401+0000 7f60c682c780 -1 Falling back to public interface 2026-02-17T04:25:52.781 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:52.779+0000 7f60c682c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:25:53.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:53.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:53.349 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:53.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:53.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:53.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:25:53.430 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2289563834,v1:127.0.0.1:6801/2289563834] [v2:127.0.0.1:6802/2289563834,v1:127.0.0.1:6803/2289563834] exists,up 544fa42f-37e7-4438-b0dd-f37ed9bb02d8 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 1 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:53.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:53.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:53.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:25:53.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef' 2026-02-17T04:25:53.438 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:25:53.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:53.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDR7ZNpZKhXGhAA+0rsnoKlikpKBDtwl81s5Q== 2026-02-17T04:25:53.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDR7ZNpZKhXGhAA+0rsnoKlikpKBDtwl81s5Q=="}' 2026-02-17T04:25:53.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef -i td/osd-scrub-repair/1/new.json 2026-02-17T04:25:53.523 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:53.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:25:53.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDR7ZNpZKhXGhAA+0rsnoKlikpKBDtwl81s5Q== --osd-uuid 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:25:53.546 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:53.544+0000 7f1236820780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:53.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:53.545+0000 7f1236820780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:53.548 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:53.546+0000 7f1236820780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:53.548 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:53.546+0000 7f1236820780 -1 bdev(0x362ac00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:53.548 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:53.546+0000 7f1236820780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:25:53.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:25:53.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:53.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:25:53.936 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:25:53.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:54.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:54.162 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:54.160+0000 7f310963a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:54.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:54.162+0000 7f310963a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:54.164 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:54.163+0000 7f310963a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:54.294 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:54.292+0000 7f310963a780 -1 Falling back to public interface 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:54.310 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:54.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:54.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:54.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:54.585 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:54.583+0000 7f310963a780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:25:55.643 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1443303595,v1:127.0.0.1:6811/1443303595] [v2:127.0.0.1:6812/1443303595,v1:127.0.0.1:6813/1443303595] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 2 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:55.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:25:55.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:55.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:25:55.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 3dff415e-bcb0-47fa-a9b7-bde712336a7d' 2026-02-17T04:25:55.651 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:25:55.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:55.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDT7ZNpdoQiJxAA+vJWWX7tAvs9Gz/tb/x2mA== 2026-02-17T04:25:55.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDT7ZNpdoQiJxAA+vJWWX7tAvs9Gz/tb/x2mA=="}' 2026-02-17T04:25:55.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3dff415e-bcb0-47fa-a9b7-bde712336a7d -i td/osd-scrub-repair/2/new.json 2026-02-17T04:25:55.821 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:25:55.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:25:55.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDT7ZNpdoQiJxAA+vJWWX7tAvs9Gz/tb/x2mA== --osd-uuid 3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:25:55.846 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:55.844+0000 7f3b7a238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:55.847 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:55.845+0000 7f3b7a238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:55.848 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:55.846+0000 7f3b7a238780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:55.848 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:55.846+0000 7f3b7a238780 -1 bdev(0x3d6cc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:55.848 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:55.846+0000 7f3b7a238780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:25:56.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:25:56.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:56.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:25:56.183 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:25:56.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:56.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:25:56.393 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:25:56.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:25:56.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:56.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:56.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:56.407 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:56.405+0000 7fa83523e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:56.408 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:56.407+0000 7fa83523e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:56.409 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:56.408+0000 7fa83523e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:56.546 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:56.544+0000 7fa83523e780 -1 Falling back to public interface 2026-02-17T04:25:56.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:25:56.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:56.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:25:56.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:56.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:56.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:56.559 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:56.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:56.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:56.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:25:56.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:56.852 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:56.850+0000 7fa83523e780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:25:57.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:57.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:57.727 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:57.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:57.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:57.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:25:57.889 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2980583558,v1:127.0.0.1:6819/2980583558] [v2:127.0.0.1:6820/2980583558,v1:127.0.0.1:6821/2980583558] exists,up 3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 3 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:25:57.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:25:57.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:25:57.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:25:57.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:25:57.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:25:57.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 f1d1058a-36c7-4b77-bc74-b3a20e81f0fb' 2026-02-17T04:25:57.895 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:25:57.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:25:57.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDV7ZNpAHfWNRAA1KaZ+g3DY1K0MXMwoXaSFA== 2026-02-17T04:25:57.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDV7ZNpAHfWNRAA1KaZ+g3DY1K0MXMwoXaSFA=="}' 2026-02-17T04:25:57.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f1d1058a-36c7-4b77-bc74-b3a20e81f0fb -i td/osd-scrub-repair/3/new.json 2026-02-17T04:25:58.072 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:25:58.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:25:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDV7ZNpAHfWNRAA1KaZ+g3DY1K0MXMwoXaSFA== --osd-uuid f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:25:58.095 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.093+0000 7f8a19643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.097 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.095+0000 7f8a19643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.098 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.096+0000 7f8a19643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.098 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.096+0000 7f8a19643780 -1 bdev(0x42e6c00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:25:58.099 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.096+0000 7f8a19643780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:25:58.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:25:58.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:25:58.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:25:58.442 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:25:58.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:25:58.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:25:58.652 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:25:58.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:25:58.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:25:58.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:25:58.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:25:58.667 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.665+0000 7f6929a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.669 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.667+0000 7f6929a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.669 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.667+0000 7f6929a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:25:58.796 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:58.794+0000 7f6929a30780 -1 Falling back to public interface 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:58.815 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:25:58.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:25:58.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:58.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:25:58.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:25:59.089 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:25:59.087+0000 7f6929a30780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:25:59.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:25:59.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:25:59.982 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:25:59.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:25:59.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:25:59.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:00.147 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3699240443,v1:127.0.0.1:6827/3699240443] [v2:127.0.0.1:6828/3699240443,v1:127.0.0.1:6829/3699240443] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:26:00.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:00.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:00.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:866: corrupt_and_repair_jerasure: create_rbd_pool 2026-02-17T04:26:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:26:00.305 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:26:00.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:26:00.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:26:00.526 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:26:00.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:26:01.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:26:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:867: corrupt_and_repair_jerasure: wait_for_clean 2026-02-17T04:26:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:01.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:01.817 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:01.817 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:01.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:01.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:01.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:01.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:02.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:26:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:26:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:26:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:02.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:02.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:26:02.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:26:02.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668' 2026-02-17T04:26:02.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:02.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:02.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-17T04:26:02.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-17T04:26:02.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668 2-55834574850' 2026-02-17T04:26:02.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:02.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444034 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444034 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668 2-55834574850 3-73014444034' 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:26:02.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:02.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:02.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:26:02.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:02.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:26:02.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:26:02.309 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:26:02.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:02.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:26:02.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:03.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:03.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:03.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:26:03.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:04.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:04.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:04.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:26:04.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:04.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:26:04.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:04.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:04.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:26:04.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:04.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:26:04.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:26:04.816 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705668 2026-02-17T04:26:04.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T04:26:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:04.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-17T04:26:04.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:04.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:04.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-17T04:26:04.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:04.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-17T04:26:04.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-17T04:26:04.989 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574850 2026-02-17T04:26:04.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:05.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574850 2026-02-17T04:26:05.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:05.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-73014444034 2026-02-17T04:26:05.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:05.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:05.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444034 2026-02-17T04:26:05.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:05.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=73014444034 2026-02-17T04:26:05.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 73014444034' 2026-02-17T04:26:05.160 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 73014444034 2026-02-17T04:26:05.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:05.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 73014444034 -lt 73014444034 2026-02-17T04:26:05.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:05.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:05.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:26:05.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:05.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:05.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:05.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:05.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:05.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:05.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:05.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:26:05.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:05.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:05.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:05.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:26:05.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:05.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:05.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:869: corrupt_and_repair_jerasure: create_ec_pool ecpool false k=2 m=2 2026-02-17T04:26:05.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:26:05.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:26:05.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:26:05.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:26:05.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-17T04:26:06.131 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:26:06.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:26:06.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:26:06.362 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:26:06.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:26:07.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:26:07.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:26:07.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:07.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:07.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:07.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:07.374 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:07.374 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:07.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:07.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:07.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:07.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:07.631 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:07.631 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:07.631 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:07.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:07.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:07.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:26:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:26:07.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:26:07.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:07.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T04:26:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T04:26:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705670' 2026-02-17T04:26:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:07.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:07.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-17T04:26:07.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-17T04:26:07.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705670 2-55834574852' 2026-02-17T04:26:07.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:07.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:07.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=73014444036 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 73014444036 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705670 2-55834574852 3-73014444036' 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:07.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:07.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:26:07.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:26:07.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:26:07.870 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:26:07.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:26:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:09.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:09.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:09.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:26:09.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:10.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:10.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:10.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-17T04:26:10.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:10.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T04:26:10.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:10.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:10.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T04:26:10.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:10.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T04:26:10.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T04:26:10.372 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705670 2026-02-17T04:26:10.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:10.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-17T04:26:10.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:10.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-17T04:26:10.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:10.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:10.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-17T04:26:10.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:10.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-17T04:26:10.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-17T04:26:10.552 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574852 2026-02-17T04:26:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:10.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574852 2026-02-17T04:26:10.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:10.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-73014444036 2026-02-17T04:26:10.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:10.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:10.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-73014444036 2026-02-17T04:26:10.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:10.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=73014444036 2026-02-17T04:26:10.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 73014444036' 2026-02-17T04:26:10.725 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 73014444036 2026-02-17T04:26:10.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:10.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 73014444036 -lt 73014444036 2026-02-17T04:26:10.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:10.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:10.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:11.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:11.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:11.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:11.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:11.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:11.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:870: corrupt_and_repair_jerasure: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:26:11.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:26:11.720 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:26:11.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:26:11.921 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:26:11.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:26:11.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:26:11.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:26:11.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:26:11.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:26:11.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:26:11.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:26:11.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:26:12.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-17T04:26:12.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:26:12.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:26:12.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:26:12.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-17T04:26:12.118 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:26:12.118 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:26:12.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-17T04:26:12.287 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:12.287 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:12.287 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:26:12.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 0 2026-02-17T04:26:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('1' '2' '0') 2026-02-17T04:26:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-17T04:26:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=1 2026-02-17T04:26:12.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=2 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:12.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:12.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:12.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:26:12.497 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:12.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:26:12.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:26:12.536 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:26:12.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:12.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:26:12.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:26:12.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:12.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:12.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:12.551 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:12.551+0000 7fe823071780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:12.553 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:12.552+0000 7fe823071780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:12.554 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:12.553+0000 7fe823071780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:12.686 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:12.685+0000 7fe823071780 -1 Falling back to public interface 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:12.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:12.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:12.971 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:12.970+0000 7fe823071780 -1 osd.3 32 log_to_monitors true 2026-02-17T04:26:13.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:13.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:13.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:13.872 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:13.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:13.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:14.037 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 36 up_thru 36 down_at 33 last_clean_interval [17,32) [v2:127.0.0.1:6826/2370674654,v1:127.0.0.1:6827/2370674654] [v2:127.0.0.1:6828/2370674654,v1:127.0.0.1:6829/2370674654] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:26:14.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:14.038 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:14.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:14.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:14.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:14.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:14.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:14.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T04:26:14.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T04:26:14.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T04:26:14.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:14.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:14.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-17T04:26:14.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-17T04:26:14.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-17T04:26:14.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:14.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:14.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-17T04:26:14.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-17T04:26:14.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855' 2026-02-17T04:26:14.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:14.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:14.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822658 2026-02-17T04:26:14.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822658 2026-02-17T04:26:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-154618822658' 2026-02-17T04:26:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:14.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T04:26:14.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:14.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:14.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T04:26:14.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T04:26:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T04:26:14.538 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836488 2026-02-17T04:26:14.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-17T04:26:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:15.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:15.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:15.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T04:26:15.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:15.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-17T04:26:15.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:15.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:15.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-17T04:26:15.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:15.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-17T04:26:15.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T04:26:15.874 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705672 2026-02-17T04:26:15.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T04:26:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:16.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-17T04:26:16.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:16.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-17T04:26:16.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:16.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-17T04:26:16.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-17T04:26:16.042 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574855 2026-02-17T04:26:16.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:16.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574855 2026-02-17T04:26:16.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:16.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-154618822658 2026-02-17T04:26:16.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:16.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-154618822658 2026-02-17T04:26:16.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:16.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822658 2026-02-17T04:26:16.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 154618822658' 2026-02-17T04:26:16.211 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 154618822658 2026-02-17T04:26:16.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:16.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822658 2026-02-17T04:26:16.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:16.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:16.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:16.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:16.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:16.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:16.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:16.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:16.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:26:16.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:17.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:17.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:17.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:17.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:26:17.462 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:17.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:17.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:17.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:17.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:17.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:18.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:18.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:18.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:18.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:18.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:18.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:18.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:18.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:18.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:19.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:19.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:19.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:19.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:19.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:19.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:19.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:19.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:19.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:20.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:20.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:20.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:20.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:20.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:20.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:21.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:21.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:22.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:22.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:22.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:22.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:22.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:22.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:22.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:22.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:22.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:23.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:23.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:23.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:23.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:23.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:23.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:23.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:23.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:06.361462+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:23.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:24.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:24.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:24.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:24.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:24.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:24.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:24.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:06.361462+0000 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:24.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:24.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:26:24.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:24.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:24.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:26:24.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:26:24.979 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:26:24.979 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:26:24.979 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:26:24.979 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:25.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:25.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:25.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:25.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:25.038 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:25.037+0000 7f3766256780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:25.039 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:25.039+0000 7f3766256780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:25.040 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:25.039+0000 7f3766256780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:25.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:25.178+0000 7f3766256780 -1 Falling back to public interface 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:25.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:25.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:25.455 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:25.454+0000 7f3766256780 -1 osd.3 39 log_to_monitors true 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:26.523 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 43 up_thru 43 down_at 40 last_clean_interval [36,39) [v2:127.0.0.1:6826/149058938,v1:127.0.0.1:6827/149058938] [v2:127.0.0.1:6828/149058938,v1:127.0.0.1:6829/149058938] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:26.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:26.525 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:26.525 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:26.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:26.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:26.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:26.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:26.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:26.774 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:26.775 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:26.775 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:26.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:26.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:26.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:26:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:26:26.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:26:26.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:26.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:26.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-17T04:26:26.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-17T04:26:26.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705676' 2026-02-17T04:26:26.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:26.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:26.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-17T04:26:26.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-17T04:26:26.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705676 2-55834574858' 2026-02-17T04:26:26.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:26.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:27.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593730 2026-02-17T04:26:27.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593730 2026-02-17T04:26:27.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705676 2-55834574858 3-184683593730' 2026-02-17T04:26:27.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:27.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:26:27.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:27.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:27.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:26:27.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:27.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:26:27.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:26:27.012 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836491 2026-02-17T04:26:27.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:27.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-17T04:26:27.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:28.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:28.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:28.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:26:28.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:28.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-17T04:26:28.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:28.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:28.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-17T04:26:28.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:28.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-17T04:26:28.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-17T04:26:28.350 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705676 2026-02-17T04:26:28.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:28.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-17T04:26:28.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:28.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-17T04:26:28.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:28.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:28.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-17T04:26:28.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:28.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-17T04:26:28.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-17T04:26:28.518 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574858 2026-02-17T04:26:28.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-17T04:26:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:28.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-184683593730 2026-02-17T04:26:28.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:28.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:28.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-184683593730 2026-02-17T04:26:28.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:28.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593730 2026-02-17T04:26:28.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 184683593730' 2026-02-17T04:26:28.686 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 184683593730 2026-02-17T04:26:28.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:28.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593730 -lt 184683593730 2026-02-17T04:26:28.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:28.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:28.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:29.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:29.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:29.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:29.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:29.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:29.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:29.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:29.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:29.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:29.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:29.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:26:29.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 1 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:26:29.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:29.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:29.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:29.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:26:29.687 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:26:29.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:29.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:29.738 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:26:29.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:26:29.740 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:26:29.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:29.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:26:29.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:26:29.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:29.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:29.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:29.750 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:29.749+0000 7f56b533d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:29.751 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:29.751+0000 7f56b533d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:29.752 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:29.752+0000 7f56b533d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:29.868 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:29.868+0000 7f56b533d780 -1 Falling back to public interface 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:29.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:30.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:30.171 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:30.170+0000 7f56b533d780 -1 osd.1 45 log_to_monitors true 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:31.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 46 last_clean_interval [9,45) [v2:127.0.0.1:6810/195024141,v1:127.0.0.1:6811/195024141] [v2:127.0.0.1:6812/195024141,v1:127.0.0.1:6813/195024141] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:31.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:31.233 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:31.233 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:31.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:31.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:31.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:31.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:31.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:31.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:31.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:31.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:31.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:31.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:31.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-17T04:26:31.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-17T04:26:31.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T04:26:31.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:31.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:31.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397506 2026-02-17T04:26:31.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397506 2026-02-17T04:26:31.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-210453397506' 2026-02-17T04:26:31.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:31.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:31.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574860 2026-02-17T04:26:31.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574860 2026-02-17T04:26:31.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-210453397506 2-55834574860' 2026-02-17T04:26:31.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:31.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:31.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593732 2026-02-17T04:26:31.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593732 2026-02-17T04:26:31.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-210453397506 2-55834574860 3-184683593732' 2026-02-17T04:26:31.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:31.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-17T04:26:31.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:31.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:31.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-17T04:26:31.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:31.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-17T04:26:31.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T04:26:31.730 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836493 2026-02-17T04:26:31.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:31.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T04:26:31.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:31.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-210453397506 2026-02-17T04:26:31.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:31.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:31.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397506 2026-02-17T04:26:31.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:31.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397506 2026-02-17T04:26:31.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 210453397506' 2026-02-17T04:26:31.899 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 210453397506 2026-02-17T04:26:31.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:32.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397506 -lt 210453397506 2026-02-17T04:26:32.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:32.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574860 2026-02-17T04:26:32.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:32.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:32.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574860 2026-02-17T04:26:32.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:32.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574860 2026-02-17T04:26:32.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574860' 2026-02-17T04:26:32.071 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574860 2026-02-17T04:26:32.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:32.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574859 -lt 55834574860 2026-02-17T04:26:32.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:33.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:33.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:33.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574859 -lt 55834574860 2026-02-17T04:26:33.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:34.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:34.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:34.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574861 -lt 55834574860 2026-02-17T04:26:34.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:34.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-184683593732 2026-02-17T04:26:34.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:34.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:34.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-184683593732 2026-02-17T04:26:34.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:34.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593732 2026-02-17T04:26:34.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 184683593732' 2026-02-17T04:26:34.586 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 184683593732 2026-02-17T04:26:34.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:34.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593732 -lt 184683593732 2026-02-17T04:26:34.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:34.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:34.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:34.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:34.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:34.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:34.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:34.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:34.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:34.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:34.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:35.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:35.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:35.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:35.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:26:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:35.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:35.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:35.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:26:35.829 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:26:35.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:36.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:36.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:37.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:37.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:37.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:38.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:38.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:38.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:38.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:38.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:38.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:39.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:39.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:39.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:39.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:39.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:39.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:39.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:39.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:39.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:40.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:40.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:40.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:40.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:40.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:18.131215+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:40.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:41.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:41.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:41.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:41.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:41.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:41.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:41.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:36.475947+0000 '>' 2026-02-17T04:26:18.131215+0000 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:41.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:41.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:41.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:41.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:26:41.992 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:26:41.992 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:26:41.992 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:26:42.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:26:42.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:26:42.042 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:26:42.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:42.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:26:42.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:26:42.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:42.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:42.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:42.054 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:42.052+0000 7efd4793d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:42.056 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:42.054+0000 7efd4793d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:42.056 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:42.055+0000 7efd4793d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:42.188 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:42.186+0000 7efd4793d780 -1 Falling back to public interface 2026-02-17T04:26:42.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:42.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:42.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:42.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:26:42.464+0000 7efd4793d780 -1 osd.3 52 log_to_monitors true 2026-02-17T04:26:43.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:43.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:43.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:43.376 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:43.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:43.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:26:43.541 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 55 up_thru 55 down_at 52 last_clean_interval [43,52) [v2:127.0.0.1:6826/1966556635,v1:127.0.0.1:6827/1966556635] [v2:127.0.0.1:6828/1966556635,v1:127.0.0.1:6829/1966556635] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:43.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:43.543 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:43.543 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:43.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:43.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:43.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:43.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:43.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:43.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:43.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:43.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:43.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:43.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:43.799 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:26:43.800 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:26:43.800 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:26:43.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:43.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:43.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:43.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-17T04:26:43.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-17T04:26:43.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-17T04:26:43.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:43.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:43.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397509 2026-02-17T04:26:43.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397509 2026-02-17T04:26:43.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-210453397509' 2026-02-17T04:26:43.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:43.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:43.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574864 2026-02-17T04:26:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574864 2026-02-17T04:26:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-210453397509 2-55834574864' 2026-02-17T04:26:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:43.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:44.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=236223201282 2026-02-17T04:26:44.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 236223201282 2026-02-17T04:26:44.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-210453397509 2-55834574864 3-236223201282' 2026-02-17T04:26:44.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:44.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836497 2026-02-17T04:26:44.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:44.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:44.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-17T04:26:44.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:44.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-17T04:26:44.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-17T04:26:44.042 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836497 2026-02-17T04:26:44.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:44.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836497 2026-02-17T04:26:44.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:45.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:45.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:45.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836497 2026-02-17T04:26:45.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:46.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:46.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:46.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836497 2026-02-17T04:26:46.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:46.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-210453397509 2026-02-17T04:26:46.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:46.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:46.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397509 2026-02-17T04:26:46.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:46.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397509 2026-02-17T04:26:46.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 210453397509' 2026-02-17T04:26:46.547 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 210453397509 2026-02-17T04:26:46.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:46.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397510 -lt 210453397509 2026-02-17T04:26:46.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:46.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574864 2026-02-17T04:26:46.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:46.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:46.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574864 2026-02-17T04:26:46.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:46.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574864 2026-02-17T04:26:46.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574864' 2026-02-17T04:26:46.717 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574864 2026-02-17T04:26:46.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574864 -lt 55834574864 2026-02-17T04:26:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:46.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-236223201282 2026-02-17T04:26:46.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:46.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:46.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-236223201282 2026-02-17T04:26:46.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:46.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=236223201282 2026-02-17T04:26:46.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 236223201282' 2026-02-17T04:26:46.891 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 236223201282 2026-02-17T04:26:46.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:47.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 236223201282 -lt 236223201282 2026-02-17T04:26:47.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:47.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:47.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:47.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:47.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:47.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:47.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:47.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:47.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:47.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:47.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:26:47.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 1 2 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=1 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=2 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:26:47.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 522576"' 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 522576' 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 522577"' 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 522577' 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 522576 522577' 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 522576 2026-02-17T04:26:47.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:47.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/522579: /' 2026-02-17T04:26:47.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:26:47.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/522581: /' 2026-02-17T04:26:47.938 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:47.939 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:47.940 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:47.941 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:26:47.942 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:47.943 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:47.943 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:47.943 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:47.944 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:47.944 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:47.944 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:26:47.944 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:47.945 INFO:tasks.workunit.client.0.trial090.stderr:522579: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:47.946 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:26:47.947 INFO:tasks.workunit.client.0.trial090.stderr:522579: start osd.1 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.948 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:47.949 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:26:47.950 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:26:47.951 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:47.952 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:47.952 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:47.952 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:47.952 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:47.953 INFO:tasks.workunit.client.0.trial090.stderr:522581: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:47.954 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:26:47.955 INFO:tasks.workunit.client.0.trial090.stderr:522581: start osd.2 2026-02-17T04:26:49.449 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:49.449 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:26:49.449 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2026-02-17T04:26:47.954+0000 7f59ab467780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2026-02-17T04:26:47.956+0000 7f59ab467780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2026-02-17T04:26:47.957+0000 7f59ab467780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:26:49.450 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: 0 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2026-02-17T04:26:48.182+0000 7f59ab467780 -1 Falling back to public interface 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2026-02-17T04:26:48.528+0000 7f59ab467780 -1 osd.1 56 log_to_monitors true 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:49.451 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: 1 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: osd.1 up in weight 1 up_from 60 up_thru 60 down_at 57 last_clean_interval [49,56) [v2:127.0.0.1:6810/2771454775,v1:127.0.0.1:6811/2771454775] [v2:127.0.0.1:6812/2771454775,v1:127.0.0.1:6813/2771454775] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:49.452 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:49.453 INFO:tasks.workunit.client.0.trial090.stderr:522579: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522579: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2026-02-17T04:26:47.957+0000 7f08a642c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2026-02-17T04:26:47.958+0000 7f08a642c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.458 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2026-02-17T04:26:47.959+0000 7f08a642c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: 0 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2026-02-17T04:26:48.189+0000 7f08a642c780 -1 Falling back to public interface 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2026-02-17T04:26:48.528+0000 7f08a642c780 -1 osd.2 57 log_to_monitors true 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: 1 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: osd.2 up in weight 1 up_from 60 up_thru 46 down_at 57 last_clean_interval [13,57) [v2:127.0.0.1:6818/2576388361,v1:127.0.0.1:6819/2576388361] [v2:127.0.0.1:6820/2576388361,v1:127.0.0.1:6821/2576388361] exists,up 3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:49.459 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:49.460 INFO:tasks.workunit.client.0.trial090.stderr:522581: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522581: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: 1 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: 2 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: 3' 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:49.956 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499' 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=257698037762 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 257698037762 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-257698037762' 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=257698037762 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 257698037762 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-257698037762 2-257698037762' 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=236223201284 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 236223201284 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-257698037762 2-257698037762 3-236223201284' 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:3: get_timeout_delays: echo true 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:49.957 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: 1 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: 2 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: 3' 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=257698037763 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 257698037763 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-257698037763' 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=257698037763 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 257698037763 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-257698037763 2-257698037763' 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=236223201285 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 236223201285 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-257698037763 2-257698037763 3-236223201285' 2026-02-17T04:26:49.958 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:52.641 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: waiting osd.0 seq 21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 257698037763' 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: waiting osd.1 seq 257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 257698037763 -lt 257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-257698037763 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.642 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=257698037763 2026-02-17T04:26:52.651 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_s flush_pg_stats: echo 0-21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: waiting osd.0 seq 21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836499 2026-02-17T04:26:52.652 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836499 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-257698037762 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-257698037762 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=257698037762 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 257698037762' 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: waiting osd.1 seq 257698037762 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 257698037763 -lt 257698037762 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:52.653 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-257698037762 2026-02-17T04:26:52.654 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:52.654 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:26:52.654 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-257698037762 2026-02-17T04:26:52.654 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:52.654 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=257698037762 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 257698037763' 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: waiting osd.2 seq 257698037763 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 257698037763 -lt 257698037763 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-236223201285 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-236223201285 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=236223201285 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 236223201285' 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: waiting osd.3 seq 236223201285 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 236223201285 -lt 236223201285 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:53.567 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:53.568 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:53.569 INFO:tasks.workunit.client.0.trial090.stderr:522581: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:53.569 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:53.569 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:53.569 INFO:tasks.workunit.client.0.trial090.stderr:522581: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:53.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:26:53.591 INFO:tasks.workunit.client.0.trial090.stderr:tats: echo 'waiting osd.2 seq 257698037762' 2026-02-17T04:26:53.592 INFO:tasks.workunit.client.0.trial090.stderr:522579: waiting osd.2 seq 257698037762 2026-02-17T04:26:53.592 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:26:53.592 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 257698037763 -lt 257698037762 2026-02-17T04:26:53.592 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-236223201284 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-236223201284 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=236223201284 2026-02-17T04:26:53.593 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 236223201284' 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: waiting osd.3 seq 236223201284 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 236223201285 -lt 236223201284 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:53.594 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:26:53.595 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:26:53.596 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr:522579: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 522577 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:26:53.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:26:53.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:26:53.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:26:53.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:26:53.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:26:53.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:53.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:53.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:53.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:26:54.081 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:54.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:54.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:54.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:54.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:54.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:54.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:36.475947+0000 '>' 2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:54.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:55.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:55.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:55.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:55.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:55.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:55.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:55.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:55.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:36.475947+0000 '>' 2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:55.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:56.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:56.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:56.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:56.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:56.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:56.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:56.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:36.475947+0000 '>' 2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:56.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:26:57.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:26:57.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:26:57.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:26:57.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:26:57.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:26:57.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:26:57.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:26:57.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:36.475947+0000 2026-02-17T04:26:57.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:26:57.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:26:57.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 525421"' 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 525421' 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 525422"' 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 525422' 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 525421 525422' 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 525421 2026-02-17T04:26:57.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:26:57.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/525424: /' 2026-02-17T04:26:57.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:26:57.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/525426: /' 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:57.971 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: _ 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: hinfo_key 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: snapset 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:57.972 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:57.973 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:26:57.974 INFO:tasks.workunit.client.0.trial090.stderr:525424: start osd.1 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.977 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING list-attrs 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: _ 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: hinfo_key 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: snapset 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:26:57.978 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:26:57.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: start osd.2 2026-02-17T04:26:59.484 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:26:59.484 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:26:59.484 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:26:59.484 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2026-02-17T04:26:57.986+0000 7f3fb3264780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2026-02-17T04:26:57.987+0000 7f3fb3264780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2026-02-17T04:26:57.988+0000 7f3fb3264780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:59.485 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: 0 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2026-02-17T04:26:58.206+0000 7f3fb3264780 -1 Falling back to public interface 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2026-02-17T04:26:58.584+0000 7f3fb3264780 -1 osd.1 63 log_to_monitors true 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: 1 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:59.486 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: osd.1 up in weight 1 up_from 67 up_thru 67 down_at 64 last_clean_interval [60,63) [v2:127.0.0.1:6810/2750518962,v1:127.0.0.1:6811/2750518962] [v2:127.0.0.1:6812/2750518962,v1:127.0.0.1:6813/2750518962] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:59.487 INFO:tasks.workunit.client.0.trial090.stderr:525424: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525424: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helprecovery_ops 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:26:59.490 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2026-02-17T04:26:57.993+0000 7f05ff662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2026-02-17T04:26:57.995+0000 7f05ff662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2026-02-17T04:26:57.996+0000 7f05ff662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 0 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2026-02-17T04:26:58.225+0000 7f05ff662780 -1 Falling back to public interface 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2026-02-17T04:26:58.610+0000 7f05ff662780 -1 osd.2 63 log_to_monitors true 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: 1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: osd.2 up in weight 1 up_from 67 up_thru 46 down_at 64 last_clean_interval [60,63) [v2:127.0.0.1:6818/2752639832,v1:127.0.0.1:6819/2752639832] [v2:127.0.0.1:6820/2752639832,v1:127.0.0.1:6821/2752639832] exists,up 3dff415e-bcb0-47fa-a9b7-bde712336a7d 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:26:59.491 INFO:tasks.workunit.client.0.trial090.stderr:525426: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:26:59.979 INFO:tasks.workunit.client.0.trial090.stderr:525426: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:59.979 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:59.980 INFO:tasks.workunit.client.0.trial090.stderr:525426: 1 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: 2 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: 3' 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836504 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836504 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504' 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-17T04:26:59.981 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-287762808835' 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808835 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808835 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-287762808835 2-287762808835' 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=236223201288 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 236223201288 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-287762808835 2-287762808835 3-236223201288' 2026-02-17T04:26:59.982 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:26:59.983 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helperers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:26:59.983 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:26:59.983 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:26:59.983 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:26:59.983 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: 1 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: 2 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: 3' 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.984 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808834 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808834 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-287762808834' 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808834 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808834 2026-02-17T04:26:59.985 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-287762808834 2-287762808834' 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=236223201289 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 236223201289 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-287762808834 2-287762808834 3-236223201289' 2026-02-17T04:26:59.986 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:02.666 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836504 2026-02-17T04:27:02.666 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836504 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836504 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: waiting osd.0 seq 21474836504 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836504 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:02.667 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836504 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836504 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-287762808835 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-287762808835 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808835 2026-02-17T04:27:02.668 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 287762808835' 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: waiting osd.1 seq 287762808835 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808835 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808835 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.669 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808835 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: s.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: waiting osd.0 seq 21474836503 2026-02-17T04:27:02.683 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836503 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836503 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836503 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-287762808834 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.684 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-287762808834 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808834 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 287762808834' 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: waiting osd.1 seq 287762808834 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808835 -lt 287762808834 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808834 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:02.685 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808834 2026-02-17T04:27:02.686 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:02.686 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808834 2026-02-17T04:27:03.605 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 287762808835' 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: waiting osd.2 seq 287762808835 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808835 -lt 287762808835 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-236223201288 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-236223201288 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:03.606 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=236223201288 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 236223201288' 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: waiting osd.3 seq 236223201288 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 236223201289 -lt 236223201288 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:03.607 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:525426: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:03.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:03.633 INFO:tasks.workunit.client.0.trial090.stderr:flush_pg_stats: echo 'waiting osd.2 seq 287762808834' 2026-02-17T04:27:03.633 INFO:tasks.workunit.client.0.trial090.stderr:525424: waiting osd.2 seq 287762808834 2026-02-17T04:27:03.633 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808835 -lt 287762808834 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-236223201289 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-236223201289 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=236223201289 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 236223201289' 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: waiting osd.3 seq 236223201289 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:03.634 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 236223201289 -lt 236223201289 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:03.635 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:03.636 INFO:tasks.workunit.client.0.trial090.stderr:525424: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 525422 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:27:03.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:27:03.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:27:03.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:27:03.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:27:03.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 1 2026-02-17T04:27:03.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:27:03.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=1 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 527752"' 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 527752' 2026-02-17T04:27:03.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 527753"' 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 527753' 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 527752 527753' 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 527752 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/527755: /' 2026-02-17T04:27:03.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:03.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/527757: /' 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:04.110 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: 527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:27:04.111 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:04.112 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: start osd.1 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_oactivate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:04.113 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:27:04.114 INFO:tasks.workunit.client.0.trial090.stderr:527755: start osd.3 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2026-02-17T04:27:04.125+0000 7f263ff3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2026-02-17T04:27:04.126+0000 7f263ff3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2026-02-17T04:27:04.127+0000 7f263ff3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: 0 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2026-02-17T04:27:04.331+0000 7f263ff3d780 -1 Falling back to public interface 2026-02-17T04:27:05.618 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2026-02-17T04:27:04.674+0000 7f263ff3d780 -1 osd.3 68 log_to_monitors true 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: 1 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: osd.3 up in weight 1 up_from 72 up_thru 72 down_at 69 last_clean_interval [55,68) [v2:127.0.0.1:6810/4134062900,v1:127.0.0.1:6811/4134062900] [v2:127.0.0.1:6812/4134062900,v1:127.0.0.1:6813/4134062900] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:05.619 INFO:tasks.workunit.client.0.trial090.stderr:527755: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527755: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2026-02-17T04:27:04.125+0000 7fb812642780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2026-02-17T04:27:04.126+0000 7fb812642780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2026-02-17T04:27:04.127+0000 7fb812642780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 0 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2026-02-17T04:27:04.335+0000 7fb812642780 -1 Falling back to public interface 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2026-02-17T04:27:04.668+0000 7fb812642780 -1 osd.1 68 log_to_monitors true 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: 1 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:05.627 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: osd.1 up in weight 1 up_from 72 up_thru 72 down_at 69 last_clean_interval [67,68) [v2:127.0.0.1:6826/922731549,v1:127.0.0.1:6827/922731549] [v2:127.0.0.1:6828/922731549,v1:127.0.0.1:6829/922731549] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:05.628 INFO:tasks.workunit.client.0.trial090.stderr:527757: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:06.116 INFO:tasks.workunit.client.0.trial090.stderr:527757: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:06.117 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: 1 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: 2 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: 3' 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:06.118 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645314 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645314 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-309237645314' 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808838 2026-02-17T04:27:06.119 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808838 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-309237645314 2-287762808838' 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645314 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645314 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-309237645314 2-287762808838 3-309237645314' 2026-02-17T04:27:06.120 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flu3: get_timeout_delays: echo true 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:06.121 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: 1 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: 2 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: 3' 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:06.122 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645315 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645315 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-309237645315' 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808837 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808837 2026-02-17T04:27:06.123 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-309237645315 2-287762808837' 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645315 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645315 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-309237645315 2-287762808837 3-309237645315' 2026-02-17T04:27:06.124 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:08.803 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:sh_pg_stats: echo 0-21474836506 2026-02-17T04:27:08.803 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.803 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:08.803 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: waiting osd.0 seq 21474836506 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836506 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836506 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:08.804 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836507 -lt 21474836506 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-309237645314 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-309237645314 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645314 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 309237645314' 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: waiting osd.1 seq 309237645314 2026-02-17T04:27:08.805 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645314 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808838 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808838 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.806 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808838 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats flush_pg_stats: echo 0-21474836507 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: waiting osd.0 seq 21474836507 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836507 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.813 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836507 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836507 -lt 21474836507 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-309237645315 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-309237645315 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645315 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 309237645315' 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: waiting osd.1 seq 309237645315 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645315 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808837 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808837 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:08.814 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808837 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 287762808837' 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: waiting osd.2 seq 287762808837 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808838 -lt 287762808837 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-309237645315 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-309237645315 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645315 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 309237645315' 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: waiting osd.3 seq 309237645315 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645315 2026-02-17T04:27:09.737 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:527755: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:09.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:27:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 527753 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:: echo 'waiting osd.2 seq 287762808838' 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: waiting osd.2 seq 287762808838 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808838 -lt 287762808838 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-309237645314 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:09.756 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-309237645314 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645314 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 309237645314' 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: waiting osd.3 seq 309237645314 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645314 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:09.757 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:09.758 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:09.759 INFO:tasks.workunit.client.0.trial090.stderr:527757: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:27:09.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:27:09.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:27:09.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:27:09.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:27:09.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:27:09.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:27:09.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:27:09.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:27:09.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:27:09.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:27:09.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:09.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:09.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:09.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:10.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:10.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:27:10.246 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:27:10.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:10.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:10.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:10.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:10.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:10.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:10.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:10.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:11.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:11.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:11.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:11.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:11.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:11.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:11.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:11.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:11.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:12.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:12.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:12.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:12.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:12.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:12.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:12.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:13.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:13.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:13.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:13.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:13.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:13.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:13.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:13.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:13.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:14.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:14.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:14.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:14.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:14.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:14.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:14.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:15.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:26:54.394160+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:15.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:16.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:16.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:16.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:16.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:10.698381+0000 '>' 2026-02-17T04:26:54.394160+0000 2026-02-17T04:27:16.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 530649"' 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 530649' 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:27:16.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 530650"' 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 530650' 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 530649 530650' 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 530649 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/530652: /' 2026-02-17T04:27:16.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:27:16.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/530654: /' 2026-02-17T04:27:16.675 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.675 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:16.675 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:16.676 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:27:16.677 INFO:tasks.workunit.client.0.trial090.stderr:530652: _ 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: hinfo_key 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: snapset 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:16.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:16.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:16.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:27:16.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: start osd.3 2026-02-17T04:27:16.684 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$n530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:16.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:27:16.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:16.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: _ 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: hinfo_key 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: snapset 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:16.686 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:16.687 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:16.688 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:27:16.689 INFO:tasks.workunit.client.0.trial090.stderr:530654: start osd.1 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_ame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2026-02-17T04:27:16.690+0000 7fbf7b62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2026-02-17T04:27:16.691+0000 7fbf7b62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2026-02-17T04:27:16.692+0000 7fbf7b62c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:18.183 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: 0 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2026-02-17T04:27:16.925+0000 7fbf7b62c780 -1 Falling back to public interface 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2026-02-17T04:27:17.287+0000 7fbf7b62c780 -1 osd.3 74 log_to_monitors true 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: 1 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: osd.3 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [72,74) [v2:127.0.0.1:6810/3599783983,v1:127.0.0.1:6812/3599783983] [v2:127.0.0.1:6814/3599783983,v1:127.0.0.1:6816/3599783983] exists,up f1d1058a-36c7-4b77-bc74-b3a20e81f0fb 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:18.184 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeoutrecovery_ops 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:18.189 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2026-02-17T04:27:16.698+0000 7fce2bc4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2026-02-17T04:27:16.700+0000 7fce2bc4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2026-02-17T04:27:16.700+0000 7fce2bc4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 0 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2026-02-17T04:27:16.925+0000 7fce2bc4c780 -1 Falling back to public interface 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2026-02-17T04:27:17.282+0000 7fce2bc4c780 -1 osd.1 74 log_to_monitors true 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: 1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: osd.1 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [72,74) [v2:127.0.0.1:6811/3661534825,v1:127.0.0.1:6813/3661534825] [v2:127.0.0.1:6815/3661534825,v1:127.0.0.1:6826/3661534825] exists,up 41a70a53-19a7-4ba1-aeaa-070e7e81c3ef 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:18.190 INFO:tasks.workunit.client.0.trial090.stderr:530654: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:18.678 INFO:tasks.workunit.client.0.trial090.stderr:530654: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-help_delays 90 .1 2026-02-17T04:27:18.678 INFO:tasks.workunit.client.0.trial090.stderr:530652: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:18.679 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: 1 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: 2 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: 3' 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-17T04:27:18.680 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-335007449090' 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808841 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808841 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-335007449090 2-287762808841' 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-17T04:27:18.681 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-335007449090 2-287762ers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:18.682 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: 1 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: 2 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: 3' 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-17T04:27:18.683 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449091 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449091 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-335007449091' 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808842 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808842 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-335007449091 2-287762808842' 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:18.684 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449091 2026-02-17T04:27:18.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449091 2026-02-17T04:27:18.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-335007449091 2-287762808842 3-335007449091' 2026-02-17T04:27:18.685 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.361 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper808841 3-335007449090' 2026-02-17T04:27:20.361 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: waiting osd.0 seq 21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836510 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449090 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449090 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449090' 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: waiting osd.1 seq 335007449090 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449090 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808841 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808841 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808841 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 287762808841' 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: waiting osd.2 seq 287762808841 2026-02-17T04:27:20.362 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/stans.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: waiting osd.0 seq 21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836511 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449091 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449091 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449091 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449091' 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: waiting osd.1 seq 335007449091 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449091 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-287762808842 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-287762808842 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808842 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 287762808842' 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: waiting osd.2 seq 287762808842 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808843 -lt 287762808842 2026-02-17T04:27:20.366 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:21.129 INFO:tasks.workunit.client.0.trial090.stderr:530654: //homdalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808843 -lt 287762808841 2026-02-17T04:27:21.129 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-335007449090 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-335007449090 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 335007449090' 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: waiting osd.3 seq 335007449090 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449090 2026-02-17T04:27:21.130 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:21.131 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:530652: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:530652: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:27:21.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 530650 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-335007449091 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-335007449091 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449091 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 335007449091' 2026-02-17T04:27:21.136 INFO:tasks.workunit.client.0.trial090.stderr:530654: waiting osd.3 seq 335007449091 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449091 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:21.137 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:530654: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:27:21.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:27:21.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:27:21.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:27:21.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:27:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:27:21.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:27:21.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:21.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:21.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:21.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:21.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:27:21.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:27:21.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:27:21.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:27:21.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:27:21.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:27:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:27:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:27:21.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:27:21.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:27:21.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:27:21.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:27:21.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:27:21.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:27:21.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:21.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:21.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:27:21.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:27:21.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:27:21.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:27:21.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:27:21.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:27:21.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:27:21.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:27:21.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:27:21.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:27:21.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:27:21.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:27:21.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:27:21.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:27:21.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:27:21.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:27:21.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:27:21.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:27:21.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:27:21.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:27:21.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:27:21.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:27:21.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:27:21.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:27:21.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_jerasure_overwrites td/osd-scrub-repair 2026-02-17T04:27:21.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:878: TEST_corrupt_and_repair_jerasure_overwrites: '[' true = true ']' 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:879: TEST_corrupt_and_repair_jerasure_overwrites: corrupt_and_repair_jerasure td/osd-scrub-repair true 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:857: corrupt_and_repair_jerasure: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:858: corrupt_and_repair_jerasure: local allow_overwrites=true 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:859: corrupt_and_repair_jerasure: local poolname=ecpool 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:861: corrupt_and_repair_jerasure: run_mon td/osd-scrub-repair a 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:27:21.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.324 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:21.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:27:21.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:27:21.349 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:27:21.350 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.350 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.350 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:27:21.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:27:21.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:27:21.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:27:21.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:27:21.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:27:21.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:27:21.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:27:21.395 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:27:21.395 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:27:21.395 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:27:21.395 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:27:21.395 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.396 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.396 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:27:21.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:27:21.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:27:21.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:862: corrupt_and_repair_jerasure: run_mgr td/osd-scrub-repair x 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:27:21.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:21.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:27:21.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:27:21.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: seq 0 3 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 0 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:21.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:21.540 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:27:21.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:27:21.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:27:21.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:27:21.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=53e4131c-dbbd-4f81-8e7b-33bd92855e42 2026-02-17T04:27:21.543 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 53e4131c-dbbd-4f81-8e7b-33bd92855e42 2026-02-17T04:27:21.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 53e4131c-dbbd-4f81-8e7b-33bd92855e42' 2026-02-17T04:27:21.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:27:21.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAp7pNp2yqlIBAAm7kc9HrGYv7b5AZ7YN7TlA== 2026-02-17T04:27:21.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAp7pNp2yqlIBAAm7kc9HrGYv7b5AZ7YN7TlA=="}' 2026-02-17T04:27:21.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 53e4131c-dbbd-4f81-8e7b-33bd92855e42 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:27:21.628 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:27:21.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:27:21.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAp7pNp2yqlIBAAm7kc9HrGYv7b5AZ7YN7TlA== --osd-uuid 53e4131c-dbbd-4f81-8e7b-33bd92855e42 2026-02-17T04:27:21.650 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:21.649+0000 7f2f98013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:21.651 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:21.650+0000 7f2f98013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:21.652 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:21.651+0000 7f2f98013780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:21.653 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:21.652+0000 7f2f98013780 -1 bdev(0x2f88c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:27:21.653 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:21.652+0000 7f2f98013780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:27:22.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:27:22.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:27:22.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:27:22.085 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:27:22.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:27:22.170 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:27:22.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:27:22.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:22.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:27:22.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:27:22.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:27:22.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:22.184+0000 7fa174e49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:22.186 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:22.185+0000 7fa174e49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:22.187 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:22.186+0000 7fa174e49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:22.251 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:27:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:22.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:27:22.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:22.398 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:22.397+0000 7fa174e49780 -1 Falling back to public interface 2026-02-17T04:27:22.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:22.715+0000 7fa174e49780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:27:23.409 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/254310166,v1:127.0.0.1:6801/254310166] [v2:127.0.0.1:6802/254310166,v1:127.0.0.1:6803/254310166] exists,up 53e4131c-dbbd-4f81-8e7b-33bd92855e42 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 1 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:23.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:23.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c6594ddc-8c79-49bc-965a-37aa48ea0029' 2026-02-17T04:27:23.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:27:23.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAr7pNph+0TGRAA6Jr/zUsJ9vTw7heu7f42jA== 2026-02-17T04:27:23.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAr7pNph+0TGRAA6Jr/zUsJ9vTw7heu7f42jA=="}' 2026-02-17T04:27:23.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c6594ddc-8c79-49bc-965a-37aa48ea0029 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:27:23.503 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:27:23.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:27:23.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAr7pNph+0TGRAA6Jr/zUsJ9vTw7heu7f42jA== --osd-uuid c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:27:23.526 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:23.525+0000 7f8e2d40d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:23.527 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:23.526+0000 7f8e2d40d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:23.528 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:23.527+0000 7f8e2d40d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:23.528 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:23.527+0000 7f8e2d40d780 -1 bdev(0x41e4c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:27:23.528 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:23.527+0000 7f8e2d40d780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:27:23.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:27:23.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:27:23.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:27:23.878 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:27:23.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:27:24.091 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:27:24.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:27:24.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:24.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:27:24.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:27:24.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:27:24.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:24.105+0000 7f3d63241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:24.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:24.107+0000 7f3d63241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:24.108 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:24.108+0000 7f3d63241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:24.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:27:24.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:24.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:24.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:24.309 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:24.308+0000 7f3d63241780 -1 Falling back to public interface 2026-02-17T04:27:24.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:24.621 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:24.620+0000 7f3d63241780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:27:25.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:25.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:25.421 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:27:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:25.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:25.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:25.583 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4042575413,v1:127.0.0.1:6811/4042575413] [v2:127.0.0.1:6812/4042575413,v1:127.0.0.1:6813/4042575413] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 2 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:27:25.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:25.585 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:27:25.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:27:25.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:27:25.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:27:25.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 004bf718-c822-4f4e-8170-2cf9fe481fe1' 2026-02-17T04:27:25.588 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:27:25.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:27:25.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAt7pNponqSIxAAuwfnCZtWbJbD8uVMcaXm+A== 2026-02-17T04:27:25.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAt7pNponqSIxAAuwfnCZtWbJbD8uVMcaXm+A=="}' 2026-02-17T04:27:25.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 004bf718-c822-4f4e-8170-2cf9fe481fe1 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:27:25.760 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:27:25.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:27:25.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAt7pNponqSIxAAuwfnCZtWbJbD8uVMcaXm+A== --osd-uuid 004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:27:25.785 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:25.784+0000 7fe11a016780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:25.786 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:25.786+0000 7fe11a016780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:25.787 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:25.787+0000 7fe11a016780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:25.788 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:25.787+0000 7fe11a016780 -1 bdev(0x42b6c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:27:25.788 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:25.787+0000 7fe11a016780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:27:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:27:26.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:27:26.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:27:26.119 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:27:26.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:27:26.329 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:27:26.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:27:26.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:26.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:27:26.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:27:26.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:27:26.345 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:26.344+0000 7fd19863d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:26.346 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:26.345+0000 7fd19863d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:26.347 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:26.346+0000 7fd19863d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:26.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:26.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:27:26.536 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:26.535+0000 7fd19863d780 -1 Falling back to public interface 2026-02-17T04:27:26.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:26.831 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:26.830+0000 7fd19863d780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:27:27.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:27.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:27.666 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:27:27.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:27.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:27.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:27:27.827 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3180185500,v1:127.0.0.1:6819/3180185500] [v2:127.0.0.1:6820/3180185500,v1:127.0.0.1:6821/3180185500] exists,up 004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 3 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:27:27.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:27.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:27:27.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:27:27.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:27.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5c8ab085-fcd6-4eb1-b45f-1c5696c15909' 2026-02-17T04:27:27.833 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:27.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:27:27.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAv7pNpet8jMhAAdDfKfzPR4OQnna5VKIuBrQ== 2026-02-17T04:27:27.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAv7pNpet8jMhAAdDfKfzPR4OQnna5VKIuBrQ=="}' 2026-02-17T04:27:27.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 -i td/osd-scrub-repair/3/new.json 2026-02-17T04:27:28.005 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:27:28.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:27:28.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAv7pNpet8jMhAAdDfKfzPR4OQnna5VKIuBrQ== --osd-uuid 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:28.029 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.028+0000 7fcc15243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.031 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.030+0000 7fcc15243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.031 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.031+0000 7fcc15243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.032 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.031+0000 7fcc15243780 -1 bdev(0x29e8c00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:27:28.032 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.031+0000 7fcc15243780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:27:28.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:27:28.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:27:28.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:27:28.347 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:27:28.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:27:28.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:27:28.554 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:27:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:27:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:27:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:27:28.568 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.567+0000 7fce1b64a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.569 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.569+0000 7fce1b64a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.570 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.570+0000 7fce1b64a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:28.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:28.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:28.722 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:27:28.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:28.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:28.738 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:28.737+0000 7fce1b64a780 -1 Falling back to public interface 2026-02-17T04:27:28.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:29.045 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:29.045+0000 7fce1b64a780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:27:29.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:29.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:29.890 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:27:29.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:29.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:29.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:30.057 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1386967898,v1:127.0.0.1:6827/1386967898] [v2:127.0.0.1:6828/1386967898,v1:127.0.0.1:6829/1386967898] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:866: corrupt_and_repair_jerasure: create_rbd_pool 2026-02-17T04:27:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:27:30.214 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:27:30.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:27:30.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:27:30.440 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:27:30.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:27:31.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:27:31.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:867: corrupt_and_repair_jerasure: wait_for_clean 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:31.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:31.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:31.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:31.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:31.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:31.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:31.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:31.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:31.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:31.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:27:31.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:27:31.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:27:31.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:31.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:32.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:27:32.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:27:32.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-17T04:27:32.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:32.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:27:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:27:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-17T04:27:32.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:32.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:32.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411330 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411330 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146 3-77309411330' 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:32.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:27:32.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:32.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:27:32.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:27:32.170 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:27:32.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:32.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:27:32.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:33.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:33.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:33.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:27:33.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:34.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:34.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:34.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:27:34.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:34.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:27:34.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:34.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:34.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:27:34.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:34.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:27:34.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:27:34.675 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:27:34.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:34.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:27:34.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:34.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:27:34.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:34.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:34.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:27:34.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:34.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:27:34.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:27:34.847 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:27:34.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:35.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-17T04:27:35.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:35.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411330 2026-02-17T04:27:35.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:35.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:35.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411330 2026-02-17T04:27:35.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:35.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411330 2026-02-17T04:27:35.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411330' 2026-02-17T04:27:35.016 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 77309411330 2026-02-17T04:27:35.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:35.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411330 -lt 77309411330 2026-02-17T04:27:35.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:35.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:35.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:35.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:27:35.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:35.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:35.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:27:35.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:35.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:35.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:869: corrupt_and_repair_jerasure: create_ec_pool ecpool true k=2 m=2 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:27:35.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-17T04:27:35.986 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:27:35.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:27:35.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:27:36.291 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:27:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:27:37.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:27:37.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:27:37.493 INFO:tasks.workunit.client.0.trial090.stderr:set pool 2 allow_ec_overwrites to true 2026-02-17T04:27:37.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:27:37.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:37.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:37.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:37.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:37.505 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:37.505 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:37.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:37.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:37.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:37.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:37.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:37.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:37.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:37.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:37.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:37.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:37.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:37.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:27:37.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:27:37.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:27:37.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:37.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:37.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:27:37.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:27:37.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705669' 2026-02-17T04:27:37.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:37.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:37.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:27:37.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:27:37.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705669 2-60129542148' 2026-02-17T04:27:37.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:37.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411332 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411332 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705669 2-60129542148 3-77309411332' 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:27:37.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:37.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:38.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:27:38.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:38.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:27:38.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:27:38.001 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:27:38.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:38.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:27:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:39.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:39.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:39.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:27:39.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:40.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:27:40.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:40.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-17T04:27:40.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:40.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:27:40.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:40.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:27:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:27:40.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:27:40.505 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:27:40.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:40.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T04:27:40.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:40.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:27:40.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:40.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:40.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:27:40.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:40.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:27:40.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:27:40.673 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542148 2026-02-17T04:27:40.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:40.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542148 2026-02-17T04:27:40.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411332 2026-02-17T04:27:40.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:40.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:40.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411332 2026-02-17T04:27:40.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:40.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411332 2026-02-17T04:27:40.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411332' 2026-02-17T04:27:40.844 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 77309411332 2026-02-17T04:27:40.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:41.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411332 -lt 77309411332 2026-02-17T04:27:41.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:41.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:41.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:41.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:41.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:41.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:41.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:41.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:41.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:41.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:41.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:41.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:41.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:41.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:41.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:870: corrupt_and_repair_jerasure: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:27:41.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:27:41.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:27:41.791 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:27:41.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:27:41.992 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:27:42.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:27:42.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:27:42.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:27:42.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:27:42.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:27:42.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:27:42.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:27:42.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:27:42.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-17T04:27:42.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:27:42.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:27:42.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:27:42.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-17T04:27:42.190 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:27:42.190 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:27:42.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-17T04:27:42.359 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:42.359 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:42.359 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:27:42.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 0 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('1' '2' '0') 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=1 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=2 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-17T04:27:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:27:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:42.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:42.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:27:42.757 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:27:42.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:27:42.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:27:42.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:42.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:27:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:27:42.801 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:27:42.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:42.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:27:42.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:27:42.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:42.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:42.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:42.813 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:42.811+0000 7fc95760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:42.814 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:42.812+0000 7fc95760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:42.815 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:42.813+0000 7fc95760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:42.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:42.937+0000 7fc95760d780 -1 Falling back to public interface 2026-02-17T04:27:42.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:42.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:43.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:43.226 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:43.224+0000 7fc95760d780 -1 osd.3 35 log_to_monitors true 2026-02-17T04:27:44.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:44.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:44.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:44.128 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:44.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:44.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:44.292 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [18,35) [v2:127.0.0.1:6826/1844771850,v1:127.0.0.1:6827/1844771850] [v2:127.0.0.1:6828/1844771850,v1:127.0.0.1:6829/1844771850] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:44.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:44.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:44.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:44.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:44.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:44.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:44.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:44.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:44.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:44.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:44.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:44.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T04:27:44.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T04:27:44.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T04:27:44.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:44.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:44.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-17T04:27:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-17T04:27:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705671' 2026-02-17T04:27:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:44.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:44.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T04:27:44.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T04:27:44.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705671 2-60129542151' 2026-02-17T04:27:44.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:44.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:44.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T04:27:44.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T04:27:44.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705671 2-60129542151 3-167503724546' 2026-02-17T04:27:44.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:44.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T04:27:44.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:44.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:44.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T04:27:44.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:44.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T04:27:44.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T04:27:44.781 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836488 2026-02-17T04:27:44.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:44.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-17T04:27:44.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:45.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:45.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:46.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T04:27:46.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:46.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-17T04:27:46.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:46.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:46.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-17T04:27:46.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:46.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-17T04:27:46.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-17T04:27:46.118 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705671 2026-02-17T04:27:46.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:46.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-17T04:27:46.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:46.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T04:27:46.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:46.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:46.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T04:27:46.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:46.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T04:27:46.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T04:27:46.285 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542151 2026-02-17T04:27:46.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:46.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542151 2026-02-17T04:27:46.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:46.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-167503724546 2026-02-17T04:27:46.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:46.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:46.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-167503724546 2026-02-17T04:27:46.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:46.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T04:27:46.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 167503724546' 2026-02-17T04:27:46.463 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 167503724546 2026-02-17T04:27:46.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:46.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T04:27:46.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:46.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:46.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:46.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:47.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:47.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:47.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:47.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:47.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:47.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:47.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:47.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:27:47.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:27:47.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:27:47.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:27:47.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:47.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:47.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:47.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:27:47.704 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:27:47.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:47.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:27:47.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:47.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:27:47.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:47.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:47.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:36.289720+0000 '>' 2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:47.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:49.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:36.289720+0000 '>' 2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:49.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:27:50.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:27:50.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:27:50.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:27:50.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:50.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:50.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:50.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:50.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:48.234439+0000 '>' 2026-02-17T04:27:36.289720+0000 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:50.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:50.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:50.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:27:50.368 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:27:50.368 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:27:50.368 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:27:50.369 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:27:50.369 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:27:50.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:27:50.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:50.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:50.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:50.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:50.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:27:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:27:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:50.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:50.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:50.438 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:50.436+0000 7fcc2ca5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:50.439 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:50.437+0000 7fcc2ca5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:50.440 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:50.438+0000 7fcc2ca5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:50.574 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:50.572+0000 7fcc2ca5f780 -1 Falling back to public interface 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:50.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:50.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:50.594 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:27:50.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:50.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:50.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:50.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:50.936+0000 7fcc2ca5f780 -1 osd.3 40 log_to_monitors true 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:51.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:27:51.928 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 44 up_thru 44 down_at 41 last_clean_interval [39,40) [v2:127.0.0.1:6826/2960989895,v1:127.0.0.1:6827/2960989895] [v2:127.0.0.1:6828/2960989895,v1:127.0.0.1:6829/2960989895] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:27:51.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:51.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:51.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:51.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:52.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:52.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:52.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:52.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T04:27:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T04:27:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T04:27:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:52.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:52.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:27:52.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:27:52.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-17T04:27:52.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:52.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:52.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T04:27:52.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T04:27:52.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153' 2026-02-17T04:27:52.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:52.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:52.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-17T04:27:52.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-17T04:27:52.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153 3-188978561026' 2026-02-17T04:27:52.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:52.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T04:27:52.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:52.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:52.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T04:27:52.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:52.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T04:27:52.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T04:27:52.420 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836490 2026-02-17T04:27:52.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:52.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836490 2026-02-17T04:27:52.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:53.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:53.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:53.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T04:27:53.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:53.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:27:53.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:53.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:53.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:27:53.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:53.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:27:53.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:27:53.756 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705674 2026-02-17T04:27:53.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:53.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:27:53.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:53.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T04:27:53.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:53.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:53.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T04:27:53.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:53.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T04:27:53.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T04:27:53.923 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542153 2026-02-17T04:27:53.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:54.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542153 2026-02-17T04:27:54.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:54.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-188978561026 2026-02-17T04:27:54.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:54.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:54.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-188978561026 2026-02-17T04:27:54.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-17T04:27:54.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 188978561026' 2026-02-17T04:27:54.089 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 188978561026 2026-02-17T04:27:54.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:54.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-17T04:27:54.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:54.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:54.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:54.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:54.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:54.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:54.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:54.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:54.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:54.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:54.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:54.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:54.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:27:54.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 1 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:27:54.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:27:54.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:27:54.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:27:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:27:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:27:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:27:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:27:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:27:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:27:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:27:55.086 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:27:55.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:27:55.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:27:55.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:27:55.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:27:55.129 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:27:55.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:27:55.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:27:55.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:27:55.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:27:55.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:27:55.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:27:55.143 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:55.141+0000 7fbf4040a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:55.144 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:55.142+0000 7fbf4040a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:55.145 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:55.143+0000 7fbf4040a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:27:55.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:55.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:55.318 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:55.316+0000 7fbf4040a780 -1 Falling back to public interface 2026-02-17T04:27:55.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:27:55.637 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:27:55.635+0000 7fbf4040a780 -1 osd.1 45 log_to_monitors true 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:27:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:27:56.629 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 46 last_clean_interval [9,45) [v2:127.0.0.1:6810/519099330,v1:127.0.0.1:6811/519099330] [v2:127.0.0.1:6812/519099330,v1:127.0.0.1:6813/519099330] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:27:56.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:27:56.631 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:27:56.631 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:27:56.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:27:56.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:27:56.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:27:56.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:27:56.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:27:56.882 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:27:56.883 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:27:56.883 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:27:56.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:27:56.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:56.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:27:56.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:27:56.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:27:56.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:27:56.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:56.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:27:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397506 2026-02-17T04:27:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397506 2026-02-17T04:27:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-210453397506' 2026-02-17T04:27:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:57.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:27:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-17T04:27:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-17T04:27:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-210453397506 2-60129542155' 2026-02-17T04:27:57.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:27:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:27:57.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561028 2026-02-17T04:27:57.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561028 2026-02-17T04:27:57.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-210453397506 2-60129542155 3-188978561028' 2026-02-17T04:27:57.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:57.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:27:57.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:57.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:27:57.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:27:57.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:57.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:27:57.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:27:57.124 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836492 2026-02-17T04:27:57.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:57.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-17T04:27:57.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:27:58.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:27:58.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:27:58.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T04:27:58.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:58.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-210453397506 2026-02-17T04:27:58.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:58.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:27:58.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397506 2026-02-17T04:27:58.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:58.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397506 2026-02-17T04:27:58.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 210453397506' 2026-02-17T04:27:58.463 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 210453397506 2026-02-17T04:27:58.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:27:58.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397506 -lt 210453397506 2026-02-17T04:27:58.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:58.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-17T04:27:58.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:58.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:27:58.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-17T04:27:58.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:58.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-17T04:27:58.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-17T04:27:58.633 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542155 2026-02-17T04:27:58.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:27:58.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-17T04:27:58.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:27:58.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-188978561028 2026-02-17T04:27:58.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:27:58.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:27:58.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-188978561028 2026-02-17T04:27:58.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:27:58.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561028 2026-02-17T04:27:58.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 188978561028' 2026-02-17T04:27:58.800 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 188978561028 2026-02-17T04:27:58.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:27:58.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561028 -lt 188978561028 2026-02-17T04:27:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:27:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:27:59.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:27:59.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:27:59.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:27:59.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:27:59.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:27:59.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:27:59.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:27:59.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:27:59.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:27:59.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:27:59.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:27:59.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:27:59.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:27:59.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:27:59.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:27:59.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:27:59.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:27:59.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:27:48.234439+0000 2026-02-17T04:27:59.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:28:00.044 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:28:00.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:27:48.234439+0000 2026-02-17T04:28:00.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:27:48.234439+0000 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:00.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:00.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:48.234439+0000 '>' 2026-02-17T04:27:48.234439+0000 2026-02-17T04:28:00.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:01.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:01.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:01.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:01.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:01.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:01.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:01.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:01.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:27:48.234439+0000 '>' 2026-02-17T04:27:48.234439+0000 2026-02-17T04:28:01.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:02.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:02.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:02.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:02.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:02.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:02.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:02.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:02.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:27:48.234439+0000 2026-02-17T04:28:02.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:28:02.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:02.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:02.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:02.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:02.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:02.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:02.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:02.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:02.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:02.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:02.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:28:02.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:02.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:02.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:28:02.702 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:28:02.702 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:28:02.703 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:28:02.703 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:28:02.703 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:28:02.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:28:02.755 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:28:02.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:02.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:28:02.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:28:02.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:02.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:02.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:02.766 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:02.764+0000 7f561fc23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:02.768 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:02.766+0000 7f561fc23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:02.768 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:02.767+0000 7f561fc23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:02.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:02.904+0000 7f561fc23780 -1 Falling back to public interface 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:28:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:02.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:03.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:03.205 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:03.203+0000 7f561fc23780 -1 osd.3 50 log_to_monitors true 2026-02-17T04:28:04.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:04.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:04.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:04.085 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:28:04.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:04.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:04.249 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 54 up_thru 54 down_at 51 last_clean_interval [44,50) [v2:127.0.0.1:6826/3434965128,v1:127.0.0.1:6827/3434965128] [v2:127.0.0.1:6828/3434965128,v1:127.0.0.1:6829/3434965128] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:28:04.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:04.250 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:04.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:04.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:04.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:04.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:04.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:04.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:04.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-17T04:28:04.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-17T04:28:04.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-17T04:28:04.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:04.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:04.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397508 2026-02-17T04:28:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397508 2026-02-17T04:28:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-210453397508' 2026-02-17T04:28:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:04.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:04.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-17T04:28:04.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-17T04:28:04.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-210453397508 2-60129542158' 2026-02-17T04:28:04.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:04.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=231928233986 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 231928233986 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-210453397508 2-60129542158 3-231928233986' 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-17T04:28:04.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:04.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:04.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-17T04:28:04.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:04.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-17T04:28:04.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-17T04:28:04.733 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836495 2026-02-17T04:28:04.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:04.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-17T04:28:04.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:05.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:05.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:06.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836495 2026-02-17T04:28:06.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:06.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-210453397508 2026-02-17T04:28:06.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:06.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:06.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-210453397508 2026-02-17T04:28:06.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:06.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=210453397508 2026-02-17T04:28:06.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 210453397508' 2026-02-17T04:28:06.080 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 210453397508 2026-02-17T04:28:06.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:06.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 210453397508 -lt 210453397508 2026-02-17T04:28:06.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:06.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-17T04:28:06.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:06.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:06.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-17T04:28:06.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:06.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-17T04:28:06.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-17T04:28:06.246 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542158 2026-02-17T04:28:06.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:06.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542158 2026-02-17T04:28:06.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:06.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-231928233986 2026-02-17T04:28:06.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:06.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:06.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-231928233986 2026-02-17T04:28:06.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:06.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=231928233986 2026-02-17T04:28:06.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 231928233986' 2026-02-17T04:28:06.421 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 231928233986 2026-02-17T04:28:06.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:06.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 231928233986 -lt 231928233986 2026-02-17T04:28:06.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:06.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:06.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:06.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:06.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:06.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:06.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:06.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:06.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:06.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:06.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:06.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:06.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:06.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:06.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:07.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:07.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:07.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:07.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:28:07.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 1 2 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=1 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=2 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:28:07.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 545078"' 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 545078' 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 545080"' 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 545080' 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 545078 545080' 2026-02-17T04:28:07.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 545078 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/545081: /' 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:28:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/545083: /' 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:28:07.466 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:07.467 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:07.468 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:28:07.469 INFO:tasks.workunit.client.0.trial090.stderr:545083: start osd.2 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:07.494 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:28:07.495 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:07.496 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:07.497 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:07.498 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:28:07.499 INFO:tasks.workunit.client.0.trial090.stderr:545081: start osd.1 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2026-02-17T04:28:07.482+0000 7f9c7480d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2026-02-17T04:28:07.483+0000 7f9c7480d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2026-02-17T04:28:07.484+0000 7f9c7480d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:08.983 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: 0 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2026-02-17T04:28:07.708+0000 7f9c7480d780 -1 Falling back to public interface 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2026-02-17T04:28:08.046+0000 7f9c7480d780 -1 osd.2 55 log_to_monitors true 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: 1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: osd.2 up in weight 1 up_from 59 up_thru 46 down_at 56 last_clean_interval [14,55) [v2:127.0.0.1:6810/2901287058,v1:127.0.0.1:6812/2901287058] [v2:127.0.0.1:6814/2901287058,v1:127.0.0.1:6816/2901287058] exists,up 004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:08.984 INFO:tasks.workunit.client.0.trial090.stderr:545083: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545083: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2026-02-17T04:28:07.508+0000 7f20ea42f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2026-02-17T04:28:07.509+0000 7f20ea42f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2026-02-17T04:28:07.510+0000 7f20ea42f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: 0 2026-02-17T04:28:09.007 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2026-02-17T04:28:07.708+0000 7f20ea42f780 -1 Falling back to public interface 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2026-02-17T04:28:08.046+0000 7f20ea42f780 -1 osd.1 55 log_to_monitors true 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: 1 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: osd.1 up in weight 1 up_from 59 up_thru 59 down_at 56 last_clean_interval [49,55) [v2:127.0.0.1:6811/3850578287,v1:127.0.0.1:6813/3850578287] [v2:127.0.0.1:6815/3850578287,v1:127.0.0.1:6817/3850578287] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:09.008 INFO:tasks.workunit.client.0.trial090.stderr:545081: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545081: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:09.484 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: 1 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: 2 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: 3' 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.485 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070466 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070466 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-253403070466' 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070466 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070466 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-253403070466 2-253403070466' 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=231928233988 2026-02-17T04:28:09.486 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 231928233988 2026-02-17T04:28:09.487 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-253403070466 2-253403070466 3-231928233988' 2026-02-17T04:28:09.487 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:3: get_timeout_delays: echo true 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:09.507 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: 1 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: 2 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: 3' 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-17T04:28:09.508 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070467 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070467 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-253403070467' 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070467 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070467 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-253403070467 2-253403070467' 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:09.509 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=231928233989 2026-02-17T04:28:09.510 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 231928233989 2026-02-17T04:28:09.510 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-253403070467 2-253403070467 3-231928233989' 2026-02-17T04:28:09.510 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:10.020 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836498 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: waiting osd.0 seq 21474836498 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-253403070467 2026-02-17T04:28:10.021 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-253403070467 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070467 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 253403070467' 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: waiting osd.1 seq 253403070467 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070467 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-253403070467 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:10.022 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-253403070467 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070467 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 253403070467' 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: waiting osd.2 seq 253403070467 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070467 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-231928233989 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:10.023 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-231928233989 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=231928233989 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 231928233989' 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: waiting osd.3 seq 231928233989 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:10.776 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 231928233989 -lt 231928233989 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:10.777 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:545081: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:10.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 545080 2026-02-17T04:28:11.168 INFO:tasks.workunit.client.0.trial090.stderr: flush_pg_stats: echo 0-21474836497 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: waiting osd.0 seq 21474836497 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:11.169 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836497 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836497 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-253403070466 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-253403070466 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070466 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 253403070466' 2026-02-17T04:28:11.170 INFO:tasks.workunit.client.0.trial090.stderr:545083: waiting osd.1 seq 253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 253403070466' 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: waiting osd.2 seq 253403070466 2026-02-17T04:28:11.171 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:11.172 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070466 2026-02-17T04:28:11.172 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-231928233988 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-231928233988 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=231928233988 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 231928233988' 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: waiting osd.3 seq 231928233988 2026-02-17T04:28:11.930 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 231928233989 -lt 231928233988 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:545083: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:11.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:28:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:28:12.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:12.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:12.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:12.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:12.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:28:12.420 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:12.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:12.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:12.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:12.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:13.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:13.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:13.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:13.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:13.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:13.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:13.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:13.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:13.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:14.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:14.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:14.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:14.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:14.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:14.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:14.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:15.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:15.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:16.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:17.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:17.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:17.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:17.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:17.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:17.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:17.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:17.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:17.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:18.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:18.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:18.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:18.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:18.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:18.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:18.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:00.989441+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:18.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:19.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:19.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:19.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:19.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:19.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:00.989441+0000 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 547929"' 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 547929' 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 547930"' 2026-02-17T04:28:19.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 547930' 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 547929 547930' 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 547929 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/547932: /' 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:28:19.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/547934: /' 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.808 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.809 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: _ 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: hinfo_key 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: snapset 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:28:19.810 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:19.811 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:19.812 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:28:19.813 INFO:tasks.workunit.client.0.trial090.stderr:547932: start osd.1 2026-02-17T04:28:19.822 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.822 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:19.822 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:28:19.822 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:19.822 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:19.823 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING list-attrs 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: _ 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: hinfo_key 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: snapset 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:19.824 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:19.825 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:19.826 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:28:19.827 INFO:tasks.workunit.client.0.trial090.stderr:547934: start osd.2 2026-02-17T04:28:21.323 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2026-02-17T04:28:19.823+0000 7fe7ab069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2026-02-17T04:28:19.824+0000 7fe7ab069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2026-02-17T04:28:19.825+0000 7fe7ab069780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:21.324 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: 0 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2026-02-17T04:28:20.002+0000 7fe7ab069780 -1 Falling back to public interface 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2026-02-17T04:28:20.324+0000 7fe7ab069780 -1 osd.1 61 log_to_monitors true 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:21.325 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: 1 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: osd.1 up in weight 1 up_from 65 up_thru 66 down_at 62 last_clean_interval [59,61) [v2:127.0.0.1:6810/2209000971,v1:127.0.0.1:6811/2209000971] [v2:127.0.0.1:6812/2209000971,v1:127.0.0.1:6813/2209000971] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:21.326 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:21.327 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:21.327 INFO:tasks.workunit.client.0.trial090.stderr:547932: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:21.337 INFO:tasks.workunit.client.0.trial090.stderr:547932: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helprecovery_ops 2026-02-17T04:28:21.337 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2026-02-17T04:28:19.839+0000 7f74c4fc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2026-02-17T04:28:19.840+0000 7f74c4fc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2026-02-17T04:28:19.841+0000 7f74c4fc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:21.338 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: 0 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2026-02-17T04:28:20.032+0000 7f74c4fc6780 -1 Falling back to public interface 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2026-02-17T04:28:20.375+0000 7f74c4fc6780 -1 osd.2 61 log_to_monitors true 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:21.339 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: 1 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: osd.2 up in weight 1 up_from 66 up_thru 46 down_at 62 last_clean_interval [59,61) [v2:127.0.0.1:6818/2877071953,v1:127.0.0.1:6819/2877071953] [v2:127.0.0.1:6820/2877071953,v1:127.0.0.1:6821/2877071953] exists,up 004bf718-c822-4f4e-8170-2cf9fe481fe1 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:21.340 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:21.341 INFO:tasks.workunit.client.0.trial090.stderr:547934: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547934: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:21.820 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: 1 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: 2 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: 3' 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836501 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836501 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836501' 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=279172874242 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 279172874242 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836501 1-279172874242' 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841538 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841538 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836501 1-279172874242 2-283467841538' 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=231928233992 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 231928233992 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836501 1-279172874242 2-283467841538 3-231928233992' 2026-02-17T04:28:21.821 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helperers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: 1 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: 2 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: 3' 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-17T04:28:21.832 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=279172874243 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 279172874243 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-279172874243' 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841539 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841539 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-279172874243 2-283467841539' 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=231928233993 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 231928233993 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-279172874243 2-283467841539 3-231928233993' 2026-02-17T04:28:21.833 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:24.503 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836501 2026-02-17T04:28:24.503 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.503 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:24.503 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: waiting osd.0 seq 21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836501 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-279172874242 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-279172874242 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=279172874242 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 279172874242' 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: waiting osd.1 seq 279172874242 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 279172874243 -lt 279172874242 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841538 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841538 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.504 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841538 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: s.sh:2266: flush_pg_stats: echo 0-21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: waiting osd.0 seq 21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836502 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:24.522 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836502 -lt 21474836502 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-279172874243 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-279172874243 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=279172874243 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 279172874243' 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: waiting osd.1 seq 279172874243 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 279172874243 -lt 279172874243 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841539 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841539 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:24.523 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841539 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 283467841538' 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: waiting osd.2 seq 283467841538 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841539 -lt 283467841538 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-231928233992 2026-02-17T04:28:25.445 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-231928233992 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=231928233992 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 231928233992' 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: waiting osd.3 seq 231928233992 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 231928233994 -lt 231928233992 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:25.446 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:25.447 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:25.448 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:25.448 INFO:tasks.workunit.client.0.trial090.stderr:547932: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:25.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:25.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:25.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 547930 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:flush_pg_stats: echo 'waiting osd.2 seq 283467841539' 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: waiting osd.2 seq 283467841539 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841539 -lt 283467841539 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-231928233993 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-231928233993 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=231928233993 2026-02-17T04:28:25.472 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 231928233993' 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: waiting osd.3 seq 231928233993 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 231928233994 -lt 231928233993 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:547934: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:28:25.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:28:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:28:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:28:25.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 1 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=1 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 550260"' 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 550260' 2026-02-17T04:28:25.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 550261"' 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 550261' 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 550260 550261' 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 550260 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/550263: /' 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:25.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/550265: /' 2026-02-17T04:28:25.946 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:28:25.947 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:28:25.948 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:25.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:25.950 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:25.950 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:25.950 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:25.951 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:28:25.952 INFO:tasks.workunit.client.0.trial090.stderr:550265: start osd.1 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:25.953 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:28:25.954 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:25.955 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:25.956 INFO:tasks.workunit.client.0.trial090.stderr:550263: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:25.957 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:25.958 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:28:25.958 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:28:25.958 INFO:tasks.workunit.client.0.trial090.stderr:550263: start osd.3 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2026-02-17T04:28:25.962+0000 7f5793a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.451 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2026-02-17T04:28:25.963+0000 7f5793a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2026-02-17T04:28:25.964+0000 7f5793a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: 0 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:27.452 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2026-02-17T04:28:26.170+0000 7f5793a12780 -1 Falling back to public interface 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2026-02-17T04:28:26.534+0000 7f5793a12780 -1 osd.1 67 log_to_monitors true 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: 1 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: osd.1 up in weight 1 up_from 71 up_thru 71 down_at 68 last_clean_interval [65,67) [v2:127.0.0.1:6810/3950449440,v1:127.0.0.1:6812/3950449440] [v2:127.0.0.1:6814/3950449440,v1:127.0.0.1:6816/3950449440] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:27.453 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:27.454 INFO:tasks.workunit.client.0.trial090.stderr:550265: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:27.462 INFO:tasks.workunit.client.0.trial090.stderr:550265: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:28:27.462 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2026-02-17T04:28:25.964+0000 7f7d9c450780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2026-02-17T04:28:25.965+0000 7f7d9c450780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2026-02-17T04:28:25.966+0000 7f7d9c450780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:27.463 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: 0 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2026-02-17T04:28:26.170+0000 7f7d9c450780 -1 Falling back to public interface 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2026-02-17T04:28:26.556+0000 7f7d9c450780 -1 osd.3 67 log_to_monitors true 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:27.464 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: 1 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: osd.3 up in weight 1 up_from 71 up_thru 71 down_at 68 last_clean_interval [54,67) [v2:127.0.0.1:6811/2512345350,v1:127.0.0.1:6813/2512345350] [v2:127.0.0.1:6815/2512345350,v1:127.0.0.1:6817/2512345350] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:27.465 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:27.466 INFO:tasks.workunit.client.0.trial090.stderr:550263: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550263: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:27.943 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: 1 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: 2 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: 3' 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836504 2026-02-17T04:28:27.944 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836504 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504' 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678018 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678018 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-304942678018' 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841541 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841541 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-304942678018 2-283467841541' 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.945 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:27.946 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678018 2026-02-17T04:28:27.946 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678018 2026-02-17T04:28:27.946 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-304942678018 2-283467841541 3-304942678018' 2026-02-17T04:28:27.946 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:3: get_timeout_delays: echo true 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:27.949 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: 1 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: 2 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: 3' 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836505 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836505 2026-02-17T04:28:27.950 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505' 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678019 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678019 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-304942678019' 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841542 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841542 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-304942678019 2-283467841542' 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:27.951 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678019 2026-02-17T04:28:27.952 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678019 2026-02-17T04:28:27.952 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-304942678019 2-283467841542 3-304942678019' 2026-02-17T04:28:27.952 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:30.633 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836504 2026-02-17T04:28:30.633 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.633 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836504 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836504 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: waiting osd.0 seq 21474836504 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836504 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836504 2026-02-17T04:28:30.634 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836504 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-304942678018 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-304942678018 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678018 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 304942678018' 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: waiting osd.1 seq 304942678018 2026-02-17T04:28:30.635 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678019 -lt 304942678018 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841541 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841541 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.636 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841541 2026-02-17T04:28:30.639 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_s flush_pg_stats: echo 0-21474836505 2026-02-17T04:28:30.639 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.639 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:30.639 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836505 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836505 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: waiting osd.0 seq 21474836505 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836505 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836505 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:30.640 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836505 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-304942678019 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-304942678019 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678019 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 304942678019' 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: waiting osd.1 seq 304942678019 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:30.641 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678019 -lt 304942678019 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841542 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841542 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:30.642 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841542 2026-02-17T04:28:31.566 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 283467841541' 2026-02-17T04:28:31.566 INFO:tasks.workunit.client.0.trial090.stderr:550265: waiting osd.2 seq 283467841541 2026-02-17T04:28:31.566 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841542 -lt 283467841541 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-304942678018 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-304942678018 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678018 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 304942678018' 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: waiting osd.3 seq 304942678018 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:31.567 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678019 -lt 304942678018 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:31.568 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:550265: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:31.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:tats: echo 'waiting osd.2 seq 283467841542' 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: waiting osd.2 seq 283467841542 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841542 -lt 283467841542 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-304942678019 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-304942678019 2026-02-17T04:28:31.583 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678019 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 304942678019' 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: waiting osd.3 seq 304942678019 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678019 -lt 304942678019 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:31.584 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:550263: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:31.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 550261 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:28:31.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:28:31.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:31.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:31.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:31.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:28:32.078 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:28:32.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:32.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:32.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:32.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:33.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:33.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:33.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:33.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:33.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:33.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:34.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:34.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:34.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:34.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:34.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:34.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:34.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:34.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:34.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:35.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:35.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:35.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:35.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:35.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:35.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:36.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:36.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:36.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:36.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:36.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:36.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:36.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:36.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:13.258295+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:36.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:28:37.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:28:37.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:28:37.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:28:37.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:28:37.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:28:37.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:28:37.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:28:38.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:28:32.569091+0000 '>' 2026-02-17T04:28:13.258295+0000 2026-02-17T04:28:38.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:28:38.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 553157"' 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 553157' 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 553158"' 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 553158' 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:28:38.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 553157 553158' 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 553157 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/553160: /' 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:38.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/553162: /' 2026-02-17T04:28:38.310 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:38.311 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: _ 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: hinfo_key 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: snapset 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:28:38.312 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:38.313 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:38.314 INFO:tasks.workunit.client.0.trial090.stderr:553162: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:38.315 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:28:38.316 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:28:38.316 INFO:tasks.workunit.client.0.trial090.stderr:553162: start osd.1 2026-02-17T04:28:38.316 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.316 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:28:38.316 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:38.317 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: _ 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: hinfo_key 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: snapset 2026-02-17T04:28:38.318 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:38.319 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:28:38.320 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:38.321 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:28:38.322 INFO:tasks.workunit.client.0.trial090.stderr:553160: start osd.3 2026-02-17T04:28:39.827 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$nrecovery_ops 2026-02-17T04:28:39.827 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:28:39.827 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:28:39.827 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:39.827 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2026-02-17T04:28:38.327+0000 7f5c1c860780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2026-02-17T04:28:38.329+0000 7f5c1c860780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2026-02-17T04:28:38.329+0000 7f5c1c860780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:39.828 INFO:tasks.workunit.client.0.trial090.stderr:553162: 0 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2026-02-17T04:28:38.583+0000 7f5c1c860780 -1 Falling back to public interface 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2026-02-17T04:28:38.912+0000 7f5c1c860780 -1 osd.1 73 log_to_monitors true 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: 1 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:39.829 INFO:tasks.workunit.client.0.trial090.stderr:553162: osd.1 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [71,73) [v2:127.0.0.1:6826/860311886,v1:127.0.0.1:6827/860311886] [v2:127.0.0.1:6828/860311886,v1:127.0.0.1:6829/860311886] exists,up c6594ddc-8c79-49bc-965a-37aa48ea0029 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:39.830 INFO:tasks.workunit.client.0.trial090.stderr:553162: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553162: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.ame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2026-02-17T04:28:38.331+0000 7febf980f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.831 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2026-02-17T04:28:38.333+0000 7febf980f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2026-02-17T04:28:38.333+0000 7febf980f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: 0 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:39.832 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2026-02-17T04:28:38.550+0000 7febf980f780 -1 Falling back to public interface 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2026-02-17T04:28:38.889+0000 7febf980f780 -1 osd.3 73 log_to_monitors true 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: 1 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: osd.3 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [71,73) [v2:127.0.0.1:6810/3483329910,v1:127.0.0.1:6811/3483329910] [v2:127.0.0.1:6812/3483329910,v1:127.0.0.1:6813/3483329910] exists,up 5c8ab085-fcd6-4eb1-b45f-1c5696c15909 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:39.833 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:39.834 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:28:39.834 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:28:39.834 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:28:39.834 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:28:40.324 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:28:40.324 INFO:tasks.workunit.client.0.trial090.stderr:553160: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:28:40.324 INFO:tasks.workunit.client.0.trial090.stderr:553160: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:40.324 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:40.324 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: 1 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: 2 2026-02-17T04:28:40.325 INFO:tasks.workunit.client.0.trial090.stderr:553160: 3' 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481795 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481795 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-330712481795' 2026-02-17T04:28:40.326 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841546 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841546 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-330712481795 2-283467841546' 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-17T04:28:40.327 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-330712481795 2-283467sh:1593: get_timeout_delays: echo true 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:28:40.328 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: 1 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: 2 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: 3' 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836509 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836509 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509' 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.329 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-330712481794' 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841545 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841545 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-330712481794 2-283467841545' 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481795 2026-02-17T04:28:40.330 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481795 2026-02-17T04:28:40.331 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-330712481794 2-283467841545 3-330712481795' 2026-02-17T04:28:40.331 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836509 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836509 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836509 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-17T04:28:43.006 INFO:tasks.workunit.client.0.trial090.stderr:553162: waiting osd.0 seq 21474836509 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836509 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836509 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:43.007 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836510 -lt 21474836509 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481794 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481794 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481794' 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: waiting osd.1 seq 330712481794 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:43.008 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481795 -lt 330712481794 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841545 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841545 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.009 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841545 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flus841546 3-330712481794' 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-17T04:28:43.010 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: waiting osd.0 seq 21474836510 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836510 -lt 21474836510 2026-02-17T04:28:43.011 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481795 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481795 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481795 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481795' 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: waiting osd.1 seq 330712481795 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481795 -lt 330712481795 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-283467841546 2026-02-17T04:28:43.012 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.013 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:28:43.013 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-283467841546 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cuth_pg_stats: echo 'waiting osd.2 seq 283467841545' 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: waiting osd.2 seq 283467841545 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841547 -lt 283467841545 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-330712481795 2026-02-17T04:28:43.938 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-330712481795 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481795 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 330712481795' 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: waiting osd.3 seq 330712481795 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481795 -lt 330712481795 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:43.939 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:43.940 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:43.941 INFO:tasks.workunit.client.0.trial090.stderr:553162: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:43.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr: -d - -f 2 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841546 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 283467841546' 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: waiting osd.2 seq 283467841546 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841547 -lt 283467841546 2026-02-17T04:28:43.948 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-330712481794 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-330712481794 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 330712481794' 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: waiting osd.3 seq 330712481794 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481795 -lt 330712481794 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:28:43.949 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:28:43.950 INFO:tasks.workunit.client.0.trial090.stderr:553160: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:28:43.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:28:43.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:28:43.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 553158 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:28:43.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:28:43.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:28:43.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:43.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:44.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:44.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:28:44.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:28:44.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:28:44.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:28:44.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:28:44.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:28:44.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:28:44.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:28:44.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:28:44.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:28:44.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:28:44.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:28:44.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:28:44.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:28:44.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:28:44.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:28:44.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:28:44.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:28:44.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:28:44.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:28:44.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:28:44.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:28:44.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:28:44.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:28:44.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:28:44.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:28:44.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:28:44.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:28:44.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:28:44.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:28:44.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:28:44.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:28:44.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:28:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:28:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:28:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:28:44.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:28:44.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:28:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_lrc_appends td/osd-scrub-repair 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:901: TEST_corrupt_and_repair_lrc_appends: corrupt_and_repair_lrc td/osd-scrub-repair false 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:884: corrupt_and_repair_lrc: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:885: corrupt_and_repair_lrc: local allow_overwrites=false 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:886: corrupt_and_repair_lrc: local poolname=ecpool 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:888: corrupt_and_repair_lrc: run_mon td/osd-scrub-repair a 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:28:44.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:44.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:28:44.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:28:44.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:28:44.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:28:44.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:28:44.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.161 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.162 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:28:44.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:28:44.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:28:44.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:28:44.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:28:44.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:28:44.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:28:44.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:28:44.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:28:44.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:28:44.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:28:44.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:889: corrupt_and_repair_lrc: run_mgr td/osd-scrub-repair x 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:28:44.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:28:44.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:28:44.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:44.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:44.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:44.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.331 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:44.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:28:44.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:28:44.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: seq 0 9 2026-02-17T04:28:44.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:44.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 0 2026-02-17T04:28:44.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:44.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:44.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:28:44.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:28:44.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=08e3670c-ff59-4a4b-8ebc-1ba17305d715 2026-02-17T04:28:44.354 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 08e3670c-ff59-4a4b-8ebc-1ba17305d715 2026-02-17T04:28:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 08e3670c-ff59-4a4b-8ebc-1ba17305d715' 2026-02-17T04:28:44.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:44.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB87pNpceV3FRAACq77H3VQHI4FsAiDor46TQ== 2026-02-17T04:28:44.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB87pNpceV3FRAACq77H3VQHI4FsAiDor46TQ=="}' 2026-02-17T04:28:44.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 08e3670c-ff59-4a4b-8ebc-1ba17305d715 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:28:44.444 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:44.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:28:44.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB87pNpceV3FRAACq77H3VQHI4FsAiDor46TQ== --osd-uuid 08e3670c-ff59-4a4b-8ebc-1ba17305d715 2026-02-17T04:28:44.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.465+0000 7fdc0023d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:44.467 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.467+0000 7fdc0023d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:44.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.467+0000 7fdc0023d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:44.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.468+0000 7fdc0023d780 -1 bdev(0x2a26c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:44.469 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.468+0000 7fdc0023d780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:28:44.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:28:44.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:44.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:28:44.899 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:28:44.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:44.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:28:44.984 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:28:44.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:44.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:44.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:44.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:45.000 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:44.999+0000 7ffb89662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:45.001 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:45.000+0000 7ffb89662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:45.002 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:45.001+0000 7ffb89662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:45.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:45.067 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:45.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:45.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:28:45.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:45.200 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:45.199+0000 7ffb89662780 -1 Falling back to public interface 2026-02-17T04:28:45.506 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:45.506+0000 7ffb89662780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:28:46.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:46.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:46.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:46.151 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:46.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:46.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:28:46.229 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1598381681,v1:127.0.0.1:6801/1598381681] [v2:127.0.0.1:6802/1598381681,v1:127.0.0.1:6803/1598381681] exists,up 08e3670c-ff59-4a4b-8ebc-1ba17305d715 2026-02-17T04:28:46.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:46.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:46.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:46.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 1 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:46.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:46.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:46.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:46.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:46.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f1bb1a34-7d22-4efb-83a1-222baad7511d 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f1bb1a34-7d22-4efb-83a1-222baad7511d' 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 f1bb1a34-7d22-4efb-83a1-222baad7511d 2026-02-17T04:28:46.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:46.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+7pNpDeB2DhAAWozg+4Txvz3wkihQPo/Kug== 2026-02-17T04:28:46.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+7pNpDeB2DhAAWozg+4Txvz3wkihQPo/Kug=="}' 2026-02-17T04:28:46.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f1bb1a34-7d22-4efb-83a1-222baad7511d -i td/osd-scrub-repair/1/new.json 2026-02-17T04:28:46.325 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:46.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:28:46.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+7pNpDeB2DhAAWozg+4Txvz3wkihQPo/Kug== --osd-uuid f1bb1a34-7d22-4efb-83a1-222baad7511d 2026-02-17T04:28:46.350 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.349+0000 7fb8b7612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:46.351 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.351+0000 7fb8b7612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:46.352 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.352+0000 7fb8b7612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:46.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.352+0000 7fb8b7612780 -1 bdev(0x2434c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:46.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.352+0000 7fb8b7612780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:28:46.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:28:46.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:46.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:28:46.696 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:28:46.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:46.909 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:28:46.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:28:46.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:46.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:46.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:46.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:46.923 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.922+0000 7facb8833780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:46.924 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.924+0000 7facb8833780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:46.925 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:46.924+0000 7facb8833780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:47.059 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:47.059+0000 7facb8833780 -1 Falling back to public interface 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:47.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:47.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:47.079 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:47.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:47.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:47.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:47.354 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:47.353+0000 7facb8833780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:28:48.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:48.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:48.246 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:48.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:48.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:48.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:28:48.411 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1945181548,v1:127.0.0.1:6811/1945181548] [v2:127.0.0.1:6812/1945181548,v1:127.0.0.1:6813/1945181548] exists,up f1bb1a34-7d22-4efb-83a1-222baad7511d 2026-02-17T04:28:48.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:48.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:48.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 2 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:48.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:48.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:48.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2c611175-d4c6-450a-ae61-36bfd45e894d 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2c611175-d4c6-450a-ae61-36bfd45e894d' 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 2c611175-d4c6-450a-ae61-36bfd45e894d 2026-02-17T04:28:48.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:48.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCA7pNpTV1KGRAArH9m8XSomqP0NODvQ8zNOw== 2026-02-17T04:28:48.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCA7pNpTV1KGRAArH9m8XSomqP0NODvQ8zNOw=="}' 2026-02-17T04:28:48.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2c611175-d4c6-450a-ae61-36bfd45e894d -i td/osd-scrub-repair/2/new.json 2026-02-17T04:28:48.588 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:28:48.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:28:48.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCA7pNpTV1KGRAArH9m8XSomqP0NODvQ8zNOw== --osd-uuid 2c611175-d4c6-450a-ae61-36bfd45e894d 2026-02-17T04:28:48.612 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:48.611+0000 7fd0f4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:48.613 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:48.612+0000 7fd0f4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:48.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:48.613+0000 7fd0f4815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:48.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:48.613+0000 7fd0f4815780 -1 bdev(0x32d6c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:48.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:48.613+0000 7fd0f4815780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:28:48.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:28:48.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:48.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:28:48.954 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:28:48.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:49.179 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:28:49.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:28:49.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:49.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:49.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:49.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:49.195 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:49.194+0000 7f665b662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:49.196 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:49.195+0000 7f665b662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:49.197 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:49.196+0000 7f665b662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:49.343 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:49.342+0000 7f665b662780 -1 Falling back to public interface 2026-02-17T04:28:49.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:49.351 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:49.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:49.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:49.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:49.617 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:49.616+0000 7f665b662780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:28:50.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:50.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:50.522 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:50.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:50.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:50.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:28:50.691 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3289877285,v1:127.0.0.1:6819/3289877285] [v2:127.0.0.1:6820/3289877285,v1:127.0.0.1:6821/3289877285] exists,up 2c611175-d4c6-450a-ae61-36bfd45e894d 2026-02-17T04:28:50.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:50.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:50.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:50.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:50.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 3 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:28:50.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:50.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:28:50.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 6ae59254-75e4-40be-88c8-c30915bbf18b' 2026-02-17T04:28:50.699 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:28:50.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:50.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCC7pNpc6/rKRAA7jDSh7LhXG1UyuJLxri+sw== 2026-02-17T04:28:50.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCC7pNpc6/rKRAA7jDSh7LhXG1UyuJLxri+sw=="}' 2026-02-17T04:28:50.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6ae59254-75e4-40be-88c8-c30915bbf18b -i td/osd-scrub-repair/3/new.json 2026-02-17T04:28:50.866 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:28:50.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:28:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCC7pNpc6/rKRAA7jDSh7LhXG1UyuJLxri+sw== --osd-uuid 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:28:50.891 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:50.889+0000 7f682822b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:50.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:50.891+0000 7f682822b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:50.894 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:50.892+0000 7f682822b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:50.894 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:50.892+0000 7f682822b780 -1 bdev(0x3bc0c00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:50.894 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:50.892+0000 7f682822b780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:28:51.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:28:51.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:51.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:28:51.204 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:28:51.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:51.427 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:28:51.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:28:51.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:51.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:51.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:51.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:51.441 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:51.439+0000 7fa23222d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:51.443 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:51.441+0000 7fa23222d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:51.443 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:51.442+0000 7fa23222d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:51.584 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:51.582+0000 7fa23222d780 -1 Falling back to public interface 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:51.592 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:51.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:51.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:51.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:51.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:51.879 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:51.877+0000 7fa23222d780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:28:52.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:52.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:52.758 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:52.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:52.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:52.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:28:52.925 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1220600590,v1:127.0.0.1:6827/1220600590] [v2:127.0.0.1:6828/1220600590,v1:127.0.0.1:6829/1220600590] exists,up 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 4 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:52.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/4 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/4' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/4/journal' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:52.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:52.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/4 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f7d18fa9-782e-43ea-b85a-632774c7365e 2026-02-17T04:28:52.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 f7d18fa9-782e-43ea-b85a-632774c7365e' 2026-02-17T04:28:52.934 INFO:tasks.workunit.client.0.trial090.stdout:add osd4 f7d18fa9-782e-43ea-b85a-632774c7365e 2026-02-17T04:28:52.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:52.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCE7pNpQWvmNxAAORQRFzmgt9gdg7OwxTV46g== 2026-02-17T04:28:52.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCE7pNpQWvmNxAAORQRFzmgt9gdg7OwxTV46g=="}' 2026-02-17T04:28:52.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f7d18fa9-782e-43ea-b85a-632774c7365e -i td/osd-scrub-repair/4/new.json 2026-02-17T04:28:53.108 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:28:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/4/new.json 2026-02-17T04:28:53.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCE7pNpQWvmNxAAORQRFzmgt9gdg7OwxTV46g== --osd-uuid f7d18fa9-782e-43ea-b85a-632774c7365e 2026-02-17T04:28:53.133 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.131+0000 7f8ba3a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.134 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.133+0000 7f8ba3a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.135 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.133+0000 7f8ba3a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.135 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.134+0000 7f8ba3a1b780 -1 bdev(0x4188c00 td/osd-scrub-repair/4/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:53.135 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.134+0000 7f8ba3a1b780 -1 bluestore(td/osd-scrub-repair/4) _read_fsid unparsable uuid 2026-02-17T04:28:53.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/4/keyring 2026-02-17T04:28:53.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:53.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-17T04:28:53.468 INFO:tasks.workunit.client.0.trial090.stdout:adding osd4 key to auth repository 2026-02-17T04:28:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:53.679 INFO:tasks.workunit.client.0.trial090.stdout:start osd.4 2026-02-17T04:28:53.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-17T04:28:53.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:53.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:53.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:53.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:53.695 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.694+0000 7f0fc9665780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.697 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.695+0000 7f0fc9665780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.696+0000 7f0fc9665780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:53.839 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:53.838+0000 7f0fc9665780 -1 Falling back to public interface 2026-02-17T04:28:53.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:53.852 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:53.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:53.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-17T04:28:54.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:54.140 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:54.138+0000 7f0fc9665780 -1 osd.4 0 log_to_monitors true 2026-02-17T04:28:55.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:55.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:55.022 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-17T04:28:55.185 INFO:tasks.workunit.client.0.trial090.stdout:osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3673318208,v1:127.0.0.1:6835/3673318208] [v2:127.0.0.1:6836/3673318208,v1:127.0.0.1:6837/3673318208] exists,up f7d18fa9-782e-43ea-b85a-632774c7365e 2026-02-17T04:28:55.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 5 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:28:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:55.191 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:55.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 4c362cf5-7040-4935-a479-fbe118932cb8' 2026-02-17T04:28:55.193 INFO:tasks.workunit.client.0.trial090.stdout:add osd5 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:28:55.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:55.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCH7pNpRHTRCxAAnni0HnNJ2ebizBsRfrgczw== 2026-02-17T04:28:55.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCH7pNpRHTRCxAAnni0HnNJ2ebizBsRfrgczw=="}' 2026-02-17T04:28:55.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4c362cf5-7040-4935-a479-fbe118932cb8 -i td/osd-scrub-repair/5/new.json 2026-02-17T04:28:55.362 INFO:tasks.workunit.client.0.trial090.stdout:5 2026-02-17T04:28:55.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/5/new.json 2026-02-17T04:28:55.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCH7pNpRHTRCxAAnni0HnNJ2ebizBsRfrgczw== --osd-uuid 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:28:55.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.384+0000 7f62a0a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:55.387 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.386+0000 7f62a0a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:55.388 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.387+0000 7f62a0a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:55.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.387+0000 7f62a0a09780 -1 bdev(0x3898c00 td/osd-scrub-repair/5/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:55.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.387+0000 7f62a0a09780 -1 bluestore(td/osd-scrub-repair/5) _read_fsid unparsable uuid 2026-02-17T04:28:55.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/5/keyring 2026-02-17T04:28:55.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:55.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-17T04:28:55.711 INFO:tasks.workunit.client.0.trial090.stdout:adding osd5 key to auth repository 2026-02-17T04:28:55.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:55.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-17T04:28:55.922 INFO:tasks.workunit.client.0.trial090.stdout:start osd.5 2026-02-17T04:28:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:55.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:55.936 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.935+0000 7f68a4885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:55.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.936+0000 7f68a4885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:55.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:55.937+0000 7f68a4885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:56.085 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:56.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:56.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:28:56.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:56.161+0000 7f68a4885780 -1 Falling back to public interface 2026-02-17T04:28:56.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:56.477 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:56.475+0000 7f68a4885780 -1 osd.5 0 log_to_monitors true 2026-02-17T04:28:57.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:57.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:57.249 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:57.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:57.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:57.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:28:57.415 INFO:tasks.workunit.client.0.trial090.stdout:osd.5 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1537850593,v1:127.0.0.1:6843/1537850593] [v2:127.0.0.1:6844/1537850593,v1:127.0.0.1:6845/1537850593] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:28:57.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 6 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/6 2026-02-17T04:28:57.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/6' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/6/journal' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:57.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/6 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=07a02c15-90d1-4999-98dc-40ead9b00079 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 07a02c15-90d1-4999-98dc-40ead9b00079' 2026-02-17T04:28:57.423 INFO:tasks.workunit.client.0.trial090.stdout:add osd6 07a02c15-90d1-4999-98dc-40ead9b00079 2026-02-17T04:28:57.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:57.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCJ7pNpF8WMGRAA/0WWLh26rQrXktgKSGN5bw== 2026-02-17T04:28:57.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCJ7pNpF8WMGRAA/0WWLh26rQrXktgKSGN5bw=="}' 2026-02-17T04:28:57.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 07a02c15-90d1-4999-98dc-40ead9b00079 -i td/osd-scrub-repair/6/new.json 2026-02-17T04:28:57.594 INFO:tasks.workunit.client.0.trial090.stdout:6 2026-02-17T04:28:57.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/6/new.json 2026-02-17T04:28:57.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCJ7pNpF8WMGRAA/0WWLh26rQrXktgKSGN5bw== --osd-uuid 07a02c15-90d1-4999-98dc-40ead9b00079 2026-02-17T04:28:57.620 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:57.618+0000 7fa083e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:57.621 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:57.619+0000 7fa083e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:57.622 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:57.620+0000 7fa083e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:57.622 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:57.620+0000 7fa083e35780 -1 bdev(0x2bdac00 td/osd-scrub-repair/6/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:57.622 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:57.620+0000 7fa083e35780 -1 bluestore(td/osd-scrub-repair/6) _read_fsid unparsable uuid 2026-02-17T04:28:57.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/6/keyring 2026-02-17T04:28:57.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:28:57.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-17T04:28:57.947 INFO:tasks.workunit.client.0.trial090.stdout:adding osd6 key to auth repository 2026-02-17T04:28:57.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:28:58.156 INFO:tasks.workunit.client.0.trial090.stdout:start osd.6 2026-02-17T04:28:58.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-17T04:28:58.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:28:58.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:28:58.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:28:58.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:28:58.171 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:58.170+0000 7fca3ee44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:58.173 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:58.171+0000 7fca3ee44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:58.174 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:58.172+0000 7fca3ee44780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:58.302 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:58.300+0000 7fca3ee44780 -1 Falling back to public interface 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:28:58.324 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:28:58.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:58.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-17T04:28:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:28:58.634 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:58.632+0000 7fca3ee44780 -1 osd.6 0 log_to_monitors true 2026-02-17T04:28:59.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:28:59.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:28:59.489 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:28:59.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:28:59.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:28:59.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-17T04:28:59.660 INFO:tasks.workunit.client.0.trial090.stdout:osd.6 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/2583922197,v1:127.0.0.1:6851/2583922197] [v2:127.0.0.1:6852/2583922197,v1:127.0.0.1:6853/2583922197] exists,up 07a02c15-90d1-4999-98dc-40ead9b00079 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 7 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/7 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/7' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/7/journal' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:28:59.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:28:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/7 2026-02-17T04:28:59.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:28:59.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52b0ec42-95ab-45c1-a5eb-2588807b590a 2026-02-17T04:28:59.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 52b0ec42-95ab-45c1-a5eb-2588807b590a' 2026-02-17T04:28:59.664 INFO:tasks.workunit.client.0.trial090.stdout:add osd7 52b0ec42-95ab-45c1-a5eb-2588807b590a 2026-02-17T04:28:59.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:28:59.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCL7pNp/F4dKBAATnIwjvcbP/JVZo/fvraCjw== 2026-02-17T04:28:59.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCL7pNp/F4dKBAATnIwjvcbP/JVZo/fvraCjw=="}' 2026-02-17T04:28:59.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52b0ec42-95ab-45c1-a5eb-2588807b590a -i td/osd-scrub-repair/7/new.json 2026-02-17T04:28:59.838 INFO:tasks.workunit.client.0.trial090.stdout:7 2026-02-17T04:28:59.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/7/new.json 2026-02-17T04:28:59.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCL7pNp/F4dKBAATnIwjvcbP/JVZo/fvraCjw== --osd-uuid 52b0ec42-95ab-45c1-a5eb-2588807b590a 2026-02-17T04:28:59.865 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:59.863+0000 7fab6fc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:59.866 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:59.865+0000 7fab6fc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:59.867 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:59.865+0000 7fab6fc2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:28:59.868 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:59.866+0000 7fab6fc2d780 -1 bdev(0x391ac00 td/osd-scrub-repair/7/block) open stat got: (1) Operation not permitted 2026-02-17T04:28:59.868 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:28:59.866+0000 7fab6fc2d780 -1 bluestore(td/osd-scrub-repair/7) _read_fsid unparsable uuid 2026-02-17T04:29:00.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/7/keyring 2026-02-17T04:29:00.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:29:00.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-17T04:29:00.199 INFO:tasks.workunit.client.0.trial090.stdout:adding osd7 key to auth repository 2026-02-17T04:29:00.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:29:00.412 INFO:tasks.workunit.client.0.trial090.stdout:start osd.7 2026-02-17T04:29:00.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-17T04:29:00.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:00.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:29:00.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:29:00.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:29:00.427 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:00.425+0000 7fe000c35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:00.428 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:00.426+0000 7fe000c35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:00.429 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:00.427+0000 7fe000c35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-17T04:29:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:00.581 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:29:00.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:00.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-17T04:29:00.629 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:00.628+0000 7fe000c35780 -1 Falling back to public interface 2026-02-17T04:29:00.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:00.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:00.904+0000 7fe000c35780 -1 osd.7 0 log_to_monitors true 2026-02-17T04:29:01.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:01.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:01.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:01.749 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:29:01.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:01.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-17T04:29:01.913 INFO:tasks.workunit.client.0.trial090.stdout:osd.7 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/4021513727,v1:127.0.0.1:6859/4021513727] [v2:127.0.0.1:6860/4021513727,v1:127.0.0.1:6861/4021513727] exists,up 52b0ec42-95ab-45c1-a5eb-2588807b590a 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 8 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/8 2026-02-17T04:29:01.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/8' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/8/journal' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:01.918 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:29:01.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/8 2026-02-17T04:29:01.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:29:01.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fbfdacf0-e240-41da-9399-78ce9c8fef9e 2026-02-17T04:29:01.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 fbfdacf0-e240-41da-9399-78ce9c8fef9e' 2026-02-17T04:29:01.921 INFO:tasks.workunit.client.0.trial090.stdout:add osd8 fbfdacf0-e240-41da-9399-78ce9c8fef9e 2026-02-17T04:29:01.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:29:01.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCN7pNp7pYyNxAAHCI2DZDs9E9j5ufyeHZbCQ== 2026-02-17T04:29:01.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCN7pNp7pYyNxAAHCI2DZDs9E9j5ufyeHZbCQ=="}' 2026-02-17T04:29:01.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fbfdacf0-e240-41da-9399-78ce9c8fef9e -i td/osd-scrub-repair/8/new.json 2026-02-17T04:29:02.087 INFO:tasks.workunit.client.0.trial090.stdout:8 2026-02-17T04:29:02.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/8/new.json 2026-02-17T04:29:02.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCN7pNp7pYyNxAAHCI2DZDs9E9j5ufyeHZbCQ== --osd-uuid fbfdacf0-e240-41da-9399-78ce9c8fef9e 2026-02-17T04:29:02.112 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.110+0000 7f64a6831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.113 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.111+0000 7f64a6831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.114 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.112+0000 7f64a6831780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.114 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.112+0000 7f64a6831780 -1 bdev(0x40bcc00 td/osd-scrub-repair/8/block) open stat got: (1) Operation not permitted 2026-02-17T04:29:02.115 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.112+0000 7f64a6831780 -1 bluestore(td/osd-scrub-repair/8) _read_fsid unparsable uuid 2026-02-17T04:29:02.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/8/keyring 2026-02-17T04:29:02.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:29:02.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-17T04:29:02.434 INFO:tasks.workunit.client.0.trial090.stdout:adding osd8 key to auth repository 2026-02-17T04:29:02.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:29:02.643 INFO:tasks.workunit.client.0.trial090.stdout:start osd.8 2026-02-17T04:29:02.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-17T04:29:02.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:02.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:29:02.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:29:02.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:29:02.658 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.656+0000 7f095a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.660 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.658+0000 7f095a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.661 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.659+0000 7f095a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:02.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:02.814 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:29:02.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:02.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-17T04:29:02.860 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:02.858+0000 7f095a40e780 -1 Falling back to public interface 2026-02-17T04:29:02.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:03.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:03.182+0000 7f095a40e780 -1 osd.8 0 log_to_monitors true 2026-02-17T04:29:03.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:03.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:03.978 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:29:03.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:03.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:03.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-17T04:29:04.146 INFO:tasks.workunit.client.0.trial090.stdout:osd.8 up in weight 1 up_from 42 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/2859739357,v1:127.0.0.1:6867/2859739357] [v2:127.0.0.1:6868/2859739357,v1:127.0.0.1:6869/2859739357] exists,up fbfdacf0-e240-41da-9399-78ce9c8fef9e 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 9 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:29:04.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:29:04.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:04.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:04.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 0fb884c2-424d-4e60-ac70-fefee487dca6' 2026-02-17T04:29:04.155 INFO:tasks.workunit.client.0.trial090.stdout:add osd9 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:04.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:29:04.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCQ7pNpGGSHCRAAr9L2vrRiUMu5m4n2QU303w== 2026-02-17T04:29:04.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCQ7pNpGGSHCRAAr9L2vrRiUMu5m4n2QU303w=="}' 2026-02-17T04:29:04.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0fb884c2-424d-4e60-ac70-fefee487dca6 -i td/osd-scrub-repair/9/new.json 2026-02-17T04:29:04.328 INFO:tasks.workunit.client.0.trial090.stdout:9 2026-02-17T04:29:04.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/9/new.json 2026-02-17T04:29:04.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCQ7pNpGGSHCRAAr9L2vrRiUMu5m4n2QU303w== --osd-uuid 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:04.352 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.350+0000 7f1784614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:04.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.352+0000 7f1784614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:04.354 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.353+0000 7f1784614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:04.355 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.353+0000 7f1784614780 -1 bdev(0x33d4c00 td/osd-scrub-repair/9/block) open stat got: (1) Operation not permitted 2026-02-17T04:29:04.355 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.353+0000 7f1784614780 -1 bluestore(td/osd-scrub-repair/9) _read_fsid unparsable uuid 2026-02-17T04:29:04.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/9/keyring 2026-02-17T04:29:04.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:29:04.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-17T04:29:04.687 INFO:tasks.workunit.client.0.trial090.stdout:adding osd9 key to auth repository 2026-02-17T04:29:04.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:29:04.905 INFO:tasks.workunit.client.0.trial090.stdout:start osd.9 2026-02-17T04:29:04.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-17T04:29:04.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:04.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:29:04.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:29:04.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:29:04.920 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.918+0000 7fb30161d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:04.922 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.920+0000 7fb30161d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:04.923 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:04.921+0000 7fb30161d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:05.072 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:05.070+0000 7fb30161d780 -1 Falling back to public interface 2026-02-17T04:29:05.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:05.074 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:29:05.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:05.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:05.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:05.396 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:05.394+0000 7fb30161d780 -1 osd.9 0 log_to_monitors true 2026-02-17T04:29:06.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:06.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:06.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:06.241 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:29:06.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:06.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:06.406 INFO:tasks.workunit.client.0.trial090.stdout:osd.9 up in weight 1 up_from 46 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/2506310634,v1:127.0.0.1:6875/2506310634] [v2:127.0.0.1:6876/2506310634,v1:127.0.0.1:6877/2506310634] exists,up 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:06.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:06.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:893: corrupt_and_repair_lrc: create_rbd_pool 2026-02-17T04:29:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:29:06.567 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:29:06.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:29:06.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:29:06.789 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:29:06.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:29:07.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:29:08.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:894: corrupt_and_repair_lrc: wait_for_clean 2026-02-17T04:29:08.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:08.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:08.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:08.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:08.075 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:08.075 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:08.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:08.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:08.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:08.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:08.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:08.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:08.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:08.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:08.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:08.323 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:08.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:08.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:08.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-17T04:29:08.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-17T04:29:08.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T04:29:08.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:08.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:29:08.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:29:08.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669' 2026-02-17T04:29:08.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-17T04:29:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-17T04:29:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853' 2026-02-17T04:29:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:08.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-17T04:29:08.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-17T04:29:08.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333' 2026-02-17T04:29:08.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:08.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247812 2026-02-17T04:29:08.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247812 2026-02-17T04:29:08.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812' 2026-02-17T04:29:08.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:08.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116996 2026-02-17T04:29:08.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116996 2026-02-17T04:29:08.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812 5-115964116996' 2026-02-17T04:29:08.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:08.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953475 2026-02-17T04:29:08.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953475 2026-02-17T04:29:08.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953475' 2026-02-17T04:29:08.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:08.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T04:29:08.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T04:29:08.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953475 7-158913789955' 2026-02-17T04:29:08.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:08.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626434 2026-02-17T04:29:08.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626434 2026-02-17T04:29:08.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953475 7-158913789955 8-180388626434' 2026-02-17T04:29:08.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:08.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:08.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495618 2026-02-17T04:29:08.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495618 2026-02-17T04:29:08.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953475 7-158913789955 8-180388626434 9-197568495618' 2026-02-17T04:29:08.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:08.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-17T04:29:08.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:08.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-17T04:29:08.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:08.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-17T04:29:08.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T04:29:08.919 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836486 2026-02-17T04:29:08.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:09.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-17T04:29:09.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:09.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:29:09.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:09.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:09.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:29:09.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:09.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:29:09.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:29:09.090 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:29:09.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:09.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:29:09.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:10.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:10.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:10.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:29:10.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:11.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:29:11.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:11.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705669 2026-02-17T04:29:11.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:11.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574853 2026-02-17T04:29:11.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:11.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:11.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574853 2026-02-17T04:29:11.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:11.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574853 2026-02-17T04:29:11.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574853' 2026-02-17T04:29:11.595 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574853 2026-02-17T04:29:11.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:11.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-17T04:29:11.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:11.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411333 2026-02-17T04:29:11.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:11.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411333 2026-02-17T04:29:11.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:11.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411333 2026-02-17T04:29:11.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-17T04:29:11.761 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 77309411333 2026-02-17T04:29:11.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:11.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-17T04:29:11.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:11.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247812 2026-02-17T04:29:11.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:11.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:11.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247812 2026-02-17T04:29:11.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:11.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247812 2026-02-17T04:29:11.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247812' 2026-02-17T04:29:11.930 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.4 seq 98784247812 2026-02-17T04:29:11.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:12.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247813 -lt 98784247812 2026-02-17T04:29:12.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:12.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116996 2026-02-17T04:29:12.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:12.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:12.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116996 2026-02-17T04:29:12.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:12.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116996 2026-02-17T04:29:12.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116996' 2026-02-17T04:29:12.100 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.5 seq 115964116996 2026-02-17T04:29:12.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:12.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116996 -lt 115964116996 2026-02-17T04:29:12.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:12.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953475 2026-02-17T04:29:12.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:12.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:12.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953475 2026-02-17T04:29:12.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:12.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953475 2026-02-17T04:29:12.271 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.6 seq 137438953475 2026-02-17T04:29:12.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953475' 2026-02-17T04:29:12.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:12.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953475 2026-02-17T04:29:12.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:12.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789955 2026-02-17T04:29:12.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:12.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:12.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789955 2026-02-17T04:29:12.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:12.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T04:29:12.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789955' 2026-02-17T04:29:12.442 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.7 seq 158913789955 2026-02-17T04:29:12.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:12.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789955 2026-02-17T04:29:12.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:12.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626434 2026-02-17T04:29:12.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:12.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:12.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626434 2026-02-17T04:29:12.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:12.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626434 2026-02-17T04:29:12.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626434' 2026-02-17T04:29:12.611 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.8 seq 180388626434 2026-02-17T04:29:12.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626434 2026-02-17T04:29:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:12.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495618 2026-02-17T04:29:12.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:12.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:12.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495618 2026-02-17T04:29:12.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:12.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495618 2026-02-17T04:29:12.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495618' 2026-02-17T04:29:12.781 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.9 seq 197568495618 2026-02-17T04:29:12.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495619 -lt 197568495618 2026-02-17T04:29:12.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:12.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:12.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:13.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:13.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:13.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:13.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:29:13.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:13.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:13.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:896: corrupt_and_repair_lrc: create_ec_pool ecpool false k=4 m=2 l=3 plugin=lrc 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:29:13.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:29:13.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:29:13.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:29:13.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=4 m=2 l=3 plugin=lrc 2026-02-17T04:29:13.763 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:29:13.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:29:13.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:29:14.069 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:29:14.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:29:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:29:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:29:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:15.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:15.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:15.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:15.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:15.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:15.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:15.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:15.334 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:15.335 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:15.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:15.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:15.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T04:29:15.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T04:29:15.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T04:29:15.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:15.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-17T04:29:15.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-17T04:29:15.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-17T04:29:15.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:15.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-17T04:29:15.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-17T04:29:15.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855' 2026-02-17T04:29:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:15.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411335 2026-02-17T04:29:15.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411335 2026-02-17T04:29:15.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335' 2026-02-17T04:29:15.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247815 2026-02-17T04:29:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247815 2026-02-17T04:29:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815' 2026-02-17T04:29:15.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:15.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116998 2026-02-17T04:29:15.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116998 2026-02-17T04:29:15.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815 5-115964116998' 2026-02-17T04:29:15.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953478 2026-02-17T04:29:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953478 2026-02-17T04:29:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815 5-115964116998 6-137438953478' 2026-02-17T04:29:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:15.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789957 2026-02-17T04:29:15.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789957 2026-02-17T04:29:15.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815 5-115964116998 6-137438953478 7-158913789957' 2026-02-17T04:29:15.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:15.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626437 2026-02-17T04:29:15.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626437 2026-02-17T04:29:15.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815 5-115964116998 6-137438953478 7-158913789957 8-180388626437' 2026-02-17T04:29:15.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:15.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:15.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495620 2026-02-17T04:29:15.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495620 2026-02-17T04:29:15.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247815 5-115964116998 6-137438953478 7-158913789957 8-180388626437 9-197568495620' 2026-02-17T04:29:15.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:15.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T04:29:15.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:15.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:15.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T04:29:15.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:15.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T04:29:15.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T04:29:15.935 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836488 2026-02-17T04:29:15.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:16.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-17T04:29:16.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:17.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:17.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:17.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T04:29:17.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:17.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-17T04:29:17.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:17.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:17.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-17T04:29:17.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:17.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-17T04:29:17.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T04:29:17.271 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705672 2026-02-17T04:29:17.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T04:29:17.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:17.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-17T04:29:17.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:17.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:17.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-17T04:29:17.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:17.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-17T04:29:17.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-17T04:29:17.445 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574855 2026-02-17T04:29:17.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-17T04:29:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:17.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411335 2026-02-17T04:29:17.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:17.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:17.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411335 2026-02-17T04:29:17.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411335 2026-02-17T04:29:17.612 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 77309411335 2026-02-17T04:29:17.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411335' 2026-02-17T04:29:17.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:17.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-17T04:29:17.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:17.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247815 2026-02-17T04:29:17.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:17.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:17.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247815 2026-02-17T04:29:17.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:17.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247815 2026-02-17T04:29:17.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247815' 2026-02-17T04:29:17.790 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.4 seq 98784247815 2026-02-17T04:29:17.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:17.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247815 -lt 98784247815 2026-02-17T04:29:17.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:17.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116998 2026-02-17T04:29:17.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:17.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:17.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116998 2026-02-17T04:29:17.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:17.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116998 2026-02-17T04:29:17.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116998' 2026-02-17T04:29:17.961 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.5 seq 115964116998 2026-02-17T04:29:17.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:18.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116998 -lt 115964116998 2026-02-17T04:29:18.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:18.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953478 2026-02-17T04:29:18.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:18.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:18.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953478 2026-02-17T04:29:18.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:18.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953478 2026-02-17T04:29:18.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953478' 2026-02-17T04:29:18.133 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.6 seq 137438953478 2026-02-17T04:29:18.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:18.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953478 -lt 137438953478 2026-02-17T04:29:18.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:18.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789957 2026-02-17T04:29:18.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:18.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:18.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789957 2026-02-17T04:29:18.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:18.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789957 2026-02-17T04:29:18.300 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.7 seq 158913789957 2026-02-17T04:29:18.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789957' 2026-02-17T04:29:18.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:18.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789958 -lt 158913789957 2026-02-17T04:29:18.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:18.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626437 2026-02-17T04:29:18.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:18.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:18.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626437 2026-02-17T04:29:18.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:18.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626437 2026-02-17T04:29:18.469 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.8 seq 180388626437 2026-02-17T04:29:18.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626437' 2026-02-17T04:29:18.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:18.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626437 -lt 180388626437 2026-02-17T04:29:18.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:18.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495620 2026-02-17T04:29:18.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:18.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:18.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495620 2026-02-17T04:29:18.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:18.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495620 2026-02-17T04:29:18.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495620' 2026-02-17T04:29:18.641 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.9 seq 197568495620 2026-02-17T04:29:18.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:18.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495621 -lt 197568495620 2026-02-17T04:29:18.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:18.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:18.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:19.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:29:19.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:19.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:19.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:19.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:19.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:19.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:19.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:19.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:29:19.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:19.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:19.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:897: corrupt_and_repair_lrc: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:29:19.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:29:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:29:19.603 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:29:19.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:29:19.808 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:29:19.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:29:19.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:29:19.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:29:19.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:29:19.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:29:19.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:29:19.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:29:19.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:29:20.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-17T04:29:20.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:29:20.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:29:20.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:29:20.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-17T04:29:20.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:29:20.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:29:20.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-17T04:29:20.175 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:20.175 INFO:tasks.workunit.client.0.trial090.stderr:9 2026-02-17T04:29:20.175 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:29:20.176 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:20.176 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:20.176 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:20.176 INFO:tasks.workunit.client.0.trial090.stderr:7' 2026-02-17T04:29:20.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 6 2 1 7 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('5' '9' '0' '6' '2' '1' '7') 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=5 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=9 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:29:20.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:29:20.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:29:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:29:20.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:29:20.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:29:20.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:29:20.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:29:20.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:29:20.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:29:20.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:29:20.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:29:20.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:29:20.391 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:29:20.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:29:20.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:20.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:29:20.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:20.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:20.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:20.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:29:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:29:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:29:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:29:20.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:29:20.449 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:20.447+0000 7f025140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:20.451 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:20.449+0000 7f025140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:20.451 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:20.450+0000 7f025140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:20.597 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:20.595+0000 7f025140f780 -1 Falling back to public interface 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:29:20.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:20.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:29:20.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:20.889 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:20.887+0000 7f025140f780 -1 osd.3 62 log_to_monitors true 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:21.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:29:21.928 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 66 up_thru 66 down_at 63 last_clean_interval [18,62) [v2:127.0.0.1:6826/1451594558,v1:127.0.0.1:6827/1451594558] [v2:127.0.0.1:6828/1451594558,v1:127.0.0.1:6829/1451594558] exists,up 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:29:21.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:21.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:21.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:21.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:29:21.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:21.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:21.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:21.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:21.930 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:21.930 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:21.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:21.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:21.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:22.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:22.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:22.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:29:22.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:29:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:29:22.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:22.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:29:22.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:29:22.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T04:29:22.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:22.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-17T04:29:22.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-17T04:29:22.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858' 2026-02-17T04:29:22.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841538 2026-02-17T04:29:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841538 2026-02-17T04:29:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538' 2026-02-17T04:29:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247817 2026-02-17T04:29:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247817 2026-02-17T04:29:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817' 2026-02-17T04:29:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117000 2026-02-17T04:29:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117000 2026-02-17T04:29:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817 5-115964117000' 2026-02-17T04:29:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:22.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953480 2026-02-17T04:29:22.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953480 2026-02-17T04:29:22.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817 5-115964117000 6-137438953480' 2026-02-17T04:29:22.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:22.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789960 2026-02-17T04:29:22.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789960 2026-02-17T04:29:22.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817 5-115964117000 6-137438953480 7-158913789960' 2026-02-17T04:29:22.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626439 2026-02-17T04:29:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626439 2026-02-17T04:29:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817 5-115964117000 6-137438953480 7-158913789960 8-180388626439' 2026-02-17T04:29:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:22.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:22.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495623 2026-02-17T04:29:22.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495623 2026-02-17T04:29:22.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-283467841538 4-98784247817 5-115964117000 6-137438953480 7-158913789960 8-180388626439 9-197568495623' 2026-02-17T04:29:22.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:22.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:29:22.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:22.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:29:22.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:22.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:29:22.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:29:22.775 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836491 2026-02-17T04:29:22.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:22.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:29:22.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:22.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:29:22.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:22.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:22.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:29:22.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:22.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:29:22.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:29:22.943 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705674 2026-02-17T04:29:22.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:23.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T04:29:23.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:23.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-17T04:29:23.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:23.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:23.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-17T04:29:23.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:23.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-17T04:29:23.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-17T04:29:23.115 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574858 2026-02-17T04:29:23.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:23.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-17T04:29:23.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:23.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841538 2026-02-17T04:29:23.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:23.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:23.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841538 2026-02-17T04:29:23.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:23.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841538 2026-02-17T04:29:23.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841538' 2026-02-17T04:29:23.284 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 283467841538 2026-02-17T04:29:23.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:23.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 283467841538 2026-02-17T04:29:23.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:24.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:24.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:24.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841538 -lt 283467841538 2026-02-17T04:29:24.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:24.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247817 2026-02-17T04:29:24.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:24.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:24.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247817 2026-02-17T04:29:24.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247817 2026-02-17T04:29:24.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247817' 2026-02-17T04:29:24.618 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247817 2026-02-17T04:29:24.619 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:24.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247817 -lt 98784247817 2026-02-17T04:29:24.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:24.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117000 2026-02-17T04:29:24.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:24.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:24.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117000 2026-02-17T04:29:24.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:24.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117000 2026-02-17T04:29:24.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117000' 2026-02-17T04:29:24.785 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 115964117000 2026-02-17T04:29:24.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:24.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117001 -lt 115964117000 2026-02-17T04:29:24.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:24.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953480 2026-02-17T04:29:24.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:24.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:24.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953480 2026-02-17T04:29:24.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:24.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953480 2026-02-17T04:29:24.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953480' 2026-02-17T04:29:24.959 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953480 2026-02-17T04:29:24.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:25.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953480 -lt 137438953480 2026-02-17T04:29:25.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:25.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789960 2026-02-17T04:29:25.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:25.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:25.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789960 2026-02-17T04:29:25.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:25.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789960 2026-02-17T04:29:25.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789960' 2026-02-17T04:29:25.129 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789960 2026-02-17T04:29:25.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789960 -lt 158913789960 2026-02-17T04:29:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:25.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626439 2026-02-17T04:29:25.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:25.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:25.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626439 2026-02-17T04:29:25.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:25.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626439 2026-02-17T04:29:25.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626439' 2026-02-17T04:29:25.302 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 180388626439 2026-02-17T04:29:25.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:25.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626440 -lt 180388626439 2026-02-17T04:29:25.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:25.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495623 2026-02-17T04:29:25.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:25.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:25.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495623 2026-02-17T04:29:25.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495623 2026-02-17T04:29:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495623' 2026-02-17T04:29:25.474 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 197568495623 2026-02-17T04:29:25.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:25.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495623 -lt 197568495623 2026-02-17T04:29:25.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:25.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:25.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:29:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:25.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:26.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:29:26.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:26.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:26.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:26.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:29:26.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:26.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:26.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:29:26.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:29:26.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:29:26.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:29:26.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:26.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:26.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:26.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:26.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:26.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:29:26.730 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:29:26.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:26.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:26.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:14.066974+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:26.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:27.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:27.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:27.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:27.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:27.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:28.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:14.066974+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:28.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:29.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:29.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:29.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:14.066974+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:29.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:30.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:30.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:30.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:30.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:30.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:30.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:30.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:30.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:14.066974+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:30.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:31.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:31.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:31.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:31.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:31.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:31.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:14.066974+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:31.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:32.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:32.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:14.066974+0000 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:29:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:29:32.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:29:32.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:29:32.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:32.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:29:32.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:29:32.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:29:32.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:29:32.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:29:32.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:29:32.892 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:29:32.892 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:29:32.893 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:32.937 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:start osd.9 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:29:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:29:32.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:29:32.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:29:32.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:29:32.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:32.951+0000 7f4c2f457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:32.954 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:32.952+0000 7f4c2f457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:32.955 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:32.953+0000 7f4c2f457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:33.098 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:33.095+0000 7f4c2f457780 -1 Falling back to public interface 2026-02-17T04:29:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:29:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:29:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:33.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:33.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:33.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:33.109 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:29:33.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:33.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:33.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:33.458 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:33.456+0000 7f4c2f457780 -1 osd.9 68 log_to_monitors true 2026-02-17T04:29:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:34.275 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:34.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:34.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:34.439 INFO:tasks.workunit.client.0.trial090.stderr:osd.9 up in weight 1 up_from 71 up_thru 0 down_at 68 last_clean_interval [46,68) [v2:127.0.0.1:6874/11205215,v1:127.0.0.1:6875/11205215] [v2:127.0.0.1:6876/11205215,v1:127.0.0.1:6877/11205215] exists,up 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:34.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:34.441 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:34.442 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:34.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:34.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:34.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:34.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:34.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:34.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-17T04:29:34.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-17T04:29:34.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T04:29:34.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:34.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705678 2026-02-17T04:29:34.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705678 2026-02-17T04:29:34.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678' 2026-02-17T04:29:34.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:34.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574861 2026-02-17T04:29:34.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574861 2026-02-17T04:29:34.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861' 2026-02-17T04:29:34.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:34.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841541 2026-02-17T04:29:34.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841541 2026-02-17T04:29:34.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541' 2026-02-17T04:29:34.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:34.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247820 2026-02-17T04:29:34.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247820 2026-02-17T04:29:34.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820' 2026-02-17T04:29:34.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:34.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:35.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117004 2026-02-17T04:29:35.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117004 2026-02-17T04:29:35.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820 5-115964117004' 2026-02-17T04:29:35.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:35.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:35.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953484 2026-02-17T04:29:35.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953484 2026-02-17T04:29:35.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820 5-115964117004 6-137438953484' 2026-02-17T04:29:35.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:35.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:35.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-17T04:29:35.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-17T04:29:35.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820 5-115964117004 6-137438953484 7-158913789963' 2026-02-17T04:29:35.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:35.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626443 2026-02-17T04:29:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626443 2026-02-17T04:29:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820 5-115964117004 6-137438953484 7-158913789963 8-180388626443' 2026-02-17T04:29:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:35.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:35.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678018 2026-02-17T04:29:35.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678018 2026-02-17T04:29:35.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-283467841541 4-98784247820 5-115964117004 6-137438953484 7-158913789963 8-180388626443 9-304942678018' 2026-02-17T04:29:35.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:35.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-17T04:29:35.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:35.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:35.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-17T04:29:35.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:35.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-17T04:29:35.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T04:29:35.291 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836494 2026-02-17T04:29:35.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:35.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-17T04:29:35.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:36.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:36.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:36.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T04:29:36.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:36.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705678 2026-02-17T04:29:36.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:36.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:36.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705678 2026-02-17T04:29:36.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705678 2026-02-17T04:29:36.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705678' 2026-02-17T04:29:36.631 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705678 2026-02-17T04:29:36.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:36.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705678 2026-02-17T04:29:36.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:36.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574861 2026-02-17T04:29:36.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:36.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574861 2026-02-17T04:29:36.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:36.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574861 2026-02-17T04:29:36.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574861' 2026-02-17T04:29:36.800 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574861 2026-02-17T04:29:36.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:36.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574862 -lt 55834574861 2026-02-17T04:29:36.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:36.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841541 2026-02-17T04:29:36.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:36.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:36.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841541 2026-02-17T04:29:36.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:36.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841541 2026-02-17T04:29:36.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841541' 2026-02-17T04:29:36.967 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 283467841541 2026-02-17T04:29:36.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:37.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841542 -lt 283467841541 2026-02-17T04:29:37.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247820 2026-02-17T04:29:37.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:37.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247820 2026-02-17T04:29:37.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247820 2026-02-17T04:29:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247820' 2026-02-17T04:29:37.137 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247820 2026-02-17T04:29:37.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:37.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247821 -lt 98784247820 2026-02-17T04:29:37.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117004 2026-02-17T04:29:37.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:37.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117004 2026-02-17T04:29:37.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117004 2026-02-17T04:29:37.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117004' 2026-02-17T04:29:37.306 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 115964117004 2026-02-17T04:29:37.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:37.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117004 -lt 115964117004 2026-02-17T04:29:37.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953484 2026-02-17T04:29:37.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:37.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953484 2026-02-17T04:29:37.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953484 2026-02-17T04:29:37.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953484' 2026-02-17T04:29:37.478 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953484 2026-02-17T04:29:37.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:37.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953484 -lt 137438953484 2026-02-17T04:29:37.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789963 2026-02-17T04:29:37.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:37.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789963 2026-02-17T04:29:37.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-17T04:29:37.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789963' 2026-02-17T04:29:37.645 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789963 2026-02-17T04:29:37.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:37.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-17T04:29:37.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626443 2026-02-17T04:29:37.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:37.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626443 2026-02-17T04:29:37.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626443 2026-02-17T04:29:37.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626443' 2026-02-17T04:29:37.814 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 180388626443 2026-02-17T04:29:37.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:37.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626443 -lt 180388626443 2026-02-17T04:29:37.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:37.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-304942678018 2026-02-17T04:29:37.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:37.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:37.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-304942678018 2026-02-17T04:29:37.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:37.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678018 2026-02-17T04:29:37.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 304942678018' 2026-02-17T04:29:37.982 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 304942678018 2026-02-17T04:29:37.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:38.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678018 -lt 304942678018 2026-02-17T04:29:38.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:38.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:38.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:29:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:38.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:29:38.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:38.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:38.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:38.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:29:38.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:38.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:38.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:29:38.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:29:38.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 5 2026-02-17T04:29:38.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:29:38.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:29:38.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=5 2026-02-17T04:29:38.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:29:38.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:29:38.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:29:38.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:29:38.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:29:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:29:38.983 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:29:39.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:29:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:start osd.5 2026-02-17T04:29:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:39.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:29:39.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:29:39.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:29:39.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:29:39.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:29:39.047 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:39.046+0000 7f4fc83d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:39.048 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:39.047+0000 7f4fc83d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:39.049 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:39.048+0000 7f4fc83d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:39.183 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:39.182+0000 7f4fc83d6780 -1 Falling back to public interface 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:39.201 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:29:39.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:39.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:29:39.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:39.522 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:39.521+0000 7f4fc83d6780 -1 osd.5 74 log_to_monitors true 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:29:40.535 INFO:tasks.workunit.client.0.trial090.stderr:osd.5 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [27,74) [v2:127.0.0.1:6842/2576813359,v1:127.0.0.1:6843/2576813359] [v2:127.0.0.1:6844/2576813359,v1:127.0.0.1:6845/2576813359] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:29:40.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:40.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:40.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:40.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:40.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:40.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:40.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:40.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:40.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:40.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:40.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:40.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:40.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:40.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:40.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:40.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-17T04:29:40.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-17T04:29:40.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T04:29:40.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:40.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:40.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-17T04:29:40.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-17T04:29:40.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680' 2026-02-17T04:29:40.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:40.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:40.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574864 2026-02-17T04:29:40.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574864 2026-02-17T04:29:40.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864' 2026-02-17T04:29:40.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:40.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:41.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841544 2026-02-17T04:29:41.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841544 2026-02-17T04:29:41.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544' 2026-02-17T04:29:41.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247823 2026-02-17T04:29:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247823 2026-02-17T04:29:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823' 2026-02-17T04:29:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-17T04:29:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-17T04:29:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823 5-330712481794' 2026-02-17T04:29:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953486 2026-02-17T04:29:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953486 2026-02-17T04:29:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823 5-330712481794 6-137438953486' 2026-02-17T04:29:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:41.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789965 2026-02-17T04:29:41.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789965 2026-02-17T04:29:41.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823 5-330712481794 6-137438953486 7-158913789965' 2026-02-17T04:29:41.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:41.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626445 2026-02-17T04:29:41.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626445 2026-02-17T04:29:41.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823 5-330712481794 6-137438953486 7-158913789965 8-180388626445' 2026-02-17T04:29:41.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:41.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678020 2026-02-17T04:29:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678020 2026-02-17T04:29:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-55834574864 3-283467841544 4-98784247823 5-330712481794 6-137438953486 7-158913789965 8-180388626445 9-304942678020' 2026-02-17T04:29:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:41.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-17T04:29:41.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:41.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:41.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-17T04:29:41.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:41.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-17T04:29:41.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T04:29:41.382 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836496 2026-02-17T04:29:41.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836496 2026-02-17T04:29:41.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:42.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:42.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836496 2026-02-17T04:29:42.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:42.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705680 2026-02-17T04:29:42.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:42.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:42.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-17T04:29:42.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:42.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705680 2026-02-17T04:29:42.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-17T04:29:42.721 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705680 2026-02-17T04:29:42.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:42.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-17T04:29:42.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:42.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574864 2026-02-17T04:29:42.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:42.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:42.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574864 2026-02-17T04:29:42.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:42.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574864 2026-02-17T04:29:42.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574864' 2026-02-17T04:29:42.892 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574864 2026-02-17T04:29:42.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574864 -lt 55834574864 2026-02-17T04:29:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841544 2026-02-17T04:29:43.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:43.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841544 2026-02-17T04:29:43.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841544 2026-02-17T04:29:43.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841544' 2026-02-17T04:29:43.063 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 283467841544 2026-02-17T04:29:43.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:43.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841544 -lt 283467841544 2026-02-17T04:29:43.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247823 2026-02-17T04:29:43.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:43.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247823 2026-02-17T04:29:43.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247823 2026-02-17T04:29:43.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247823' 2026-02-17T04:29:43.233 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247823 2026-02-17T04:29:43.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247823 -lt 98784247823 2026-02-17T04:29:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-330712481794 2026-02-17T04:29:43.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:43.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-330712481794 2026-02-17T04:29:43.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-17T04:29:43.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 330712481794' 2026-02-17T04:29:43.402 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 330712481794 2026-02-17T04:29:43.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:43.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481794 -lt 330712481794 2026-02-17T04:29:43.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953486 2026-02-17T04:29:43.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:43.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953486 2026-02-17T04:29:43.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953486 2026-02-17T04:29:43.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953486' 2026-02-17T04:29:43.572 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953486 2026-02-17T04:29:43.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:43.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953486 -lt 137438953486 2026-02-17T04:29:43.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789965 2026-02-17T04:29:43.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:43.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789965 2026-02-17T04:29:43.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789965 2026-02-17T04:29:43.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789965' 2026-02-17T04:29:43.741 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789965 2026-02-17T04:29:43.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:43.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789966 -lt 158913789965 2026-02-17T04:29:43.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:43.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626445 2026-02-17T04:29:43.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:43.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:43.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626445 2026-02-17T04:29:43.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:43.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626445 2026-02-17T04:29:43.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626445' 2026-02-17T04:29:43.913 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 180388626445 2026-02-17T04:29:43.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:44.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626445 -lt 180388626445 2026-02-17T04:29:44.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:44.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-304942678020 2026-02-17T04:29:44.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:44.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:44.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-304942678020 2026-02-17T04:29:44.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:44.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678020 2026-02-17T04:29:44.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 304942678020' 2026-02-17T04:29:44.083 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 304942678020 2026-02-17T04:29:44.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:44.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678020 -lt 304942678020 2026-02-17T04:29:44.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:44.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:44.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:44.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:29:44.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:44.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:44.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:44.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:44.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:44.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:44.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:44.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:29:44.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:44.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:44.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:44.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:29:44.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:29:44.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:45.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:45.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:45.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:45.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:29:45.343 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:29:45.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:45.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:29:45.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:45.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:45.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:45.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:46.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:46.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:46.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:46.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:46.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:46.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:46.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:46.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:46.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:47.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:47.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:47.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:47.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:47.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:47.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:47.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:47.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:47.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:48.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:48.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:48.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:48.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:48.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:49.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:49.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:50.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:50.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:50.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:51.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:51.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:26.859278+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:51.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:29:52.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:29:52.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:29:52.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:29:52.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:29:52.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:29:52.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:29:52.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:29:52.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:26.859278+0000 2026-02-17T04:29:52.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:29:52.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:52.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:29:52.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:29:52.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:29:52.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:29:52.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:29:52.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:29:52.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:29:52.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:29:52.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:29:52.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:29:52.679 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:29:52.679 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:29:52.679 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:29:52.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:29:52.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:52.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:29:52.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:29:52.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:29:52.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:52.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:start osd.9 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:29:52.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:29:52.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:29:52.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:29:52.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:29:52.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:29:52.741 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:52.740+0000 7fcc8ba2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:52.742 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:52.742+0000 7fcc8ba2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:52.743 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:52.742+0000 7fcc8ba2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:29:52.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:52.892+0000 7fcc8ba2f780 -1 Falling back to public interface 2026-02-17T04:29:52.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:29:52.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:53.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:29:53.248 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:29:53.247+0000 7fcc8ba2f780 -1 osd.9 78 log_to_monitors true 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:29:54.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:29:54.230 INFO:tasks.workunit.client.0.trial090.stderr:osd.9 up in weight 1 up_from 82 up_thru 0 down_at 79 last_clean_interval [71,78) [v2:127.0.0.1:6874/2815847022,v1:127.0.0.1:6875/2815847022] [v2:127.0.0.1:6876/2815847022,v1:127.0.0.1:6877/2815847022] exists,up 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:29:54.231 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:29:54.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:29:54.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:29:54.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:29:54.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:29:54.487 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:29:54.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:29:54.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:29:54.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-17T04:29:54.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-17T04:29:54.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-17T04:29:54.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:29:54.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705684 2026-02-17T04:29:54.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705684 2026-02-17T04:29:54.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684' 2026-02-17T04:29:54.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:29:54.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574867 2026-02-17T04:29:54.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574867 2026-02-17T04:29:54.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867' 2026-02-17T04:29:54.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:29:54.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841547 2026-02-17T04:29:54.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841547 2026-02-17T04:29:54.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547' 2026-02-17T04:29:54.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:29:54.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247826 2026-02-17T04:29:54.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247826 2026-02-17T04:29:54.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826' 2026-02-17T04:29:54.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:29:54.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481798 2026-02-17T04:29:54.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481798 2026-02-17T04:29:54.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826 5-330712481798' 2026-02-17T04:29:54.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:29:54.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953490 2026-02-17T04:29:54.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953490 2026-02-17T04:29:54.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826 5-330712481798 6-137438953490' 2026-02-17T04:29:54.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:29:54.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789969 2026-02-17T04:29:54.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789969 2026-02-17T04:29:54.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826 5-330712481798 6-137438953490 7-158913789969' 2026-02-17T04:29:54.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:54.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:29:55.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626449 2026-02-17T04:29:55.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626449 2026-02-17T04:29:55.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826 5-330712481798 6-137438953490 7-158913789969 8-180388626449' 2026-02-17T04:29:55.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:29:55.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:29:55.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=352187318274 2026-02-17T04:29:55.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 352187318274 2026-02-17T04:29:55.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-55834574867 3-283467841547 4-98784247826 5-330712481798 6-137438953490 7-158913789969 8-180388626449 9-352187318274' 2026-02-17T04:29:55.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:55.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-17T04:29:55.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:55.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:29:55.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-17T04:29:55.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:55.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-17T04:29:55.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-17T04:29:55.085 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836500 2026-02-17T04:29:55.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:55.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836500 2026-02-17T04:29:55.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:56.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:29:56.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:56.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836500 2026-02-17T04:29:56.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:29:57.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:29:57.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:29:57.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-17T04:29:57.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:57.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705684 2026-02-17T04:29:57.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:57.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:29:57.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705684 2026-02-17T04:29:57.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:57.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705684 2026-02-17T04:29:57.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705684' 2026-02-17T04:29:57.588 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705684 2026-02-17T04:29:57.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:29:57.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705684 -lt 38654705684 2026-02-17T04:29:57.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:57.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574867 2026-02-17T04:29:57.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:57.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:29:57.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574867 2026-02-17T04:29:57.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:57.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574867 2026-02-17T04:29:57.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574867' 2026-02-17T04:29:57.757 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 55834574867 2026-02-17T04:29:57.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:29:57.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574868 -lt 55834574867 2026-02-17T04:29:57.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:57.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841547 2026-02-17T04:29:57.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:57.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:29:57.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841547 2026-02-17T04:29:57.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:57.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841547 2026-02-17T04:29:57.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841547' 2026-02-17T04:29:57.926 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 283467841547 2026-02-17T04:29:57.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:29:58.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841548 -lt 283467841547 2026-02-17T04:29:58.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247826 2026-02-17T04:29:58.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:29:58.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247826 2026-02-17T04:29:58.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247826 2026-02-17T04:29:58.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247826' 2026-02-17T04:29:58.100 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247826 2026-02-17T04:29:58.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:29:58.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247827 -lt 98784247826 2026-02-17T04:29:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-330712481798 2026-02-17T04:29:58.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:29:58.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-330712481798 2026-02-17T04:29:58.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481798 2026-02-17T04:29:58.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 330712481798' 2026-02-17T04:29:58.269 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 330712481798 2026-02-17T04:29:58.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:29:58.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481798 -lt 330712481798 2026-02-17T04:29:58.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953490 2026-02-17T04:29:58.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:29:58.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953490 2026-02-17T04:29:58.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953490 2026-02-17T04:29:58.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953490' 2026-02-17T04:29:58.438 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953490 2026-02-17T04:29:58.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:29:58.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953490 -lt 137438953490 2026-02-17T04:29:58.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789969 2026-02-17T04:29:58.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:29:58.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789969 2026-02-17T04:29:58.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789969 2026-02-17T04:29:58.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789969' 2026-02-17T04:29:58.605 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789969 2026-02-17T04:29:58.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:29:58.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789970 -lt 158913789969 2026-02-17T04:29:58.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626449 2026-02-17T04:29:58.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:29:58.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626449 2026-02-17T04:29:58.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626449 2026-02-17T04:29:58.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626449' 2026-02-17T04:29:58.776 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 180388626449 2026-02-17T04:29:58.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:29:58.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626449 -lt 180388626449 2026-02-17T04:29:58.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:29:58.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-352187318274 2026-02-17T04:29:58.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:29:58.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:29:58.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-352187318274 2026-02-17T04:29:58.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:29:58.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=352187318274 2026-02-17T04:29:58.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 352187318274' 2026-02-17T04:29:58.946 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 352187318274 2026-02-17T04:29:58.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:29:59.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 352187318275 -lt 352187318274 2026-02-17T04:29:59.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:29:59.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:59.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:29:59.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:29:59.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:29:59.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:29:59.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:29:59.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:29:59.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:29:59.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:29:59.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:29:59.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:29:59.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:29:59.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:29:59.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 5 9 2026-02-17T04:29:59.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:29:59.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:29:59.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=5 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=9 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 577995"' 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 577995' 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 577996"' 2026-02-17T04:29:59.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 577996' 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 577995 577996' 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 577995 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/577998: /' 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:29:59.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/578000: /' 2026-02-17T04:29:59.962 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:29:59.963 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:29:59.964 INFO:tasks.workunit.client.0.trial090.stderr:577998: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:29:59.965 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:29:59.966 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:29:59.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:29:59.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:29:59.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:29:59.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:29:59.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:29:59.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: start osd.5 2026-02-17T04:30:00.215 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING remove 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-17T04:30:00.216 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:00.217 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:30:00.218 INFO:tasks.workunit.client.0.trial090.stderr:578000: start osd.9 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:01.471 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2026-02-17T04:29:59.977+0000 7f9c0305e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2026-02-17T04:29:59.979+0000 7f9c0305e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2026-02-17T04:29:59.980+0000 7f9c0305e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: 0 2026-02-17T04:30:01.472 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2026-02-17T04:30:00.192+0000 7f9c0305e780 -1 Falling back to public interface 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2026-02-17T04:30:00.631+0000 7f9c0305e780 -1 osd.5 83 log_to_monitors true 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: 1 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:01.473 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: osd.5 up in weight 1 up_from 87 up_thru 87 down_at 84 last_clean_interval [77,83) [v2:127.0.0.1:6842/3247960987,v1:127.0.0.1:6843/3247960987] [v2:127.0.0.1:6844/3247960987,v1:127.0.0.1:6845/3247960987] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:01.474 INFO:tasks.workunit.client.0.trial090.stderr:577998: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:01.725 INFO:tasks.workunit.client.0.trial090.stderr:577998: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2026-02-17T04:30:00.231+0000 7f8f5da2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2026-02-17T04:30:00.232+0000 7f8f5da2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2026-02-17T04:30:00.233+0000 7f8f5da2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:01.726 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: 0 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2026-02-17T04:30:00.492+0000 7f8f5da2d780 -1 Falling back to public interface 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2026-02-17T04:30:00.780+0000 7f8f5da2d780 -1 osd.9 83 log_to_monitors true 2026-02-17T04:30:01.727 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: 1 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: osd.9 up in weight 1 up_from 88 up_thru 0 down_at 84 last_clean_interval [82,83) [v2:127.0.0.1:6874/237075142,v1:127.0.0.1:6875/237075142] [v2:127.0.0.1:6876/237075142,v1:127.0.0.1:6877/237075142] exists,up 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:01.728 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:01.729 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:01.729 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:01.729 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:01.729 INFO:tasks.workunit.client.0.trial090.stderr:578000: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:578000: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: ge3: get_timeout_delays: echo true 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:01.967 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 1 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 2 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 3 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 4 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 5 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 6 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 7 2026-02-17T04:30:01.968 INFO:tasks.workunit.client.0.trial090.stderr:577998: 8 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: 9' 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705686 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705686 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686' 2026-02-17T04:30:01.969 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574870 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574870 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870' 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841550 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841550 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550' 2026-02-17T04:30:01.970 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.227 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest_timeout_delays: echo true 2026-02-17T04:30:02.227 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:02.227 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: 1 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: 2 2026-02-17T04:30:02.228 INFO:tasks.workunit.client.0.trial090.stderr:578000: 3 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 4 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 5 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 6 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 7 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 8 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: 9' 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836504 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836504 2026-02-17T04:30:02.229 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504' 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705687 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705687 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687' 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574871 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574871 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871' 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:02.230 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841551 2026-02-17T04:30:02.231 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841551 2026-02-17T04:30:02.231 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551' 2026-02-17T04:30:02.231 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clot/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247829 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247829 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829' 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=373662154754 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 373662154754 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829 5-373662154754' 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953492 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953492 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829 5-373662154754 6-137438953492' 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789972 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789972 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829 5-373662154754 6-137438953492 7-158913789972' 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626451 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626451 2026-02-17T04:30:02.330 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829 5-373662154754 6-137438953492 7-158913789972 8-180388626451' 2026-02-17T04:30:02.331 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.331 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:02.331 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122050 2026-02-17T04:30:02.331 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122050 2026-02-17T04:30:02.331 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-283467841550 4-98784247829 5-373662154754 6-137438953492 7-158913789972 8-180388626451 9-377957122050' 2026-02-17T04:30:02.592 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ne.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:02.592 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247830 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247830 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830' 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=373662154755 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 373662154755 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830 5-373662154755' 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:02.593 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953493 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953493 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830 5-373662154755 6-137438953493' 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789973 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789973 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830 5-373662154755 6-137438953493 7-158913789973' 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626452 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626452 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830 5-373662154755 6-137438953493 7-158913789973 8-180388626452' 2026-02-17T04:30:02.594 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:02.595 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:02.595 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122051 2026-02-17T04:30:02.595 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122051 2026-02-17T04:30:02.595 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836504 1-38654705687 2-55834574871 3-283467841551 4-98784247830 5-373662154755 6-137438953493 7-158913789973 8-180388626452 9-377957122051' 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-17T04:30:02.863 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.0 seq 21474836503 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836503 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705686 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705686 2026-02-17T04:30:02.864 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705686 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705686' 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.1 seq 38654705686 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705686 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574870 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574870 2026-02-17T04:30:02.865 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574870 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.2 seq 55834574870 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574871 -lt 55834574870 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841550 2026-02-17T04:30:02.866 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=u/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836504 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836504 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836504 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2026-02-17T04:30:03.119 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.0 seq 21474836504 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836504 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705687 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705687 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705687 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-17T04:30:03.120 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.1 seq 38654705687 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574871 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574871 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574871 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574871' 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.2 seq 55834574871 2026-02-17T04:30:03.121 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:03.122 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574871 -lt 55834574871 2026-02-17T04:30:03.122 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.122 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841551 2026-02-17T04:30:03.122 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.122 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:5783 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841550 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841550 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841550' 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.3 seq 283467841550 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841551 -lt 283467841550 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247829 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247829 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247829 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247829' 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.4 seq 98784247829 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247830 -lt 98784247829 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-373662154754 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-373662154754 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=373662154754 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 373662154754' 2026-02-17T04:30:03.392 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.5 seq 373662154754 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 373662154755 -lt 373662154754 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953492 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953492 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.393 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953492 2026-02-17T04:30:03.648 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841551 2026-02-17T04:30:03.648 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.648 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841551 2026-02-17T04:30:03.648 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841551' 2026-02-17T04:30:03.648 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.3 seq 283467841551 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841551 -lt 283467841551 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247830 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247830 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247830 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247830' 2026-02-17T04:30:03.649 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.4 seq 98784247830 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247830 -lt 98784247830 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-373662154755 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-373662154755 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=373662154755 2026-02-17T04:30:03.650 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 373662154755' 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.5 seq 373662154755 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 373662154755 -lt 373662154755 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953493 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953493 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:03.651 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953493 2026-02-17T04:30:04.091 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:s.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953492' 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.6 seq 137438953492 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953492 -lt 137438953492 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789972 2026-02-17T04:30:04.092 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789972 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789972 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789972' 2026-02-17T04:30:04.093 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.7 seq 158913789972 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789972 -lt 158913789972 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626451 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626451 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:04.094 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626451 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626451' 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.8 seq 180388626451 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626451 -lt 180388626451 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-377957122050 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-377957122050 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122050 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 377957122050' 2026-02-17T04:30:04.095 INFO:tasks.workunit.client.0.trial090.stderr:577998: waiting osd.9 seq 377957122050 2026-02-17T04:30:04.096 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:04.096 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122050 -lt 377957122050 2026-02-17T04:30:04.688 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:04.689 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:04.690 INFO:tasks.workunit.client.0.trial090.stderr:577998: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:577998: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:04.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 577996 2026-02-17T04:30:05.326 INFO:tasks.workunit.client.0.trial090.stderr:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953493' 2026-02-17T04:30:05.326 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.6 seq 137438953493 2026-02-17T04:30:05.326 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:05.326 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953492 -lt 137438953493 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953493 -lt 137438953493 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789973 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789973 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789973 2026-02-17T04:30:05.327 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789973' 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.7 seq 158913789973 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789973 -lt 158913789973 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626452 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626452 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626452 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626452' 2026-02-17T04:30:05.328 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.8 seq 180388626452 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626453 -lt 180388626452 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-377957122051 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-377957122051 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:05.329 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122051 2026-02-17T04:30:06.091 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 377957122051' 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: waiting osd.9 seq 377957122051 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122051 -lt 377957122051 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:06.092 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:06.093 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:578000: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:30:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:30:06.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:30:06.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:06.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:06.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:06.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:30:06.579 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:06.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:06.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:06.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:06.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:06.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:06.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:06.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:07.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:07.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:07.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:07.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:07.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:08.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:08.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:08.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:09.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:09.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:10.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:10.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:10.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:11.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:11.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:11.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:11.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:11.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:11.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:11.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:11.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:29:46.003594+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:11.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:12.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:12.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:12.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:12.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:12.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:12.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:12.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:29:46.003594+0000 2026-02-17T04:30:12.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 581460"' 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 581460' 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 581462"' 2026-02-17T04:30:12.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 581462' 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 581460 581462' 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 581460 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/581463: /' 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:30:12.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/581466: /' 2026-02-17T04:30:12.975 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:12.975 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:12.975 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:30:12.975 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:12.976 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: _ 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: hinfo_key 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: snapset 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:30:12.977 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:12.978 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:12.979 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:12.980 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:30:12.981 INFO:tasks.workunit.client.0.trial090.stderr:581463: start osd.5 2026-02-17T04:30:13.010 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:30:13.011 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:30:13.012 INFO:tasks.workunit.client.0.trial090.stderr:581466: _ 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: hinfo_key 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: snapset 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:13.013 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:13.014 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:13.015 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:30:13.016 INFO:tasks.workunit.client.0.trial090.stderr:581466: start osd.9 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2026-02-17T04:30:12.990+0000 7f5872051780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2026-02-17T04:30:12.991+0000 7f5872051780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2026-02-17T04:30:12.993+0000 7f5872051780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:14.488 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: 0 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2026-02-17T04:30:13.181+0000 7f5872051780 -1 Falling back to public interface 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2026-02-17T04:30:13.555+0000 7f5872051780 -1 osd.5 89 log_to_monitors true 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: 1 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: osd.5 up in weight 1 up_from 93 up_thru 93 down_at 90 last_clean_interval [87,89) [v2:127.0.0.1:6842/1690871745,v1:127.0.0.1:6843/1690871745] [v2:127.0.0.1:6844/1690871745,v1:127.0.0.1:6845/1690871745] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:14.489 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:14.490 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:14.490 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:14.490 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:14.490 INFO:tasks.workunit.client.0.trial090.stderr:581463: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:14.520 INFO:tasks.workunit.client.0.trial090.stderr:581463: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helprecovery_ops 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2026-02-17T04:30:13.026+0000 7f294923a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2026-02-17T04:30:13.027+0000 7f294923a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2026-02-17T04:30:13.028+0000 7f294923a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 0 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2026-02-17T04:30:13.229+0000 7f294923a780 -1 Falling back to public interface 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2026-02-17T04:30:13.589+0000 7f294923a780 -1 osd.9 89 log_to_monitors true 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:14.521 INFO:tasks.workunit.client.0.trial090.stderr:581466: 1 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: osd.9 up in weight 1 up_from 93 up_thru 0 down_at 90 last_clean_interval [88,89) [v2:127.0.0.1:6874/549278915,v1:127.0.0.1:6875/549278915] [v2:127.0.0.1:6876/549278915,v1:127.0.0.1:6877/549278915] exists,up 0fb884c2-424d-4e60-ac70-fefee487dca6 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:14.522 INFO:tasks.workunit.client.0.trial090.stderr:581466: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581466: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: 1 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: 2 2026-02-17T04:30:14.987 INFO:tasks.workunit.client.0.trial090.stderr:581463: 3 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 4 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 5 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 6 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 7 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 8 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: 9' 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691' 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574874 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574874 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874' 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841554 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841554 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554' 2026-02-17T04:30:14.988 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubunh:1593: get_timeout_delays: echo true 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:15.017 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 1 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 2 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 3 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 4 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 5 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 6 2026-02-17T04:30:15.018 INFO:tasks.workunit.client.0.trial090.stderr:581466: 7 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: 8 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: 9' 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836508 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836508 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508' 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705692 2026-02-17T04:30:15.019 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705692 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692' 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574875 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574875 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875' 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841555 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841555 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555' 2026-02-17T04:30:15.020 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cetu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247833 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247833 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833' 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958530 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958530 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833 5-399431958530' 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953497 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953497 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833 5-399431958530 6-137438953497' 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789976 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789976 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833 5-399431958530 6-137438953497 7-158913789976' 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626456 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626456 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833 5-399431958530 6-137438953497 7-158913789976 8-180388626456' 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958530 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958530 2026-02-17T04:30:15.352 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-55834574874 3-283467841554 4-98784247833 5-399431958530 6-137438953497 7-158913789976 8-180388626456 9-399431958530' 2026-02-17T04:30:15.380 INFO:tasks.workunit.client.0.trial090.stderr:5814phtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:15.380 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247834 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247834 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834' 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958531 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958531 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834 5-399431958531' 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953498 2026-02-17T04:30:15.381 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953498 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834 5-399431958531 6-137438953498' 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789977 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789977 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834 5-399431958531 6-137438953498 7-158913789977' 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626457 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626457 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834 5-399431958531 6-137438953498 7-158913789977 8-180388626457' 2026-02-17T04:30:15.382 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:15.383 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:15.383 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958531 2026-02-17T04:30:15.383 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958531 2026-02-17T04:30:15.383 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-55834574875 3-283467841555 4-98784247834 5-399431958531 6-137438953498 7-158913789977 8-180388626457 9-399431958531' 2026-02-17T04:30:17.047 INFO:tasks.workunit.client.0.trial090.stderr:581466: /63: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.047 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-17T04:30:17.047 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.047 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.0 seq 21474836507 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836507 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-17T04:30:17.048 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705691 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705691 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.1 seq 38654705691 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705692 -lt 38654705691 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574874 2026-02-17T04:30:17.049 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574874 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574874 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574874' 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.2 seq 55834574874 2026-02-17T04:30:17.050 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:17.063 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_shome/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.063 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836508 2026-02-17T04:30:17.063 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.063 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836508 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836508 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836508' 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.0 seq 21474836508 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836508 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836508 2026-02-17T04:30:17.064 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705692 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705692 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705692 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705692' 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.1 seq 38654705692 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705692 -lt 38654705692 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.065 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574875 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574875 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574875 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574875' 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.2 seq 55834574875 2026-02-17T04:30:17.066 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:17.576 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats:tats: test 55834574876 -lt 55834574874 2026-02-17T04:30:17.576 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.576 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841554 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841554 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841554 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841554' 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.3 seq 283467841554 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841556 -lt 283467841554 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247833 2026-02-17T04:30:17.577 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247833 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247833 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247833' 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.4 seq 98784247833 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247835 -lt 98784247833 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-399431958530 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.578 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-399431958530 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958530 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 399431958530' 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.5 seq 399431958530 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958530 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953497 2026-02-17T04:30:17.579 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clon test 55834574876 -lt 55834574875 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-283467841555 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-283467841555 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841555 2026-02-17T04:30:17.587 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 283467841555' 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.3 seq 283467841555 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841556 -lt 283467841555 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247834 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247834 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247834 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247834' 2026-02-17T04:30:17.588 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.4 seq 98784247834 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247835 -lt 98784247834 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-399431958531 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-399431958531 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958531 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 399431958531' 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.5 seq 399431958531 2026-02-17T04:30:17.589 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:17.590 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958531 2026-02-17T04:30:17.590 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:17.590 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953498 2026-02-17T04:30:17.590 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.097 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.clie.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:18.097 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953497 2026-02-17T04:30:18.097 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.097 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953497 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953497' 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.6 seq 137438953497 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953498 -lt 137438953497 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789976 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789976 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789976 2026-02-17T04:30:18.098 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789976' 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.7 seq 158913789976 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789977 -lt 158913789976 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626456 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626456 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626456 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626456' 2026-02-17T04:30:18.099 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.8 seq 180388626456 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626457 -lt 180388626456 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958530 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958530 2026-02-17T04:30:18.100 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=39943195ent.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953498 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953498 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953498' 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.6 seq 137438953498 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953498 -lt 137438953498 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.101 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789977 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789977 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789977 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789977' 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.7 seq 158913789977 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789977 -lt 158913789977 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626457 2026-02-17T04:30:18.102 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626457 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626457 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626457' 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.8 seq 180388626457 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626457 -lt 180388626457 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958531 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:18.103 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958531 2026-02-17T04:30:18.104 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:18.104 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958531 2026-02-17T04:30:18.860 INFO:tasks.workunit.client.0.trial090.stderr:8530 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958530' 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: waiting osd.9 seq 399431958530 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958530 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:18.861 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:581463: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:18.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 581462 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958531' 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: waiting osd.9 seq 399431958531 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958531 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:18.864 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:581466: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:18.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:30:18.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:30:18.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:30:18.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 5 2026-02-17T04:30:18.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:30:18.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:30:18.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-17T04:30:18.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=5 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 584371"' 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 584371' 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 584372"' 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 584372' 2026-02-17T04:30:18.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 584371 584372' 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 584371 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/584374: /' 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:30:18.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/584376: /' 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:19.164 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.165 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:19.166 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:30:19.167 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:19.167 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:19.167 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:19.167 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:19.168 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:30:19.169 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:30:19.170 INFO:tasks.workunit.client.0.trial090.stderr:584374: start osd.3 2026-02-17T04:30:19.204 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.204 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:19.205 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:30:19.206 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:19.207 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:19.208 INFO:tasks.workunit.client.0.trial090.stderr:584376: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:19.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:19.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:30:19.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:30:19.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: start osd.5 2026-02-17T04:30:20.678 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2026-02-17T04:30:19.179+0000 7f1183e37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2026-02-17T04:30:19.180+0000 7f1183e37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2026-02-17T04:30:19.181+0000 7f1183e37780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:20.679 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: 0 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2026-02-17T04:30:19.421+0000 7f1183e37780 -1 Falling back to public interface 2026-02-17T04:30:20.680 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2026-02-17T04:30:19.744+0000 7f1183e37780 -1 osd.3 94 log_to_monitors true 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: 1 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: osd.3 up in weight 1 up_from 98 up_thru 98 down_at 95 last_clean_interval [66,94) [v2:127.0.0.1:6826/2051928384,v1:127.0.0.1:6827/2051928384] [v2:127.0.0.1:6828/2051928384,v1:127.0.0.1:6829/2051928384] exists,up 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:20.681 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:20.682 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:20.682 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:20.682 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:20.682 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:20.682 INFO:tasks.workunit.client.0.trial090.stderr:584374: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584374: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2026-02-17T04:30:19.219+0000 7f8b83e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.713 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2026-02-17T04:30:19.220+0000 7f8b83e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2026-02-17T04:30:19.221+0000 7f8b83e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: 0 2026-02-17T04:30:20.714 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2026-02-17T04:30:19.446+0000 7f8b83e09780 -1 Falling back to public interface 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2026-02-17T04:30:19.760+0000 7f8b83e09780 -1 osd.5 94 log_to_monitors true 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:20.715 INFO:tasks.workunit.client.0.trial090.stderr:584376: 1 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: osd.5 up in weight 1 up_from 98 up_thru 98 down_at 95 last_clean_interval [93,94) [v2:127.0.0.1:6842/2939143964,v1:127.0.0.1:6843/2939143964] [v2:127.0.0.1:6844/2939143964,v1:127.0.0.1:6845/2939143964] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:20.716 INFO:tasks.workunit.client.0.trial090.stderr:584376: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:21.176 INFO:tasks.workunit.client.0.trial090.stderr:584376: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:21.177 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 1 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 2 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 3 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 4 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 5 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 6 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 7 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 8 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: 9' 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:21.178 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694' 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574878 2026-02-17T04:30:21.179 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574878 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878' 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795010 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795010 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010' 2026-02-17T04:30:21.180 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.208 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtes3: get_timeout_delays: echo true 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:21.209 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 1 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 2 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 3 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 4 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 5 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 6 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 7 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 8 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: 9' 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.210 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705695 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705695 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695' 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574879 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574879 2026-02-17T04:30:21.211 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879' 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795011 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795011 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011' 2026-02-17T04:30:21.212 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.547 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247837 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247837 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837' 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795010 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795010 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837 5-420906795010' 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:21.548 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953500 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953500 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837 5-420906795010 6-137438953500' 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789979 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789979 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837 5-420906795010 6-137438953500 7-158913789979' 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626459 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626459 2026-02-17T04:30:21.549 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837 5-420906795010 6-137438953500 7-158913789979 8-180388626459' 2026-02-17T04:30:21.550 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.550 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:21.550 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958533 2026-02-17T04:30:21.550 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958533 2026-02-17T04:30:21.550 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705694 2-55834574878 3-420906795010 4-98784247837 5-420906795010 6-137438953500 7-158913789979 8-180388626459 9-399431958533' 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/t/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247838 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247838 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838' 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:21.575 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795011 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795011 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838 5-420906795011' 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953501 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953501 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838 5-420906795011 6-137438953501' 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789980 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789980 2026-02-17T04:30:21.576 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838 5-420906795011 6-137438953501 7-158913789980' 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626460 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626460 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838 5-420906795011 6-137438953501 7-158913789980 8-180388626460' 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958534 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958534 2026-02-17T04:30:21.577 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-55834574879 3-420906795011 4-98784247838 5-420906795011 6-137438953501 7-158913789980 8-180388626460 9-399431958534' 2026-02-17T04:30:23.252 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.0 seq 21474836510 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836510 2026-02-17T04:30:23.253 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836510 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.1 seq 38654705694 2026-02-17T04:30:23.254 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705695 -lt 38654705694 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574878 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574878 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574878 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574878' 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.2 seq 55834574878 2026-02-17T04:30:23.255 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:23.261 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: tesubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.261 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-17T04:30:23.261 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.261 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:23.261 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.0 seq 21474836511 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836511 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836511 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705695 2026-02-17T04:30:23.262 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705695 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705695 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705695' 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.1 seq 38654705695 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705695 -lt 38654705695 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574879 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:23.263 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574879 2026-02-17T04:30:23.264 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.264 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574879 2026-02-17T04:30:23.264 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574879' 2026-02-17T04:30:23.264 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.2 seq 55834574879 2026-02-17T04:30:23.264 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:23.772 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574879 -lt 55834574878 2026-02-17T04:30:23.772 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.772 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-420906795010 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-420906795010 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795010 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 420906795010' 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.3 seq 420906795010 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795010 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.773 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247837 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247837 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247837 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247837' 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.4 seq 98784247837 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247838 -lt 98784247837 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-420906795010 2026-02-17T04:30:23.774 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-420906795010 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795010 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 420906795010' 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.5 seq 420906795010 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795010 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953500 2026-02-17T04:30:23.775 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.782 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0t 55834574879 -lt 55834574879 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-420906795011 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-420906795011 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795011 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 420906795011' 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.3 seq 420906795011 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:23.783 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795011 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247838 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247838 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247838 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247838' 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.4 seq 98784247838 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247838 -lt 98784247838 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.784 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-420906795011 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-420906795011 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795011 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 420906795011' 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.5 seq 420906795011 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795011 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953501 2026-02-17T04:30:23.785 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.292 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:24.292 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953500 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953500 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953500' 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.6 seq 137438953500 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953501 -lt 137438953500 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789979 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:24.293 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789979 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789979 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789979' 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.7 seq 158913789979 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789981 -lt 158913789979 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626459 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626459 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.294 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626459 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626459' 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.8 seq 180388626459 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626460 -lt 180388626459 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958533 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958533 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.295 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958533 2026-02-17T04:30:24.307 INFO:tasks.workunit.client.0.trial090.stderr:58437/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:24.307 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953501 2026-02-17T04:30:24.307 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953501 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953501' 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.6 seq 137438953501 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953501 -lt 137438953501 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789980 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789980 2026-02-17T04:30:24.308 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789980 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789980' 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.7 seq 158913789980 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789981 -lt 158913789980 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626460 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626460 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.309 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626460 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626460' 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.8 seq 180388626460 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626460 -lt 180388626460 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958534 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958534 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:24.310 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958534 2026-02-17T04:30:25.062 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958533' 2026-02-17T04:30:25.062 INFO:tasks.workunit.client.0.trial090.stderr:584374: waiting osd.9 seq 399431958533 2026-02-17T04:30:25.062 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:25.062 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958535 -lt 399431958533 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:25.063 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:584374: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:25.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 584372 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:6: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958534' 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:584376: waiting osd.9 seq 399431958534 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958535 -lt 399431958534 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:25.070 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:25.071 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:584376: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:584376: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:30:25.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:30:25.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:30:25.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:25.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:25.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:25.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:25.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:25.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:30:25.559 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:25.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:25.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:25.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:25.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:25.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:26.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:26.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:26.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:26.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:26.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:26.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:26.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:26.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:26.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:27.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:27.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:27.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:28.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:28.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:29.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:29.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:29.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:29.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:30.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:30.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:30.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:30.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:30.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:30.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:30.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:30.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:07.165652+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:30.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:30:31.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:30:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:30:25.919299+0000 '>' 2026-02-17T04:30:07.165652+0000 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 587844"' 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 587844' 2026-02-17T04:30:31.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 587845"' 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 587845' 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 587844 587845' 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 587844 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/587847: /' 2026-02-17T04:30:31.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:31.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/587849: /' 2026-02-17T04:30:31.781 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.781 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:31.781 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:31.782 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-17T04:30:31.783 INFO:tasks.workunit.client.0.trial090.stderr:587849: _ 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: hinfo_key 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: snapset 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:31.784 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:30:31.785 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:30:31.786 INFO:tasks.workunit.client.0.trial090.stderr:587847: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: _ 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: hinfo_key 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: snapset 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:30:31.787 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:31.788 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:31.788 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:31.788 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:31.789 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:30:31.790 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587847: start osd.3 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$ns.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:31.791 INFO:tasks.workunit.client.0.trial090.stderr:587849: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:30:31.792 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:30:31.793 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:30:31.793 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:30:31.793 INFO:tasks.workunit.client.0.trial090.stderr:587849: start osd.5 2026-02-17T04:30:33.295 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:33.295 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:30:33.295 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2026-02-17T04:30:31.796+0000 7fa13d7e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2026-02-17T04:30:31.797+0000 7fa13d7e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2026-02-17T04:30:31.798+0000 7fa13d7e1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:33.296 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: 0 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2026-02-17T04:30:32.034+0000 7fa13d7e1780 -1 Falling back to public interface 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2026-02-17T04:30:32.374+0000 7fa13d7e1780 -1 osd.5 99 log_to_monitors true 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:33.297 INFO:tasks.workunit.client.0.trial090.stderr:587849: 1 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: osd.5 up in weight 1 up_from 103 up_thru 103 down_at 100 last_clean_interval [98,99) [v2:127.0.0.1:6842/1927617213,v1:127.0.0.1:6843/1927617213] [v2:127.0.0.1:6844/1927617213,v1:127.0.0.1:6845/1927617213] exists,up 4c362cf5-7040-4935-a479-fbe118932cb8 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:33.298 INFO:tasks.workunit.client.0.trial090.stderr:587849: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587849: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-hame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:30:33.299 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2026-02-17T04:30:31.796+0000 7fcbd542e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2026-02-17T04:30:31.797+0000 7fcbd542e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2026-02-17T04:30:31.798+0000 7fcbd542e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: 0 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:33.300 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2026-02-17T04:30:32.006+0000 7fcbd542e780 -1 Falling back to public interface 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2026-02-17T04:30:32.345+0000 7fcbd542e780 -1 osd.3 99 log_to_monitors true 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: 1 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: osd.3 up in weight 1 up_from 103 up_thru 103 down_at 100 last_clean_interval [98,99) [v2:127.0.0.1:6826/1272267432,v1:127.0.0.1:6827/1272267432] [v2:127.0.0.1:6828/1272267432,v1:127.0.0.1:6829/1272267432] exists,up 6ae59254-75e4-40be-88c8-c30915bbf18b 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:33.301 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:33.302 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:30:33.302 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:30:33.302 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:30:33.302 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:33.793 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 1 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 2 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 3 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 4 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 5 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 6 2026-02-17T04:30:33.794 INFO:tasks.workunit.client.0.trial090.stderr:587847: 7 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: 8 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: 9' 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836515 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836515 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515' 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:33.795 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705699 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705699 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699' 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574883 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574883 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883' 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=442381631491 2026-02-17T04:30:33.796 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 442381631491 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flushelpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:30:33.797 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 1 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 2 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 3 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 4 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 5 2026-02-17T04:30:33.798 INFO:tasks.workunit.client.0.trial090.stderr:587849: 6 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: 7 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: 8 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: 9' 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836516 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836516 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516' 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705700 2026-02-17T04:30:33.799 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705700 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700' 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574882 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574882 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882' 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=442381631490 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 442381631490 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490' 2026-02-17T04:30:33.800 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.156 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/u_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491' 2026-02-17T04:30:34.156 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.156 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:34.156 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247842 2026-02-17T04:30:34.156 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247842 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842' 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=442381631490 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 442381631490 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842 5-442381631490' 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953504 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953504 2026-02-17T04:30:34.157 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842 5-442381631490 6-137438953504' 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789984 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789984 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842 5-442381631490 6-137438953504 7-158913789984' 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626463 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626463 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842 5-442381631490 6-137438953504 7-158913789984 8-180388626463' 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:34.158 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958538 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958538 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qbuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247841 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247841 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841' 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=442381631491 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 442381631491 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841 5-442381631491' 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.159 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953505 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953505 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841 5-442381631491 6-137438953505' 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789985 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789985 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841 5-442381631491 6-137438953505 7-158913789985' 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626464 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626464 2026-02-17T04:30:34.160 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841 5-442381631491 6-137438953505 7-158913789985 8-180388626464' 2026-02-17T04:30:34.161 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:30:34.161 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:30:34.161 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958539 2026-02-17T04:30:34.161 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958539 2026-02-17T04:30:34.161 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705700 2-55834574882 3-442381631490 4-98784247841 5-442381631491 6-137438953505 7-158913789985 8-180388626464 9-399431958539' 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:5a/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574883 3-442381631491 4-98784247842 5-442381631490 6-137438953504 7-158913789984 8-180388626463 9-399431958538' 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836515 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836515 2026-02-17T04:30:35.674 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836515 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.0 seq 21474836515 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836515 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836515 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705699 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705699 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705699 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705699' 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.1 seq 38654705699 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705700 -lt 38654705699 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574883 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574883 2026-02-17T04:30:35.675 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.676 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574883 2026-02-17T04:30:35.676 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574883' 2026-02-17T04:30:35.676 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.2 seq 55834574883 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:5878487849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836516 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836516 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.837 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836516 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836516' 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.0 seq 21474836516 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836516 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836516 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705700 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.838 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705700 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705700 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705700' 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.1 seq 38654705700 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705700 -lt 38654705700 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574882 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:30:35.839 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574882 2026-02-17T04:30:35.840 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:35.840 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574882 2026-02-17T04:30:35.840 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574882' 2026-02-17T04:30:35.840 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.2 seq 55834574882 2026-02-17T04:30:35.840 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:36.354 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574883 -lt 55834574882 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-442381631490 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-442381631490 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=442381631490 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 442381631490' 2026-02-17T04:30:36.355 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.3 seq 442381631490 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 442381631491 -lt 442381631490 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247841 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247841 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247841 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247841' 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.4 seq 98784247841 2026-02-17T04:30:36.356 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247841 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-442381631491 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-442381631491 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=442381631491 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 442381631491' 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.5 seq 442381631491 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 442381631491 -lt 442381631491 2026-02-17T04:30:36.357 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.358 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953505 2026-02-17T04:30:36.358 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.361 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/c7: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574883 -lt 55834574883 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-442381631491 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-442381631491 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=442381631491 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 442381631491' 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.3 seq 442381631491 2026-02-17T04:30:36.362 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 442381631491 -lt 442381631491 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247842 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247842 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247842 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247842' 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.4 seq 98784247842 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:30:36.363 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247842 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-442381631490 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-442381631490 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=442381631490 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 442381631490' 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.5 seq 442381631490 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 442381631491 -lt 442381631490 2026-02-17T04:30:36.364 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standallone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953505 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953505 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953505' 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.6 seq 137438953505 2026-02-17T04:30:36.873 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953505 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789985 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789985 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789985 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789985' 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.7 seq 158913789985 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789985 -lt 158913789985 2026-02-17T04:30:36.874 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626464 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626464 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626464 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626464' 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.8 seq 180388626464 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626465 -lt 180388626464 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.875 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958539 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958539 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=39943one/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953504 2026-02-17T04:30:36.876 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953504 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953504 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953504' 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.6 seq 137438953504 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953504 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.877 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789984 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789984 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789984 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789984' 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.7 seq 158913789984 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789985 -lt 158913789984 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-180388626463 2026-02-17T04:30:36.878 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-180388626463 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626463 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 180388626463' 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.8 seq 180388626463 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626465 -lt 180388626463 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958538 2026-02-17T04:30:36.879 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:30:36.880 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:30:36.880 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958538 2026-02-17T04:30:37.629 INFO:tasks.workunit.client.0.trial090.stderr:587847: //hom1958539 2026-02-17T04:30:37.629 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958539' 2026-02-17T04:30:37.629 INFO:tasks.workunit.client.0.trial090.stderr:587849: waiting osd.9 seq 399431958539 2026-02-17T04:30:37.629 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958539 -lt 399431958539 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:37.630 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:587849: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:37.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:37.643 INFO:tasks.workunit.client.0.trial090.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:30:37.643 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958538 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958538' 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: waiting osd.9 seq 399431958538 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958539 -lt 399431958538 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:30:37.644 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:587847: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:30:37.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 587845 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:30:37.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:30:37.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:30:37.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:30:37.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:30:37.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:30:37.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:37.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:37.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:37.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:37.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:30:37.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:30:37.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:30:37.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:30:37.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:30:37.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:30:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:30:37.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:30:37.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:30:37.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:30:37.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:30:37.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:30:37.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:30:37.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:30:37.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:30:37.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:30:37.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:30:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:30:37.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:30:37.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:30:37.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:30:37.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:30:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:30:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:30:37.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:30:37.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:30:37.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:30:37.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:30:37.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:30:37.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:30:37.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:30:37.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:30:37.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:30:37.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:30:37.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:30:37.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:30:37.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:30:37.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:30:37.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:30:37.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_lrc_overwrites td/osd-scrub-repair 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:905: TEST_corrupt_and_repair_lrc_overwrites: '[' true = true ']' 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:906: TEST_corrupt_and_repair_lrc_overwrites: corrupt_and_repair_lrc td/osd-scrub-repair true 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:884: corrupt_and_repair_lrc: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:885: corrupt_and_repair_lrc: local allow_overwrites=true 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:886: corrupt_and_repair_lrc: local poolname=ecpool 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:888: corrupt_and_repair_lrc: run_mon td/osd-scrub-repair a 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:30:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:30:37.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:30:37.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:37.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:30:37.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:30:37.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:30:37.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:30:37.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:30:37.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:30:37.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.876 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.877 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:30:37.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:30:37.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:30:37.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:30:37.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:30:37.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:30:37.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:30:37.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:30:37.921 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:30:37.921 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:30:37.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:30:37.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:889: corrupt_and_repair_lrc: run_mgr td/osd-scrub-repair x 2026-02-17T04:30:37.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:30:37.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:30:37.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:30:37.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:30:37.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:30:37.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:30:38.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:30:38.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:38.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:38.046 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:38.046 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:38.047 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:38.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:38.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:30:38.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:30:38.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: seq 0 9 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 0 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:38.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:38.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:38.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:38.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:38.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:30:38.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:38.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=13bac625-ab6d-43c7-b9b0-f3af9faf49d6 2026-02-17T04:30:38.071 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 13bac625-ab6d-43c7-b9b0-f3af9faf49d6 2026-02-17T04:30:38.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 13bac625-ab6d-43c7-b9b0-f3af9faf49d6' 2026-02-17T04:30:38.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:38.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDu7pNpHCiJBBAAOW9hz3DEzVc5g8qLGRjOEg== 2026-02-17T04:30:38.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDu7pNpHCiJBBAAOW9hz3DEzVc5g8qLGRjOEg=="}' 2026-02-17T04:30:38.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 13bac625-ab6d-43c7-b9b0-f3af9faf49d6 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:30:38.157 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:38.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:30:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDu7pNpHCiJBBAAOW9hz3DEzVc5g8qLGRjOEg== --osd-uuid 13bac625-ab6d-43c7-b9b0-f3af9faf49d6 2026-02-17T04:30:38.181 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.179+0000 7f8d29433780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.183 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.181+0000 7f8d29433780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.183 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.182+0000 7f8d29433780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.182+0000 7f8d29433780 -1 bdev(0x2ae4c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:38.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.182+0000 7f8d29433780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:30:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:30:38.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:38.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:30:38.564 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:30:38.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:38.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:30:38.648 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:30:38.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:38.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:38.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:38.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:38.662 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.660+0000 7f70c340e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.663 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.662+0000 7f70c340e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.663+0000 7f70c340e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:38.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:30:38.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:38.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:30:38.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:38.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:38.731 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:38.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:38.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:38.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:38.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:30:38.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:38.867 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:38.865+0000 7f70c340e780 -1 Falling back to public interface 2026-02-17T04:30:39.208 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:39.206+0000 7f70c340e780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:30:39.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:39.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:39.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:39.811 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:39.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:39.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:30:39.891 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/850416995,v1:127.0.0.1:6801/850416995] [v2:127.0.0.1:6802/850416995,v1:127.0.0.1:6803/850416995] exists,up 13bac625-ab6d-43c7-b9b0-f3af9faf49d6 2026-02-17T04:30:39.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:39.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:39.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:39.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:39.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 1 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:30:39.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:39.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=43327292-847b-4d06-adca-84648e3c341e 2026-02-17T04:30:39.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 43327292-847b-4d06-adca-84648e3c341e' 2026-02-17T04:30:39.899 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 43327292-847b-4d06-adca-84648e3c341e 2026-02-17T04:30:39.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDv7pNpNNbeNRAAqiuRFOazyIIo85F+dpANFA== 2026-02-17T04:30:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDv7pNpNNbeNRAAqiuRFOazyIIo85F+dpANFA=="}' 2026-02-17T04:30:39.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 43327292-847b-4d06-adca-84648e3c341e -i td/osd-scrub-repair/1/new.json 2026-02-17T04:30:39.984 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:39.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:30:39.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDv7pNpNNbeNRAAqiuRFOazyIIo85F+dpANFA== --osd-uuid 43327292-847b-4d06-adca-84648e3c341e 2026-02-17T04:30:40.007 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.005+0000 7f15bc5d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.008 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.006+0000 7f15bc5d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.010 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.007+0000 7f15bc5d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.010 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.008+0000 7f15bc5d4780 -1 bdev(0x3678c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:40.010 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.008+0000 7f15bc5d4780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:30:40.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:30:40.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:40.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:30:40.386 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:30:40.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:40.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:30:40.594 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:30:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:40.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:40.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:40.608 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.606+0000 7f998a84f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.609 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.607+0000 7f998a84f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.610 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.608+0000 7f998a84f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:40.744 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:40.742+0000 7f998a84f780 -1 Falling back to public interface 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:40.762 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:40.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:40.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:30:40.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:41.028 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:41.027+0000 7f998a84f780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:30:41.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:41.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:41.930 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:41.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:41.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:41.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:30:42.100 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3195618024,v1:127.0.0.1:6811/3195618024] [v2:127.0.0.1:6812/3195618024,v1:127.0.0.1:6813/3195618024] exists,up 43327292-847b-4d06-adca-84648e3c341e 2026-02-17T04:30:42.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 2 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:30:42.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:42.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:42.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=875f1069-e86e-4242-beb5-5d90a44e0304 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 875f1069-e86e-4242-beb5-5d90a44e0304' 2026-02-17T04:30:42.108 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 875f1069-e86e-4242-beb5-5d90a44e0304 2026-02-17T04:30:42.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:42.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDy7pNpq0DKBhAA3RGv5/j0g5b9ydK3WL+Ydw== 2026-02-17T04:30:42.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDy7pNpq0DKBhAA3RGv5/j0g5b9ydK3WL+Ydw=="}' 2026-02-17T04:30:42.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 875f1069-e86e-4242-beb5-5d90a44e0304 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:30:42.281 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:30:42.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:30:42.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDy7pNpq0DKBhAA3RGv5/j0g5b9ydK3WL+Ydw== --osd-uuid 875f1069-e86e-4242-beb5-5d90a44e0304 2026-02-17T04:30:42.306 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.304+0000 7fc54a213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:42.307 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.305+0000 7fc54a213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:42.308 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.306+0000 7fc54a213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:42.308 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.306+0000 7fc54a213780 -1 bdev(0x36bec00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:42.309 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.306+0000 7fc54a213780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:30:42.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:30:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:30:42.631 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:30:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:30:42.843 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:30:42.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:42.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:42.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:42.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:42.858 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.856+0000 7f1100a46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:42.859 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.857+0000 7f1100a46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:42.860 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:42.858+0000 7f1100a46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:43.002 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:43.000+0000 7f1100a46780 -1 Falling back to public interface 2026-02-17T04:30:43.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:43.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:43.014 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:43.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:43.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:30:43.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:43.331 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:43.329+0000 7f1100a46780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:30:44.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:44.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:44.181 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:44.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:44.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:30:44.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:44.347 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2372880848,v1:127.0.0.1:6819/2372880848] [v2:127.0.0.1:6820/2372880848,v1:127.0.0.1:6821/2372880848] exists,up 875f1069-e86e-4242-beb5-5d90a44e0304 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 3 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:30:44.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:44.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:44.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:30:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 afe6991b-c470-438e-b11d-a0c5bd0d684e' 2026-02-17T04:30:44.356 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:30:44.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:44.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD07pNpqbB8FRAA84fr0FNTVULG0GfFmV3JIg== 2026-02-17T04:30:44.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD07pNpqbB8FRAA84fr0FNTVULG0GfFmV3JIg=="}' 2026-02-17T04:30:44.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new afe6991b-c470-438e-b11d-a0c5bd0d684e -i td/osd-scrub-repair/3/new.json 2026-02-17T04:30:44.531 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:30:44.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:30:44.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD07pNpqbB8FRAA84fr0FNTVULG0GfFmV3JIg== --osd-uuid afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:30:44.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:44.555+0000 7facaba35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:44.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:44.556+0000 7facaba35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:44.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:44.557+0000 7facaba35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:44.559 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:44.557+0000 7facaba35780 -1 bdev(0x3ff0c00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:44.559 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:44.557+0000 7facaba35780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:30:44.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:30:44.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:44.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:30:44.875 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:30:44.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:45.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:30:45.098 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:30:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:45.112 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:45.111+0000 7f1870ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:45.113 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:45.112+0000 7f1870ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:45.114 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:45.113+0000 7f1870ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:45.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:45.271 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:45.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:45.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:45.285 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:45.284+0000 7f1870ffd780 -1 Falling back to public interface 2026-02-17T04:30:45.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:45.589 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:45.588+0000 7f1870ffd780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:30:46.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:46.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:46.438 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:46.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:46.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:46.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:30:46.601 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2915880885,v1:127.0.0.1:6827/2915880885] [v2:127.0.0.1:6828/2915880885,v1:127.0.0.1:6829/2915880885] exists,up afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:30:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 4 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/4 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/4' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/4/journal' 2026-02-17T04:30:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/4 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=935fa2f2-c6ac-40dd-aa1b-55a8dca063d9 2026-02-17T04:30:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 935fa2f2-c6ac-40dd-aa1b-55a8dca063d9' 2026-02-17T04:30:46.609 INFO:tasks.workunit.client.0.trial090.stdout:add osd4 935fa2f2-c6ac-40dd-aa1b-55a8dca063d9 2026-02-17T04:30:46.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:46.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD27pNpJk+dJBAAcJl3OgGDpl9sNznqf/V1xw== 2026-02-17T04:30:46.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD27pNpJk+dJBAAcJl3OgGDpl9sNznqf/V1xw=="}' 2026-02-17T04:30:46.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 935fa2f2-c6ac-40dd-aa1b-55a8dca063d9 -i td/osd-scrub-repair/4/new.json 2026-02-17T04:30:46.779 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:30:46.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/4/new.json 2026-02-17T04:30:46.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD27pNpJk+dJBAAcJl3OgGDpl9sNznqf/V1xw== --osd-uuid 935fa2f2-c6ac-40dd-aa1b-55a8dca063d9 2026-02-17T04:30:46.805 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:46.804+0000 7fbcafa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:46.806 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:46.805+0000 7fbcafa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:46.807 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:46.806+0000 7fbcafa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:46.808 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:46.807+0000 7fbcafa3a780 -1 bdev(0x35eac00 td/osd-scrub-repair/4/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:46.808 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:46.807+0000 7fbcafa3a780 -1 bluestore(td/osd-scrub-repair/4) _read_fsid unparsable uuid 2026-02-17T04:30:47.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/4/keyring 2026-02-17T04:30:47.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:47.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-17T04:30:47.151 INFO:tasks.workunit.client.0.trial090.stdout:adding osd4 key to auth repository 2026-02-17T04:30:47.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:47.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-17T04:30:47.366 INFO:tasks.workunit.client.0.trial090.stdout:start osd.4 2026-02-17T04:30:47.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:47.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:47.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:47.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:47.381 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:47.380+0000 7fe95dfd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:47.382 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:47.381+0000 7fe95dfd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:47.383 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:47.382+0000 7fe95dfd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:47.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-17T04:30:47.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:47.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-17T04:30:47.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:47.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:47.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:47.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:47.531 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:47.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:47.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-17T04:30:47.559 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:47.558+0000 7fe95dfd8780 -1 Falling back to public interface 2026-02-17T04:30:47.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:47.891 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:47.889+0000 7fe95dfd8780 -1 osd.4 0 log_to_monitors true 2026-02-17T04:30:48.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:48.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:48.697 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:48.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:48.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:48.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-17T04:30:48.862 INFO:tasks.workunit.client.0.trial090.stdout:osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1920937628,v1:127.0.0.1:6835/1920937628] [v2:127.0.0.1:6836/1920937628,v1:127.0.0.1:6837/1920937628] exists,up 935fa2f2-c6ac-40dd-aa1b-55a8dca063d9 2026-02-17T04:30:48.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 5 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:30:48.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:48.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:30:48.871 INFO:tasks.workunit.client.0.trial090.stdout:add osd5 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:30:48.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 0c22539d-d708-49fa-b836-0d51a5e61077' 2026-02-17T04:30:48.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:48.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD47pNpGlcvNBAAQsjT3RGezGgl0EMq6OgRQw== 2026-02-17T04:30:48.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD47pNpGlcvNBAAQsjT3RGezGgl0EMq6OgRQw=="}' 2026-02-17T04:30:48.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0c22539d-d708-49fa-b836-0d51a5e61077 -i td/osd-scrub-repair/5/new.json 2026-02-17T04:30:49.039 INFO:tasks.workunit.client.0.trial090.stdout:5 2026-02-17T04:30:49.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/5/new.json 2026-02-17T04:30:49.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD47pNpGlcvNBAAQsjT3RGezGgl0EMq6OgRQw== --osd-uuid 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:30:49.064 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.063+0000 7f6c7184f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.065 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.064+0000 7f6c7184f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.066 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.065+0000 7f6c7184f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.067 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.066+0000 7f6c7184f780 -1 bdev(0x320ec00 td/osd-scrub-repair/5/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:49.067 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.066+0000 7f6c7184f780 -1 bluestore(td/osd-scrub-repair/5) _read_fsid unparsable uuid 2026-02-17T04:30:49.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/5/keyring 2026-02-17T04:30:49.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:49.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-17T04:30:49.405 INFO:tasks.workunit.client.0.trial090.stdout:adding osd5 key to auth repository 2026-02-17T04:30:49.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:49.619 INFO:tasks.workunit.client.0.trial090.stdout:start osd.5 2026-02-17T04:30:49.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-17T04:30:49.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:49.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:49.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:49.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:49.635 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.634+0000 7fd8ac43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.636 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.635+0000 7fd8ac43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.637 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.636+0000 7fd8ac43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:49.776 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:49.775+0000 7fd8ac43b780 -1 Falling back to public interface 2026-02-17T04:30:49.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-17T04:30:49.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:49.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:30:49.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:49.784 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:49.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:49.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:49.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:49.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:49.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:49.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:50.089 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:50.088+0000 7fd8ac43b780 -1 osd.5 0 log_to_monitors true 2026-02-17T04:30:50.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:50.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:50.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:50.950 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:50.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:50.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:30:51.122 INFO:tasks.workunit.client.0.trial090.stdout:osd.5 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2784769626,v1:127.0.0.1:6843/2784769626] [v2:127.0.0.1:6844/2784769626,v1:127.0.0.1:6845/2784769626] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:30:51.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 6 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/6 2026-02-17T04:30:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/6' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/6/journal' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:51.128 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:51.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/6 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bac7dee1-4bcf-45e4-ba4d-de496161b783 2026-02-17T04:30:51.130 INFO:tasks.workunit.client.0.trial090.stdout:add osd6 bac7dee1-4bcf-45e4-ba4d-de496161b783 2026-02-17T04:30:51.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 bac7dee1-4bcf-45e4-ba4d-de496161b783' 2026-02-17T04:30:51.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:51.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD77pNpP4oLCBAAx+OuK8zuc8d08um6XqgJfQ== 2026-02-17T04:30:51.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD77pNpP4oLCBAAx+OuK8zuc8d08um6XqgJfQ=="}' 2026-02-17T04:30:51.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bac7dee1-4bcf-45e4-ba4d-de496161b783 -i td/osd-scrub-repair/6/new.json 2026-02-17T04:30:51.299 INFO:tasks.workunit.client.0.trial090.stdout:6 2026-02-17T04:30:51.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/6/new.json 2026-02-17T04:30:51.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD77pNpP4oLCBAAx+OuK8zuc8d08um6XqgJfQ== --osd-uuid bac7dee1-4bcf-45e4-ba4d-de496161b783 2026-02-17T04:30:51.324 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.323+0000 7f6600639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:51.325 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.324+0000 7f6600639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:51.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.325+0000 7f6600639780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:51.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.326+0000 7f6600639780 -1 bdev(0x3692c00 td/osd-scrub-repair/6/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:51.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.326+0000 7f6600639780 -1 bluestore(td/osd-scrub-repair/6) _read_fsid unparsable uuid 2026-02-17T04:30:51.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/6/keyring 2026-02-17T04:30:51.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:51.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-17T04:30:51.659 INFO:tasks.workunit.client.0.trial090.stdout:adding osd6 key to auth repository 2026-02-17T04:30:51.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:51.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-17T04:30:51.871 INFO:tasks.workunit.client.0.trial090.stdout:start osd.6 2026-02-17T04:30:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:51.886 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.885+0000 7fa96a257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:51.887 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.887+0000 7fa96a257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:51.888 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:51.887+0000 7fa96a257780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:52.038 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:52.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:52.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-17T04:30:52.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:52.090+0000 7fa96a257780 -1 Falling back to public interface 2026-02-17T04:30:52.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:52.400 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:52.399+0000 7fa96a257780 -1 osd.6 0 log_to_monitors true 2026-02-17T04:30:53.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:53.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:53.203 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:53.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:53.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:53.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-17T04:30:53.370 INFO:tasks.workunit.client.0.trial090.stdout:osd.6 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/2361361952,v1:127.0.0.1:6851/2361361952] [v2:127.0.0.1:6852/2361361952,v1:127.0.0.1:6853/2361361952] exists,up bac7dee1-4bcf-45e4-ba4d-de496161b783 2026-02-17T04:30:53.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:53.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 7 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/7 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:53.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/7' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/7/journal' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:53.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:53.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/7 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1b94a49a-17d5-4887-8624-fcce435900ce 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 1b94a49a-17d5-4887-8624-fcce435900ce' 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stdout:add osd7 1b94a49a-17d5-4887-8624-fcce435900ce 2026-02-17T04:30:53.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:53.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD97pNpCnbYFhAA9IOnwN6GHkL6iq3WYY7hWQ== 2026-02-17T04:30:53.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD97pNpCnbYFhAA9IOnwN6GHkL6iq3WYY7hWQ=="}' 2026-02-17T04:30:53.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1b94a49a-17d5-4887-8624-fcce435900ce -i td/osd-scrub-repair/7/new.json 2026-02-17T04:30:53.546 INFO:tasks.workunit.client.0.trial090.stdout:7 2026-02-17T04:30:53.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/7/new.json 2026-02-17T04:30:53.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD97pNpCnbYFhAA9IOnwN6GHkL6iq3WYY7hWQ== --osd-uuid 1b94a49a-17d5-4887-8624-fcce435900ce 2026-02-17T04:30:53.570 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:53.569+0000 7f6c285d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:53.572 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:53.571+0000 7f6c285d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:53.572 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:53.572+0000 7f6c285d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:53.573 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:53.572+0000 7f6c285d8780 -1 bdev(0x260ec00 td/osd-scrub-repair/7/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:53.573 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:53.572+0000 7f6c285d8780 -1 bluestore(td/osd-scrub-repair/7) _read_fsid unparsable uuid 2026-02-17T04:30:53.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/7/keyring 2026-02-17T04:30:53.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:53.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-17T04:30:53.905 INFO:tasks.workunit.client.0.trial090.stdout:adding osd7 key to auth repository 2026-02-17T04:30:53.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:54.115 INFO:tasks.workunit.client.0.trial090.stdout:start osd.7 2026-02-17T04:30:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-17T04:30:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:54.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:54.128 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:54.127+0000 7f9fe5844780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:54.130 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:54.129+0000 7f9fe5844780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:54.130 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:54.130+0000 7f9fe5844780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:54.262 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:54.261+0000 7f9fe5844780 -1 Falling back to public interface 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:54.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:54.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:54.283 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:54.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:54.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-17T04:30:54.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:54.563 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:54.562+0000 7f9fe5844780 -1 osd.7 0 log_to_monitors true 2026-02-17T04:30:55.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:55.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:55.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:55.449 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:55.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:55.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-17T04:30:55.612 INFO:tasks.workunit.client.0.trial090.stdout:osd.7 up in weight 1 up_from 37 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/2799561532,v1:127.0.0.1:6859/2799561532] [v2:127.0.0.1:6860/2799561532,v1:127.0.0.1:6861/2799561532] exists,up 1b94a49a-17d5-4887-8624-fcce435900ce 2026-02-17T04:30:55.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:55.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:55.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:55.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 8 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/8 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/8' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/8/journal' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:55.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/8 2026-02-17T04:30:55.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:55.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f8a49599-c18a-4e2f-b002-54e151762f4d 2026-02-17T04:30:55.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 f8a49599-c18a-4e2f-b002-54e151762f4d' 2026-02-17T04:30:55.616 INFO:tasks.workunit.client.0.trial090.stdout:add osd8 f8a49599-c18a-4e2f-b002-54e151762f4d 2026-02-17T04:30:55.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:55.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD/7pNpRZM+JRAAsZjZr4En3Ofy6RAmK8IE/g== 2026-02-17T04:30:55.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD/7pNpRZM+JRAAsZjZr4En3Ofy6RAmK8IE/g=="}' 2026-02-17T04:30:55.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f8a49599-c18a-4e2f-b002-54e151762f4d -i td/osd-scrub-repair/8/new.json 2026-02-17T04:30:55.788 INFO:tasks.workunit.client.0.trial090.stdout:8 2026-02-17T04:30:55.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/8/new.json 2026-02-17T04:30:55.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD/7pNpRZM+JRAAsZjZr4En3Ofy6RAmK8IE/g== --osd-uuid f8a49599-c18a-4e2f-b002-54e151762f4d 2026-02-17T04:30:55.815 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:55.814+0000 7fc589836780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:55.816 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:55.815+0000 7fc589836780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:55.817 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:55.816+0000 7fc589836780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:55.817 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:55.817+0000 7fc589836780 -1 bdev(0x40ecc00 td/osd-scrub-repair/8/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:55.818 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:55.817+0000 7fc589836780 -1 bluestore(td/osd-scrub-repair/8) _read_fsid unparsable uuid 2026-02-17T04:30:56.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/8/keyring 2026-02-17T04:30:56.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:56.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-17T04:30:56.152 INFO:tasks.workunit.client.0.trial090.stdout:adding osd8 key to auth repository 2026-02-17T04:30:56.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-17T04:30:56.367 INFO:tasks.workunit.client.0.trial090.stdout:start osd.8 2026-02-17T04:30:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:56.382 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:56.381+0000 7ff46d81b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:56.383 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:56.382+0000 7ff46d81b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:56.384 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:56.383+0000 7ff46d81b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:56.505 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:56.504+0000 7ff46d81b780 -1 Falling back to public interface 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-17T04:30:56.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:56.818 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:56.817+0000 7ff46d81b780 -1 osd.8 0 log_to_monitors true 2026-02-17T04:30:57.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:57.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:57.704 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-17T04:30:57.869 INFO:tasks.workunit.client.0.trial090.stdout:osd.8 up in weight 1 up_from 41 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/2518656868,v1:127.0.0.1:6867/2518656868] [v2:127.0.0.1:6868/2518656868,v1:127.0.0.1:6869/2518656868] exists,up f8a49599-c18a-4e2f-b002-54e151762f4d 2026-02-17T04:30:57.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:30:57.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:30:57.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 9 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:30:57.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:30:57.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:30:57.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 bf165c8b-466d-40d4-adf6-0022df558ffc' 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stdout:add osd9 bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:30:57.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:30:57.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAB75Np26WgNBAAt9Gri7slDZ/QVf75sxJoUw== 2026-02-17T04:30:57.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAB75Np26WgNBAAt9Gri7slDZ/QVf75sxJoUw=="}' 2026-02-17T04:30:57.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bf165c8b-466d-40d4-adf6-0022df558ffc -i td/osd-scrub-repair/9/new.json 2026-02-17T04:30:58.051 INFO:tasks.workunit.client.0.trial090.stdout:9 2026-02-17T04:30:58.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/9/new.json 2026-02-17T04:30:58.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAB75Np26WgNBAAt9Gri7slDZ/QVf75sxJoUw== --osd-uuid bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:30:58.077 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.076+0000 7fa01ea2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.078 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.078+0000 7fa01ea2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.079 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.078+0000 7fa01ea2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.079+0000 7fa01ea2f780 -1 bdev(0x36b2c00 td/osd-scrub-repair/9/block) open stat got: (1) Operation not permitted 2026-02-17T04:30:58.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.079+0000 7fa01ea2f780 -1 bluestore(td/osd-scrub-repair/9) _read_fsid unparsable uuid 2026-02-17T04:30:58.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/9/keyring 2026-02-17T04:30:58.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:30:58.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-17T04:30:58.428 INFO:tasks.workunit.client.0.trial090.stdout:adding osd9 key to auth repository 2026-02-17T04:30:58.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:30:58.639 INFO:tasks.workunit.client.0.trial090.stdout:start osd.9 2026-02-17T04:30:58.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-17T04:30:58.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:30:58.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:30:58.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:30:58.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:30:58.654 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.653+0000 7f520c61f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.656 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.655+0000 7f520c61f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.656 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.656+0000 7f520c61f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:30:58.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:30:58.808 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:30:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:30:58.822 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:58.821+0000 7f520c61f780 -1 Falling back to public interface 2026-02-17T04:30:58.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:30:59.166 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:30:59.165+0000 7f520c61f780 -1 osd.9 0 log_to_monitors true 2026-02-17T04:30:59.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:30:59.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:30:59.973 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:30:59.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:30:59.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:30:59.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:00.139 INFO:tasks.workunit.client.0.trial090.stdout:osd.9 up in weight 1 up_from 46 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/1396793691,v1:127.0.0.1:6875/1396793691] [v2:127.0.0.1:6876/1396793691,v1:127.0.0.1:6877/1396793691] exists,up bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:31:00.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:00.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:00.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:00.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:893: corrupt_and_repair_lrc: create_rbd_pool 2026-02-17T04:31:00.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:31:00.300 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:31:00.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:31:00.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:31:00.486 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:31:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:31:01.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:31:01.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:894: corrupt_and_repair_lrc: wait_for_clean 2026-02-17T04:31:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:01.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:01.776 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:01.776 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:01.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:01.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:01.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:01.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:02.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-17T04:31:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-17T04:31:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T04:31:02.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:02.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:31:02.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:31:02.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669' 2026-02-17T04:31:02.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-17T04:31:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-17T04:31:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149' 2026-02-17T04:31:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:02.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378630 2026-02-17T04:31:02.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378630 2026-02-17T04:31:02.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630' 2026-02-17T04:31:02.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247812 2026-02-17T04:31:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247812 2026-02-17T04:31:02.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812' 2026-02-17T04:31:02.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:02.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116996 2026-02-17T04:31:02.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116996 2026-02-17T04:31:02.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812 5-115964116996' 2026-02-17T04:31:02.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953476 2026-02-17T04:31:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953476 2026-02-17T04:31:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812 5-115964116996 6-137438953476' 2026-02-17T04:31:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:02.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T04:31:02.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T04:31:02.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812 5-115964116996 6-137438953476 7-158913789955' 2026-02-17T04:31:02.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659138 2026-02-17T04:31:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659138 2026-02-17T04:31:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812 5-115964116996 6-137438953476 7-158913789955 8-176093659138' 2026-02-17T04:31:02.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:02.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495618 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495618 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705669 2-60129542149 3-81604378630 4-98784247812 5-115964116996 6-137438953476 7-158913789955 8-176093659138 9-197568495618' 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-17T04:31:02.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:02.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:02.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-17T04:31:02.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:02.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-17T04:31:02.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T04:31:02.636 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836486 2026-02-17T04:31:02.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-17T04:31:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:02.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:31:02.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:02.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:02.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:31:02.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:02.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:31:02.805 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:31:02.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:31:02.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:02.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:31:02.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:03.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:03.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:04.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705669 2026-02-17T04:31:04.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:05.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:31:05.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:05.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705669 2026-02-17T04:31:05.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:05.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-17T04:31:05.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:05.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:05.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-17T04:31:05.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:05.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-17T04:31:05.307 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542149 2026-02-17T04:31:05.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-17T04:31:05.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:05.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542149 2026-02-17T04:31:05.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:05.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378630 2026-02-17T04:31:05.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:05.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:05.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378630 2026-02-17T04:31:05.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:05.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378630 2026-02-17T04:31:05.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378630' 2026-02-17T04:31:05.476 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 81604378630 2026-02-17T04:31:05.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:05.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378630 -lt 81604378630 2026-02-17T04:31:05.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:05.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247812 2026-02-17T04:31:05.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:05.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:05.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247812 2026-02-17T04:31:05.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:05.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247812 2026-02-17T04:31:05.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247812' 2026-02-17T04:31:05.645 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.4 seq 98784247812 2026-02-17T04:31:05.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247813 -lt 98784247812 2026-02-17T04:31:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:05.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116996 2026-02-17T04:31:05.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:05.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:05.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116996 2026-02-17T04:31:05.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:05.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116996 2026-02-17T04:31:05.812 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.5 seq 115964116996 2026-02-17T04:31:05.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116996' 2026-02-17T04:31:05.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:05.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116996 -lt 115964116996 2026-02-17T04:31:05.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:05.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953476 2026-02-17T04:31:05.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:05.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:05.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953476 2026-02-17T04:31:05.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:05.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953476 2026-02-17T04:31:05.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953476' 2026-02-17T04:31:05.980 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.6 seq 137438953476 2026-02-17T04:31:05.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:06.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953476 2026-02-17T04:31:06.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:06.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789955 2026-02-17T04:31:06.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:06.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789955 2026-02-17T04:31:06.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:06.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T04:31:06.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789955' 2026-02-17T04:31:06.153 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.7 seq 158913789955 2026-02-17T04:31:06.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:06.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789955 2026-02-17T04:31:06.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:06.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659138 2026-02-17T04:31:06.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:06.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:06.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659138 2026-02-17T04:31:06.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:06.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659138 2026-02-17T04:31:06.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659138' 2026-02-17T04:31:06.320 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.8 seq 176093659138 2026-02-17T04:31:06.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:06.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659139 -lt 176093659138 2026-02-17T04:31:06.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:06.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495618 2026-02-17T04:31:06.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:06.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:06.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495618 2026-02-17T04:31:06.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:06.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495618 2026-02-17T04:31:06.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495618' 2026-02-17T04:31:06.489 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.9 seq 197568495618 2026-02-17T04:31:06.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:06.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495619 -lt 197568495618 2026-02-17T04:31:06.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:06.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:06.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:06.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:06.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:07.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:31:07.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:07.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:07.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:896: corrupt_and_repair_lrc: create_ec_pool ecpool true k=4 m=2 l=3 plugin=lrc 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:31:07.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=4 m=2 l=3 plugin=lrc 2026-02-17T04:31:07.459 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:31:07.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:31:07.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:31:07.765 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:31:07.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:31:08.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:31:08.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:31:08.987 INFO:tasks.workunit.client.0.trial090.stderr:set pool 2 allow_ec_overwrites to true 2026-02-17T04:31:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:31:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:08.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:08.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:08.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:08.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:08.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:08.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:08.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:09.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:09.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:09.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:09.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:09.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:09.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:09.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T04:31:09.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T04:31:09.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T04:31:09.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-17T04:31:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-17T04:31:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-17T04:31:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:09.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T04:31:09.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T04:31:09.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151' 2026-02-17T04:31:09.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:09.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378632 2026-02-17T04:31:09.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378632 2026-02-17T04:31:09.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632' 2026-02-17T04:31:09.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247815 2026-02-17T04:31:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247815 2026-02-17T04:31:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815' 2026-02-17T04:31:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:09.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116998 2026-02-17T04:31:09.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116998 2026-02-17T04:31:09.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815 5-115964116998' 2026-02-17T04:31:09.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:09.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953479 2026-02-17T04:31:09.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953479 2026-02-17T04:31:09.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815 5-115964116998 6-137438953479' 2026-02-17T04:31:09.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:09.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789957 2026-02-17T04:31:09.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789957 2026-02-17T04:31:09.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815 5-115964116998 6-137438953479 7-158913789957' 2026-02-17T04:31:09.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:09.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659141 2026-02-17T04:31:09.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659141 2026-02-17T04:31:09.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815 5-115964116998 6-137438953479 7-158913789957 8-176093659141' 2026-02-17T04:31:09.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:09.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:09.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495620 2026-02-17T04:31:09.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495620 2026-02-17T04:31:09.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-81604378632 4-98784247815 5-115964116998 6-137438953479 7-158913789957 8-176093659141 9-197568495620' 2026-02-17T04:31:09.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:09.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T04:31:09.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:09.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:09.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T04:31:09.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T04:31:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T04:31:09.854 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836488 2026-02-17T04:31:09.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:10.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-17T04:31:10.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:11.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:11.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:11.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T04:31:11.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:11.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-17T04:31:11.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:11.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:11.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-17T04:31:11.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:11.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-17T04:31:11.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T04:31:11.193 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705672 2026-02-17T04:31:11.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:11.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T04:31:11.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:11.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T04:31:11.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:11.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:11.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T04:31:11.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:11.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T04:31:11.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T04:31:11.363 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542151 2026-02-17T04:31:11.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-17T04:31:11.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:11.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378632 2026-02-17T04:31:11.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:11.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:11.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378632 2026-02-17T04:31:11.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378632 2026-02-17T04:31:11.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378632' 2026-02-17T04:31:11.535 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 81604378632 2026-02-17T04:31:11.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:11.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378632 -lt 81604378632 2026-02-17T04:31:11.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:11.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247815 2026-02-17T04:31:11.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:11.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:11.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247815 2026-02-17T04:31:11.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:11.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247815 2026-02-17T04:31:11.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247815' 2026-02-17T04:31:11.704 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.4 seq 98784247815 2026-02-17T04:31:11.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:11.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247815 -lt 98784247815 2026-02-17T04:31:11.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:11.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116998 2026-02-17T04:31:11.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:11.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:11.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116998 2026-02-17T04:31:11.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116998 2026-02-17T04:31:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116998' 2026-02-17T04:31:11.876 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.5 seq 115964116998 2026-02-17T04:31:11.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:12.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116998 -lt 115964116998 2026-02-17T04:31:12.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:12.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953479 2026-02-17T04:31:12.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:12.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:12.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953479 2026-02-17T04:31:12.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953479 2026-02-17T04:31:12.047 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.6 seq 137438953479 2026-02-17T04:31:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953479' 2026-02-17T04:31:12.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:12.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953479 -lt 137438953479 2026-02-17T04:31:12.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:12.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789957 2026-02-17T04:31:12.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:12.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:12.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789957 2026-02-17T04:31:12.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:12.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789957 2026-02-17T04:31:12.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789957' 2026-02-17T04:31:12.218 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.7 seq 158913789957 2026-02-17T04:31:12.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:12.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789958 -lt 158913789957 2026-02-17T04:31:12.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:12.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659141 2026-02-17T04:31:12.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:12.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:12.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659141 2026-02-17T04:31:12.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:12.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659141 2026-02-17T04:31:12.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659141' 2026-02-17T04:31:12.390 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.8 seq 176093659141 2026-02-17T04:31:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:12.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659141 -lt 176093659141 2026-02-17T04:31:12.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:12.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495620 2026-02-17T04:31:12.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:12.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:12.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495620 2026-02-17T04:31:12.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:12.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495620 2026-02-17T04:31:12.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495620' 2026-02-17T04:31:12.562 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.9 seq 197568495620 2026-02-17T04:31:12.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:12.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495621 -lt 197568495620 2026-02-17T04:31:12.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:12.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:12.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:12.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:12.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:13.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:13.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:13.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:13.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:13.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:13.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:897: corrupt_and_repair_lrc: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:31:13.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:31:13.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:31:13.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:31:13.525 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:31:13.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:31:13.729 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:31:13.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:31:13.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:31:13.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:31:13.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:31:13.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:31:13.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:31:13.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:31:13.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:31:13.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-17T04:31:13.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:31:13.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:31:13.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-17T04:31:13.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:31:13.927 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:31:13.927 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:9 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:7' 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 6 2 1 7 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('5' '9' '0' '6' '2' '1' '7') 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-17T04:31:14.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=5 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=9 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:31:14.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:31:14.506 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:14.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:14.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:start osd.3 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:31:14.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:31:14.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:31:14.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:14.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:14.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:14.557 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:14.555+0000 7feaa49d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:14.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:14.556+0000 7feaa49d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:14.559 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:14.557+0000 7feaa49d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:14.707 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:14.705+0000 7feaa49d6780 -1 Falling back to public interface 2026-02-17T04:31:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:31:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:31:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:14.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:14.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:14.709 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:31:14.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:14.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:31:14.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:15.042 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:15.040+0000 7feaa49d6780 -1 osd.3 63 log_to_monitors true 2026-02-17T04:31:15.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:15.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:15.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:15.874 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:15.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:15.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:31:16.039 INFO:tasks.workunit.client.0.trial090.stderr:osd.3 up in weight 1 up_from 67 up_thru 67 down_at 64 last_clean_interval [19,63) [v2:127.0.0.1:6826/3882438488,v1:127.0.0.1:6827/3882438488] [v2:127.0.0.1:6828/3882438488,v1:127.0.0.1:6829/3882438488] exists,up afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:31:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:16.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:16.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:16.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:16.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:16.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:16.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:16.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:31:16.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:31:16.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:31:16.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:16.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T04:31:16.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T04:31:16.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T04:31:16.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:16.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-17T04:31:16.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-17T04:31:16.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154' 2026-02-17T04:31:16.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:16.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808834 2026-02-17T04:31:16.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808834 2026-02-17T04:31:16.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834' 2026-02-17T04:31:16.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247817 2026-02-17T04:31:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247817 2026-02-17T04:31:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817' 2026-02-17T04:31:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:16.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117001 2026-02-17T04:31:16.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117001 2026-02-17T04:31:16.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817 5-115964117001' 2026-02-17T04:31:16.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:16.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953481 2026-02-17T04:31:16.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953481 2026-02-17T04:31:16.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817 5-115964117001 6-137438953481' 2026-02-17T04:31:16.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:16.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789960 2026-02-17T04:31:16.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789960 2026-02-17T04:31:16.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817 5-115964117001 6-137438953481 7-158913789960' 2026-02-17T04:31:16.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:16.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659143 2026-02-17T04:31:16.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659143 2026-02-17T04:31:16.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817 5-115964117001 6-137438953481 7-158913789960 8-176093659143' 2026-02-17T04:31:16.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:16.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:16.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495623 2026-02-17T04:31:16.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495623 2026-02-17T04:31:16.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-287762808834 4-98784247817 5-115964117001 6-137438953481 7-158913789960 8-176093659143 9-197568495623' 2026-02-17T04:31:16.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:16.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:31:16.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:16.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:16.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:31:16.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:16.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:31:16.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:31:16.894 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836491 2026-02-17T04:31:16.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:17.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-17T04:31:17.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:18.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:18.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:31:18.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:18.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T04:31:18.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:18.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:18.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T04:31:18.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:18.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T04:31:18.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T04:31:18.233 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705674 2026-02-17T04:31:18.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:18.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705674 2026-02-17T04:31:18.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:18.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-17T04:31:18.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:18.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:18.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-17T04:31:18.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:18.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-17T04:31:18.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-17T04:31:18.401 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542154 2026-02-17T04:31:18.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:18.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-17T04:31:18.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:18.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808834 2026-02-17T04:31:18.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:18.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:18.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808834 2026-02-17T04:31:18.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808834 2026-02-17T04:31:18.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808834' 2026-02-17T04:31:18.572 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 287762808834 2026-02-17T04:31:18.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:18.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808834 -lt 287762808834 2026-02-17T04:31:18.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:18.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247817 2026-02-17T04:31:18.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:18.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:18.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247817 2026-02-17T04:31:18.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:18.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247817 2026-02-17T04:31:18.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247817' 2026-02-17T04:31:18.748 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247817 2026-02-17T04:31:18.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:18.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247817 -lt 98784247817 2026-02-17T04:31:18.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:18.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117001 2026-02-17T04:31:18.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:18.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:18.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117001 2026-02-17T04:31:18.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117001 2026-02-17T04:31:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117001' 2026-02-17T04:31:18.919 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 115964117001 2026-02-17T04:31:18.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:19.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117001 -lt 115964117001 2026-02-17T04:31:19.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:19.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953481 2026-02-17T04:31:19.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:19.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:19.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953481 2026-02-17T04:31:19.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:19.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953481 2026-02-17T04:31:19.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953481' 2026-02-17T04:31:19.088 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953481 2026-02-17T04:31:19.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:19.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953481 -lt 137438953481 2026-02-17T04:31:19.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:19.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789960 2026-02-17T04:31:19.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:19.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:19.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789960 2026-02-17T04:31:19.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:19.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789960 2026-02-17T04:31:19.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789960' 2026-02-17T04:31:19.256 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789960 2026-02-17T04:31:19.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789960 -lt 158913789960 2026-02-17T04:31:19.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:19.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659143 2026-02-17T04:31:19.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:19.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:19.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659143 2026-02-17T04:31:19.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:19.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659143 2026-02-17T04:31:19.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659143' 2026-02-17T04:31:19.425 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 176093659143 2026-02-17T04:31:19.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:19.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659144 -lt 176093659143 2026-02-17T04:31:19.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:19.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-197568495623 2026-02-17T04:31:19.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:19.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:19.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-197568495623 2026-02-17T04:31:19.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:19.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495623 2026-02-17T04:31:19.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 197568495623' 2026-02-17T04:31:19.596 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 197568495623 2026-02-17T04:31:19.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:19.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495623 -lt 197568495623 2026-02-17T04:31:19.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:19.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:19.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:19.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:20.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:20.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:20.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:20.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:31:20.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:31:20.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:31:20.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:20.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:20.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:20.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:20.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:31:20.840 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:31:20.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:20.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:31:20.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:21.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:07.762592+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:21.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:22.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:22.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:07.762592+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:22.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:23.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:23.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:23.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:23.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:23.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:23.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:23.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:23.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:07.762592+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:23.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:24.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:07.762592+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:25.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:25.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:25.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:25.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:25.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:25.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:25.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:25.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:07.762592+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:25.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:26.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:26.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:26.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:26.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:26.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:26.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:26.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:07.762592+0000 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:26.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:26.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:26.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:26.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:26.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:27.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:27.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:27.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:31:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:31:27.210 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:31:27.210 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:31:27.210 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:31:27.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:27.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:27.261 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:start osd.9 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:31:27.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:31:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:31:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:27.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:27.274+0000 7fa013c0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:27.277 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:27.276+0000 7fa013c0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:27.278 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:27.276+0000 7fa013c0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:27.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:31:27.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:27.427 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:31:27.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:27.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:27.439 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:27.437+0000 7fa013c0f780 -1 Falling back to public interface 2026-02-17T04:31:27.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:27.770 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:27.768+0000 7fa013c0f780 -1 osd.9 70 log_to_monitors true 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:osd.9 up in weight 1 up_from 73 up_thru 0 down_at 70 last_clean_interval [46,70) [v2:127.0.0.1:6874/3141927970,v1:127.0.0.1:6875/3141927970] [v2:127.0.0.1:6876/3141927970,v1:127.0.0.1:6877/3141927970] exists,up bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:28.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:28.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:28.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:28.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:28.759 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:28.759 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:28.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:28.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:28.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:28.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:29.010 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:29.011 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:29.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:29.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:29.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-17T04:31:29.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-17T04:31:29.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T04:31:29.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:29.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705678 2026-02-17T04:31:29.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705678 2026-02-17T04:31:29.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678' 2026-02-17T04:31:29.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-17T04:31:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-17T04:31:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157' 2026-02-17T04:31:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:29.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808837 2026-02-17T04:31:29.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808837 2026-02-17T04:31:29.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837' 2026-02-17T04:31:29.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:29.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247821 2026-02-17T04:31:29.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247821 2026-02-17T04:31:29.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821' 2026-02-17T04:31:29.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117004 2026-02-17T04:31:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117004 2026-02-17T04:31:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821 5-115964117004' 2026-02-17T04:31:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:29.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953485 2026-02-17T04:31:29.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953485 2026-02-17T04:31:29.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821 5-115964117004 6-137438953485' 2026-02-17T04:31:29.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:29.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-17T04:31:29.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-17T04:31:29.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821 5-115964117004 6-137438953485 7-158913789963' 2026-02-17T04:31:29.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:29.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659147 2026-02-17T04:31:29.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659147 2026-02-17T04:31:29.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821 5-115964117004 6-137438953485 7-158913789963 8-176093659147' 2026-02-17T04:31:29.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:29.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612610 2026-02-17T04:31:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612610 2026-02-17T04:31:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-287762808837 4-98784247821 5-115964117004 6-137438953485 7-158913789963 8-176093659147 9-313532612610' 2026-02-17T04:31:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:29.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-17T04:31:29.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:29.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:29.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-17T04:31:29.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:29.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-17T04:31:29.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T04:31:29.610 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836494 2026-02-17T04:31:29.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:29.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-17T04:31:29.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:30.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:30.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:30.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T04:31:30.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:30.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705678 2026-02-17T04:31:30.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:30.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:30.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705678 2026-02-17T04:31:30.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:30.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705678 2026-02-17T04:31:30.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705678' 2026-02-17T04:31:30.946 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705678 2026-02-17T04:31:30.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:31.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705678 2026-02-17T04:31:31.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-17T04:31:31.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:31.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-17T04:31:31.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-17T04:31:31.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-17T04:31:31.118 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542157 2026-02-17T04:31:31.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:31.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542157 2026-02-17T04:31:31.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808837 2026-02-17T04:31:31.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:31.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808837 2026-02-17T04:31:31.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808837 2026-02-17T04:31:31.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808837' 2026-02-17T04:31:31.284 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 287762808837 2026-02-17T04:31:31.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:31.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808838 -lt 287762808837 2026-02-17T04:31:31.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247821 2026-02-17T04:31:31.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:31.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247821 2026-02-17T04:31:31.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247821 2026-02-17T04:31:31.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247821' 2026-02-17T04:31:31.461 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247821 2026-02-17T04:31:31.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:31.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247821 -lt 98784247821 2026-02-17T04:31:31.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117004 2026-02-17T04:31:31.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:31.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117004 2026-02-17T04:31:31.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117004 2026-02-17T04:31:31.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117004' 2026-02-17T04:31:31.634 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 115964117004 2026-02-17T04:31:31.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:31.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117004 -lt 115964117004 2026-02-17T04:31:31.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953485 2026-02-17T04:31:31.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:31.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953485 2026-02-17T04:31:31.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953485 2026-02-17T04:31:31.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953485' 2026-02-17T04:31:31.807 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953485 2026-02-17T04:31:31.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:31.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953485 -lt 137438953485 2026-02-17T04:31:31.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:31.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789963 2026-02-17T04:31:31.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:31.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:31.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789963 2026-02-17T04:31:31.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:31.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-17T04:31:31.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789963' 2026-02-17T04:31:31.977 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789963 2026-02-17T04:31:31.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:32.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789964 -lt 158913789963 2026-02-17T04:31:32.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:32.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659147 2026-02-17T04:31:32.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:32.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659147 2026-02-17T04:31:32.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:32.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659147 2026-02-17T04:31:32.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659147' 2026-02-17T04:31:32.148 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 176093659147 2026-02-17T04:31:32.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:32.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659147 -lt 176093659147 2026-02-17T04:31:32.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:32.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-313532612610 2026-02-17T04:31:32.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:32.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:32.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-313532612610 2026-02-17T04:31:32.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:32.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612610 2026-02-17T04:31:32.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 313532612610' 2026-02-17T04:31:32.319 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 313532612610 2026-02-17T04:31:32.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:32.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612610 -lt 313532612610 2026-02-17T04:31:32.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:32.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:32.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:32.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:32.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:32.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:32.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:32.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:32.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:33.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:33.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:33.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:33.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:31:33.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:31:33.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 5 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=5 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:33.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:33.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:31:33.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:31:33.330 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:33.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:33.371 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:33.371 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:33.371 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:33.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:start osd.5 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:31:33.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:31:33.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:31:33.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:33.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:33.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:33.387 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:33.385+0000 7f0ffae14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:33.388 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:33.386+0000 7f0ffae14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:33.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:33.387+0000 7f0ffae14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:33.539 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:33.538+0000 7f0ffae14780 -1 Falling back to public interface 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:33.543 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:31:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:31:33.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:33.894 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:33.892+0000 7f0ffae14780 -1 osd.5 74 log_to_monitors true 2026-02-17T04:31:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:34.709 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:34.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:31:34.874 INFO:tasks.workunit.client.0.trial090.stderr:osd.5 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [27,74) [v2:127.0.0.1:6842/970528970,v1:127.0.0.1:6843/970528970] [v2:127.0.0.1:6844/970528970,v1:127.0.0.1:6845/970528970] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:34.875 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:34.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:34.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:34.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:34.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:34.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:34.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:35.129 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:35.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-17T04:31:35.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-17T04:31:35.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T04:31:35.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:35.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-17T04:31:35.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-17T04:31:35.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680' 2026-02-17T04:31:35.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:35.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542160 2026-02-17T04:31:35.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542160 2026-02-17T04:31:35.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160' 2026-02-17T04:31:35.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:35.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808840 2026-02-17T04:31:35.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808840 2026-02-17T04:31:35.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840' 2026-02-17T04:31:35.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:35.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247823 2026-02-17T04:31:35.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247823 2026-02-17T04:31:35.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823' 2026-02-17T04:31:35.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:35.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-17T04:31:35.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-17T04:31:35.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823 5-335007449090' 2026-02-17T04:31:35.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:35.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953487 2026-02-17T04:31:35.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953487 2026-02-17T04:31:35.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823 5-335007449090 6-137438953487' 2026-02-17T04:31:35.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:35.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789965 2026-02-17T04:31:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789965 2026-02-17T04:31:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823 5-335007449090 6-137438953487 7-158913789965' 2026-02-17T04:31:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:35.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659149 2026-02-17T04:31:35.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659149 2026-02-17T04:31:35.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823 5-335007449090 6-137438953487 7-158913789965 8-176093659149' 2026-02-17T04:31:35.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:35.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:35.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612612 2026-02-17T04:31:35.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612612 2026-02-17T04:31:35.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496 1-38654705680 2-60129542160 3-287762808840 4-98784247823 5-335007449090 6-137438953487 7-158913789965 8-176093659149 9-313532612612' 2026-02-17T04:31:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:35.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-17T04:31:35.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:35.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-17T04:31:35.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-17T04:31:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T04:31:35.729 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836496 2026-02-17T04:31:35.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:35.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836496 2026-02-17T04:31:35.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:36.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:36.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:37.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836496 2026-02-17T04:31:37.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705680 2026-02-17T04:31:37.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:37.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-17T04:31:37.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705680 2026-02-17T04:31:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-17T04:31:37.068 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705680 2026-02-17T04:31:37.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:37.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-17T04:31:37.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542160 2026-02-17T04:31:37.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:37.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542160 2026-02-17T04:31:37.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542160 2026-02-17T04:31:37.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542160' 2026-02-17T04:31:37.237 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542160 2026-02-17T04:31:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:37.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542160 -lt 60129542160 2026-02-17T04:31:37.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808840 2026-02-17T04:31:37.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:37.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808840 2026-02-17T04:31:37.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808840 2026-02-17T04:31:37.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808840' 2026-02-17T04:31:37.405 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 287762808840 2026-02-17T04:31:37.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:37.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808840 -lt 287762808840 2026-02-17T04:31:37.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247823 2026-02-17T04:31:37.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:37.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247823 2026-02-17T04:31:37.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247823 2026-02-17T04:31:37.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247823' 2026-02-17T04:31:37.573 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247823 2026-02-17T04:31:37.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247823 -lt 98784247823 2026-02-17T04:31:37.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-335007449090 2026-02-17T04:31:37.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:37.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-335007449090 2026-02-17T04:31:37.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-17T04:31:37.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 335007449090' 2026-02-17T04:31:37.744 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 335007449090 2026-02-17T04:31:37.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:37.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449090 -lt 335007449090 2026-02-17T04:31:37.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:37.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953487 2026-02-17T04:31:37.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:37.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:37.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953487 2026-02-17T04:31:37.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:37.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953487 2026-02-17T04:31:37.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953487' 2026-02-17T04:31:37.920 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953487 2026-02-17T04:31:37.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:38.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953487 -lt 137438953487 2026-02-17T04:31:38.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:38.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789965 2026-02-17T04:31:38.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:38.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:38.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789965 2026-02-17T04:31:38.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:38.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789965 2026-02-17T04:31:38.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789965' 2026-02-17T04:31:38.090 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789965 2026-02-17T04:31:38.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:38.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789966 -lt 158913789965 2026-02-17T04:31:38.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:38.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659149 2026-02-17T04:31:38.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:38.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:38.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659149 2026-02-17T04:31:38.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659149 2026-02-17T04:31:38.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659149' 2026-02-17T04:31:38.257 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 176093659149 2026-02-17T04:31:38.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:38.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659150 -lt 176093659149 2026-02-17T04:31:38.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:38.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-313532612612 2026-02-17T04:31:38.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:38.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:38.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-313532612612 2026-02-17T04:31:38.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:38.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612612 2026-02-17T04:31:38.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 313532612612' 2026-02-17T04:31:38.426 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 313532612612 2026-02-17T04:31:38.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:38.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612613 -lt 313532612612 2026-02-17T04:31:38.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:38.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:38.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:38.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:38.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:38.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:38.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:38.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:38.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:39.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:39.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:39.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:39.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-17T04:31:39.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:31:39.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:31:39.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:31:39.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:39.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:39.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:39.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:39.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:39.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:31:39.678 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:31:39.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:39.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:39.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:39.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:39.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:39.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:40.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:40.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:40.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:40.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:40.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:40.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:40.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:42.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:42.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:42.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:42.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:42.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:42.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:42.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:42.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:43.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:43.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:43.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:43.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:43.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:43.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:43.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:43.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:43.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:44.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:44.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:44.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:44.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:44.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:44.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:44.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:45.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:45.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:45.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:21.002692+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:45.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:31:46.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:31:46.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:46.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:46.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:46.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:46.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:46.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:21.002692+0000 2026-02-17T04:31:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:31:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:46.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:31:47.003 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:31:47.003 INFO:tasks.workunit.client.0.trial090.stdout:hinfo_key 2026-02-17T04:31:47.003 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:31:47.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:47.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:47.051 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:31:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:31:47.053 INFO:tasks.workunit.client.0.trial090.stderr:start osd.9 2026-02-17T04:31:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:31:47.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:31:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:31:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:47.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:47.061+0000 7f68c2e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:47.064 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:47.062+0000 7f68c2e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:47.065 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:47.063+0000 7f68c2e09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:47.216 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:31:47.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:47.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:47.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:47.230+0000 7f68c2e09780 -1 Falling back to public interface 2026-02-17T04:31:47.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:47.581 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:31:47.578+0000 7f68c2e09780 -1 osd.9 79 log_to_monitors true 2026-02-17T04:31:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:48.381 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:48.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:48.547 INFO:tasks.workunit.client.0.trial090.stderr:osd.9 up in weight 1 up_from 83 up_thru 0 down_at 80 last_clean_interval [73,79) [v2:127.0.0.1:6874/2748601741,v1:127.0.0.1:6875/2748601741] [v2:127.0.0.1:6876/2748601741,v1:127.0.0.1:6877/2748601741] exists,up bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:31:48.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:48.548 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:31:48.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:48.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:48.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:48.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:48.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:48.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:48.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:48.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:48.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:48.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:48.801 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:31:48.801 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:31:48.801 INFO:tasks.workunit.client.0.trial090.stderr:3 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:4 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:5 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:6 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:7 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:8 2026-02-17T04:31:48.802 INFO:tasks.workunit.client.0.trial090.stderr:9' 2026-02-17T04:31:48.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:48.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:48.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:48.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-17T04:31:48.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-17T04:31:48.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-17T04:31:48.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:48.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:48.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705684 2026-02-17T04:31:48.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705684 2026-02-17T04:31:48.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684' 2026-02-17T04:31:48.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:48.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:48.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542163 2026-02-17T04:31:48.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542163 2026-02-17T04:31:48.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163' 2026-02-17T04:31:48.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:48.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:49.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808843 2026-02-17T04:31:49.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808843 2026-02-17T04:31:49.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843' 2026-02-17T04:31:49.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:49.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247827 2026-02-17T04:31:49.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247827 2026-02-17T04:31:49.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827' 2026-02-17T04:31:49.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449094 2026-02-17T04:31:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449094 2026-02-17T04:31:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827 5-335007449094' 2026-02-17T04:31:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:49.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953491 2026-02-17T04:31:49.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953491 2026-02-17T04:31:49.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827 5-335007449094 6-137438953491' 2026-02-17T04:31:49.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:49.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789969 2026-02-17T04:31:49.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789969 2026-02-17T04:31:49.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827 5-335007449094 6-137438953491 7-158913789969' 2026-02-17T04:31:49.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:49.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659153 2026-02-17T04:31:49.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659153 2026-02-17T04:31:49.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827 5-335007449094 6-137438953491 7-158913789969 8-176093659153' 2026-02-17T04:31:49.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:49.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:49.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285570 2026-02-17T04:31:49.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285570 2026-02-17T04:31:49.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-287762808843 4-98784247827 5-335007449094 6-137438953491 7-158913789969 8-176093659153 9-356482285570' 2026-02-17T04:31:49.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:49.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-17T04:31:49.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:49.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:49.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-17T04:31:49.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:49.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-17T04:31:49.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-17T04:31:49.393 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836500 2026-02-17T04:31:49.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:49.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836500 2026-02-17T04:31:49.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:50.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:50.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:50.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-17T04:31:50.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:50.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705684 2026-02-17T04:31:50.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:50.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:50.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705684 2026-02-17T04:31:50.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:50.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705684 2026-02-17T04:31:50.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705684' 2026-02-17T04:31:50.732 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705684 2026-02-17T04:31:50.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:50.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705684 -lt 38654705684 2026-02-17T04:31:50.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:50.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542163 2026-02-17T04:31:50.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:50.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:50.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542163 2026-02-17T04:31:50.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542163 2026-02-17T04:31:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542163' 2026-02-17T04:31:50.900 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542163 2026-02-17T04:31:50.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:51.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542164 -lt 60129542163 2026-02-17T04:31:51.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808843 2026-02-17T04:31:51.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:51.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808843 2026-02-17T04:31:51.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808843 2026-02-17T04:31:51.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808843' 2026-02-17T04:31:51.067 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.3 seq 287762808843 2026-02-17T04:31:51.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:51.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808844 -lt 287762808843 2026-02-17T04:31:51.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247827 2026-02-17T04:31:51.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:51.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247827 2026-02-17T04:31:51.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247827 2026-02-17T04:31:51.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247827' 2026-02-17T04:31:51.234 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.4 seq 98784247827 2026-02-17T04:31:51.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:51.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247827 -lt 98784247827 2026-02-17T04:31:51.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-335007449094 2026-02-17T04:31:51.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:51.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-335007449094 2026-02-17T04:31:51.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449094 2026-02-17T04:31:51.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 335007449094' 2026-02-17T04:31:51.407 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.5 seq 335007449094 2026-02-17T04:31:51.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:51.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449094 -lt 335007449094 2026-02-17T04:31:51.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953491 2026-02-17T04:31:51.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:51.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953491 2026-02-17T04:31:51.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953491 2026-02-17T04:31:51.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953491' 2026-02-17T04:31:51.576 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.6 seq 137438953491 2026-02-17T04:31:51.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:51.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953491 -lt 137438953491 2026-02-17T04:31:51.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789969 2026-02-17T04:31:51.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:51.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789969 2026-02-17T04:31:51.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789969 2026-02-17T04:31:51.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789969' 2026-02-17T04:31:51.748 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.7 seq 158913789969 2026-02-17T04:31:51.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789969 -lt 158913789969 2026-02-17T04:31:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:51.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659153 2026-02-17T04:31:51.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:51.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:51.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659153 2026-02-17T04:31:51.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:51.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659153 2026-02-17T04:31:51.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659153' 2026-02-17T04:31:51.923 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.8 seq 176093659153 2026-02-17T04:31:51.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:52.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659153 -lt 176093659153 2026-02-17T04:31:52.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:52.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-356482285570 2026-02-17T04:31:52.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:52.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:52.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-356482285570 2026-02-17T04:31:52.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:52.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=356482285570 2026-02-17T04:31:52.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 356482285570' 2026-02-17T04:31:52.092 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.9 seq 356482285570 2026-02-17T04:31:52.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:52.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 356482285570 -lt 356482285570 2026-02-17T04:31:52.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:52.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:52.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:52.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:52.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:52.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:52.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:52.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:52.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:52.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:31:52.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:31:52.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 5 9 2026-02-17T04:31:52.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=5 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=9 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 613596"' 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 613596' 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:31:52.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 613597"' 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 613597' 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 613596 613597' 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 613596 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/613599: /' 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:31:52.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/613601: /' 2026-02-17T04:31:53.333 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.333 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:53.333 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:31:53.333 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:53.334 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING remove 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING remove 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:31:53.335 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:53.336 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:53.337 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:31:53.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: start osd.9 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.339 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:31:53.340 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:31:53.341 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:31:53.342 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:31:53.343 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:31:53.344 INFO:tasks.workunit.client.0.trial090.stderr:613599: start osd.5 2026-02-17T04:31:54.838 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:31:54.838 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:31:54.838 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:31:54.838 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2026-02-17T04:31:53.348+0000 7f8395629780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2026-02-17T04:31:53.350+0000 7f8395629780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2026-02-17T04:31:53.351+0000 7f8395629780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 0 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2026-02-17T04:31:53.537+0000 7f8395629780 -1 Falling back to public interface 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2026-02-17T04:31:53.877+0000 7f8395629780 -1 osd.9 84 log_to_monitors true 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: 1 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: osd.9 up in weight 1 up_from 88 up_thru 0 down_at 85 last_clean_interval [83,84) [v2:127.0.0.1:6842/3006360470,v1:127.0.0.1:6843/3006360470] [v2:127.0.0.1:6844/3006360470,v1:127.0.0.1:6845/3006360470] exists,up bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:54.839 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:54.840 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:54.840 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:54.840 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:54.840 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:54.840 INFO:tasks.workunit.client.0.trial090.stderr:613601: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:54.853 INFO:tasks.workunit.client.0.trial090.stderr:613601: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-17T04:31:54.853 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:31:54.853 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:31:54.853 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2026-02-17T04:31:53.351+0000 7fdb563fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2026-02-17T04:31:53.352+0000 7fdb563fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2026-02-17T04:31:53.353+0000 7fdb563fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 0 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2026-02-17T04:31:53.561+0000 7fdb563fd780 -1 Falling back to public interface 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2026-02-17T04:31:53.898+0000 7fdb563fd780 -1 osd.5 85 log_to_monitors true 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: 1 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: osd.5 up in weight 1 up_from 88 up_thru 88 down_at 85 last_clean_interval [78,85) [v2:127.0.0.1:6874/3540353149,v1:127.0.0.1:6875/3540353149] [v2:127.0.0.1:6876/3540353149,v1:127.0.0.1:6877/3540353149] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:31:54.854 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:31:54.855 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:31:54.855 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:31:54.855 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:31:54.855 INFO:tasks.workunit.client.0.trial090.stderr:613599: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613599: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: get_timeout_delays: echo true 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:55.338 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 1 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 2 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 3 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 4 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 5 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 6 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 7 2026-02-17T04:31:55.339 INFO:tasks.workunit.client.0.trial090.stderr:613601: 8 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: 9' 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705686 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705686 2026-02-17T04:31:55.340 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686' 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542166 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542166 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166' 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808846 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808846 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846' 2026-02-17T04:31:55.341 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.354 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest3: get_timeout_delays: echo true 2026-02-17T04:31:55.354 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:31:55.354 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:31:55.354 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:31:55.354 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 1 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 2 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 3 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 4 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 5 2026-02-17T04:31:55.355 INFO:tasks.workunit.client.0.trial090.stderr:613599: 6 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: 7 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: 8 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: 9' 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705687 2026-02-17T04:31:55.356 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705687 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687' 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542167 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542167 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167' 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808847 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808847 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847' 2026-02-17T04:31:55.357 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtes/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247829 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247829 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829' 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.699 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122050 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122050 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829 5-377957122050' 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953493 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953493 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829 5-377957122050 6-137438953493' 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:55.700 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789971 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789971 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829 5-377957122050 6-137438953493 7-158913789971' 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659155 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659155 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829 5-377957122050 6-137438953493 7-158913789971 8-176093659155' 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122050 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122050 2026-02-17T04:31:55.701 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-287762808846 4-98784247829 5-377957122050 6-137438953493 7-158913789971 8-176093659155 9-377957122050' 2026-02-17T04:31:55.715 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ut/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:31:55.715 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247830 2026-02-17T04:31:55.715 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247830 2026-02-17T04:31:55.715 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830' 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122051 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122051 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830 5-377957122051' 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953494 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953494 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830 5-377957122051 6-137438953494' 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.716 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789972 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789972 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830 5-377957122051 6-137438953494 7-158913789972' 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659156 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659156 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830 5-377957122051 6-137438953494 7-158913789972 8-176093659156' 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122051 2026-02-17T04:31:55.717 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122051 2026-02-17T04:31:55.718 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-287762808847 4-98784247830 5-377957122051 6-137438953494 7-158913789972 8-176093659156 9-377957122051' 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/buntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836502 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.394 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.0 seq 21474836502 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836502 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836502 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705686 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705686 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705686 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705686' 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.1 seq 38654705686 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705686 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.395 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542166 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542166 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542166 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542166' 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.2 seq 60129542166 2026-02-17T04:31:57.396 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: testubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-17T04:31:57.408 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.0 seq 21474836503 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836503 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836503 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705687 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705687 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705687 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.1 seq 38654705687 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542167 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542167 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542167 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542167' 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.2 seq 60129542167 2026-02-17T04:31:57.409 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:31:57.924 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: tes 60129542167 -lt 60129542166 2026-02-17T04:31:57.924 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.924 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808846 2026-02-17T04:31:57.924 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.924 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808846 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808846 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808846' 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.3 seq 287762808846 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808847 -lt 287762808846 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247829 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247829 2026-02-17T04:31:57.925 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247829 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247829' 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.4 seq 98784247829 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247830 -lt 98784247829 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-377957122050 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-377957122050 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122050 2026-02-17T04:31:57.926 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 377957122050' 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.5 seq 377957122050 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122051 -lt 377957122050 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953493 2026-02-17T04:31:57.927 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.936 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/t 60129542167 -lt 60129542167 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808847 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808847 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808847 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808847' 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.3 seq 287762808847 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:31:57.937 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808847 -lt 287762808847 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247830 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247830 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247830 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247830' 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.4 seq 98784247830 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247830 -lt 98784247830 2026-02-17T04:31:57.938 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-377957122051 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-377957122051 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122051 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 377957122051' 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.5 seq 377957122051 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122051 -lt 377957122051 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953494 2026-02-17T04:31:57.939 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953493 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953493 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953493' 2026-02-17T04:31:58.445 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.6 seq 137438953493 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953494 -lt 137438953493 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789971 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789971 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789971 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789971' 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.7 seq 158913789971 2026-02-17T04:31:58.446 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789973 -lt 158913789971 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659155 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659155 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659155 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659155' 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.8 seq 176093659155 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659157 -lt 176093659155 2026-02-17T04:31:58.447 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-377957122050 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-377957122050 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.448 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122050 2026-02-17T04:31:58.450 INFO:tasks.workunit.client.0.trial090.stderr:613601/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:31:58.450 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953494 2026-02-17T04:31:58.450 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.450 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953494 2026-02-17T04:31:58.450 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953494' 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.6 seq 137438953494 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953494 -lt 137438953494 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789972 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789972 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.451 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789972 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789972' 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.7 seq 158913789972 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789973 -lt 158913789972 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659156 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659156 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.452 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659156 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659156' 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.8 seq 176093659156 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659157 -lt 176093659156 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-377957122051 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-377957122051 2026-02-17T04:31:58.453 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:31:58.454 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122051 2026-02-17T04:31:59.206 INFO:tasks.workunit.client.0.trial090.stderr:61359: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 377957122050' 2026-02-17T04:31:59.206 INFO:tasks.workunit.client.0.trial090.stderr:613601: waiting osd.9 seq 377957122050 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122051 -lt 377957122050 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:59.207 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:613601: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:59.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:9: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 377957122051' 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:613599: waiting osd.9 seq 377957122051 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122051 -lt 377957122051 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:31:59.217 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:31:59.218 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:31:59.219 INFO:tasks.workunit.client.0.trial090.stderr:613599: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:31:59.219 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:31:59.219 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:31:59.219 INFO:tasks.workunit.client.0.trial090.stderr:613599: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:31:59.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 613597 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:31:59.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:31:59.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:31:59.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:31:59.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:59.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:59.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:31:40.164924+0000 2026-02-17T04:31:59.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:31:59.711 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:31:59.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:31:40.164924+0000 2026-02-17T04:31:59.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:31:59.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:31:40.164924+0000 2026-02-17T04:31:59.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:31:59.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:31:59.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:31:59.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:31:59.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:00.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:00.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:00.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:00.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:00.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:00.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:00.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:01.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:01.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:02.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:02.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:02.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:02.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:02.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:02.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:02.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:02.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:02.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:03.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:03.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:03.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:03.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:03.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:03.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:03.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:03.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:03.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:04.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:04.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:04.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:04.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:04.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:04.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:04.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:04.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:04.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:05.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:05.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:05.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:05.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:05.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:05.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:31:40.164924+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:05.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:06.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:06.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:06.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:06.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:06.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:06.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:06.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:00.208015+0000 '>' 2026-02-17T04:31:40.164924+0000 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 617096"' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 617096' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 617097"' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 617097' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 617096 617097' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 617096 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/617099: /' 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:32:06.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/617101: /' 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:07.106 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: _ 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: hinfo_key 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: snapset 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:07.107 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:07.109 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:07.109 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:07.109 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:32:07.109 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:07.110 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:32:07.111 INFO:tasks.workunit.client.0.trial090.stderr:617099: start osd.5 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:07.115 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:07.116 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: _ 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: hinfo_key 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: snapset 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:07.117 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-17T04:32:07.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:07.119 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-17T04:32:07.120 INFO:tasks.workunit.client.0.trial090.stderr:617101: start osd.9 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:08.619 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2026-02-17T04:32:07.122+0000 7fc0bba2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2026-02-17T04:32:07.124+0000 7fc0bba2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2026-02-17T04:32:07.125+0000 7fc0bba2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: 0 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:08.620 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2026-02-17T04:32:07.347+0000 7fc0bba2d780 -1 Falling back to public interface 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2026-02-17T04:32:07.705+0000 7fc0bba2d780 -1 osd.5 89 log_to_monitors true 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: 1 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: osd.5 up in weight 1 up_from 93 up_thru 93 down_at 90 last_clean_interval [88,89) [v2:127.0.0.1:6842/2788382718,v1:127.0.0.1:6843/2788382718] [v2:127.0.0.1:6844/2788382718,v1:127.0.0.1:6845/2788382718] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:32:08.621 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:08.622 INFO:tasks.workunit.client.0.trial090.stderr:617099: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:08.627 INFO:tasks.workunit.client.0.trial090.stderr:617099: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helprecovery_ops 2026-02-17T04:32:08.627 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2026-02-17T04:32:07.131+0000 7f929dc17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2026-02-17T04:32:07.132+0000 7f929dc17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2026-02-17T04:32:07.133+0000 7f929dc17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:08.628 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: 0 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2026-02-17T04:32:07.365+0000 7f929dc17780 -1 Falling back to public interface 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2026-02-17T04:32:07.731+0000 7f929dc17780 -1 osd.9 89 log_to_monitors true 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:08.629 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: 1 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: osd.9 up in weight 1 up_from 93 up_thru 0 down_at 90 last_clean_interval [88,89) [v2:127.0.0.1:6874/436429177,v1:127.0.0.1:6875/436429177] [v2:127.0.0.1:6876/436429177,v1:127.0.0.1:6877/436429177] exists,up bf165c8b-466d-40d4-adf6-0022df558ffc 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:08.630 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:08.631 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:08.631 INFO:tasks.workunit.client.0.trial090.stderr:617101: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:09.118 INFO:tasks.workunit.client.0.trial090.stderr:617101: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:09.118 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:09.118 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:09.118 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:09.118 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: 1 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: 2 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: 3 2026-02-17T04:32:09.119 INFO:tasks.workunit.client.0.trial090.stderr:617099: 4 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: 5 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: 6 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: 7 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: 8 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: 9' 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-17T04:32:09.120 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691' 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542170 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542170 2026-02-17T04:32:09.121 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170' 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808850 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808850 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850' 2026-02-17T04:32:09.122 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubunh:1593: get_timeout_delays: echo true 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:09.127 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: 1 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: 2 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: 3 2026-02-17T04:32:09.128 INFO:tasks.workunit.client.0.trial090.stderr:617101: 4 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: 5 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: 6 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: 7 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: 8 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: 9' 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:09.129 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836508 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836508 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508' 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705692 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705692 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692' 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:09.130 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542171 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542171 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171' 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808851 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808851 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851' 2026-02-17T04:32:09.131 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.484 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cetu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:09.484 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247834 2026-02-17T04:32:09.484 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247834 2026-02-17T04:32:09.484 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834' 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958530 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958530 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834 5-399431958530' 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953498 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953498 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834 5-399431958530 6-137438953498' 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789976 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789976 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834 5-399431958530 6-137438953498 7-158913789976' 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659160 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659160 2026-02-17T04:32:09.485 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834 5-399431958530 6-137438953498 7-158913789976 8-176093659160' 2026-02-17T04:32:09.486 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.486 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:09.486 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958530 2026-02-17T04:32:09.486 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958530 2026-02-17T04:32:09.486 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705691 2-60129542170 3-287762808850 4-98784247834 5-399431958530 6-137438953498 7-158913789976 8-176093659160 9-399431958530' 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:6170phtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247835 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247835 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835' 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.491 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958531 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958531 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835 5-399431958531' 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953499 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953499 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835 5-399431958531 6-137438953499' 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789977 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789977 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835 5-399431958531 6-137438953499 7-158913789977' 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659161 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659161 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835 5-399431958531 6-137438953499 7-158913789977 8-176093659161' 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:09.492 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958531 2026-02-17T04:32:09.493 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958531 2026-02-17T04:32:09.493 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705692 2-60129542171 3-287762808851 4-98784247835 5-399431958531 6-137438953499 7-158913789977 8-176093659161 9-399431958531' 2026-02-17T04:32:11.173 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.173 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836508 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836508 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836508 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836508' 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.0 seq 21474836508 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836508 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:11.174 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836508 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705692 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705692 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705692 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705692' 2026-02-17T04:32:11.175 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.1 seq 38654705692 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705692 -lt 38654705692 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542171 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542171 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542171 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542171' 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.2 seq 60129542171 2026-02-17T04:32:11.176 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats:99: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-17T04:32:11.177 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.0 seq 21474836507 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836507 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705691 2026-02-17T04:32:11.178 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705691 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.1 seq 38654705691 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705692 -lt 38654705691 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542170 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:11.179 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542170 2026-02-17T04:32:11.180 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.180 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542170 2026-02-17T04:32:11.180 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542170' 2026-02-17T04:32:11.180 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.2 seq 60129542170 2026-02-17T04:32:11.180 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:11.688 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_s test 60129542172 -lt 60129542171 2026-02-17T04:32:11.688 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.688 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808851 2026-02-17T04:32:11.688 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.688 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:11.689 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808851 2026-02-17T04:32:11.689 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.689 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808851 2026-02-17T04:32:11.689 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808851' 2026-02-17T04:32:11.689 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.3 seq 287762808851 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808852 -lt 287762808851 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247835 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.690 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247835 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247835 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247835' 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.4 seq 98784247835 2026-02-17T04:32:11.691 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247835 -lt 98784247835 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-399431958531 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-399431958531 2026-02-17T04:32:11.692 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.693 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958531 2026-02-17T04:32:11.693 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 399431958531' 2026-02-17T04:32:11.693 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.5 seq 399431958531 2026-02-17T04:32:11.693 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:11.693 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958531 2026-02-17T04:32:11.694 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.694 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953499 2026-02-17T04:32:11.694 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.695 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.clitats: test 60129542172 -lt 60129542170 2026-02-17T04:32:11.695 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.695 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-287762808850 2026-02-17T04:32:11.695 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-287762808850 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808850 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 287762808850' 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.3 seq 287762808850 2026-02-17T04:32:11.696 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808852 -lt 287762808850 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247834 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247834 2026-02-17T04:32:11.697 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247834 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247834' 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.4 seq 98784247834 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247835 -lt 98784247834 2026-02-17T04:32:11.698 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-399431958530 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-399431958530 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:11.699 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958530 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 399431958530' 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.5 seq 399431958530 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958530 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:11.700 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953498 2026-02-17T04:32:11.701 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.203 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clonent.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:12.203 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953499 2026-02-17T04:32:12.203 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953499 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953499' 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.6 seq 137438953499 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953499 -lt 137438953499 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789977 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:12.204 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789977 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789977 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789977' 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.7 seq 158913789977 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789977 -lt 158913789977 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659161 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.205 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659161 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659161 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659161' 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.8 seq 176093659161 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659161 -lt 176093659161 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958531 2026-02-17T04:32:12.206 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.207 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:12.207 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958531 2026-02-17T04:32:12.207 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.207 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958531 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:e.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953498 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953498 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953498' 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.6 seq 137438953498 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953499 -lt 137438953498 2026-02-17T04:32:12.212 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789976 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789976 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789976 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789976' 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.7 seq 158913789976 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:12.213 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789977 -lt 158913789976 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659160 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659160 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659160 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659160' 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.8 seq 176093659160 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659161 -lt 176093659160 2026-02-17T04:32:12.214 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:12.215 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958530 2026-02-17T04:32:12.215 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:12.215 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:12.215 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958530 2026-02-17T04:32:12.215 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:12.973 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958530 2026-02-17T04:32:12.973 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958530' 2026-02-17T04:32:12.973 INFO:tasks.workunit.client.0.trial090.stderr:617099: waiting osd.9 seq 399431958530 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958530 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:12.974 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:12.975 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:12.976 INFO:tasks.workunit.client.0.trial090.stderr:617099: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:12.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:12.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:12.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 617097 2026-02-17T04:32:12.982 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958531' 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: waiting osd.9 seq 399431958531 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958531 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:12.983 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:12.984 INFO:tasks.workunit.client.0.trial090.stderr:617101: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:617101: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:32:12.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:32:13.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 5 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=5 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:32:13.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 620005"' 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 620005' 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 620006"' 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 620006' 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-17T04:32:13.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 620005 620006' 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 620005 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/620008: /' 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:32:13.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/620010: /' 2026-02-17T04:32:13.450 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:13.451 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:13.452 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-17T04:32:13.453 INFO:tasks.workunit.client.0.trial090.stderr:620010: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:13.454 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:13.456 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:13.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:13.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: start osd.5 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:13.459 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:13.460 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:32:13.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:13.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:13.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:13.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:13.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:32:13.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:32:13.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:13.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:13.465 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:32:13.466 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:32:13.466 INFO:tasks.workunit.client.0.trial090.stderr:620008: start osd.3 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2026-02-17T04:32:13.466+0000 7fd1dec30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2026-02-17T04:32:13.467+0000 7fd1dec30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2026-02-17T04:32:13.468+0000 7fd1dec30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 0 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2026-02-17T04:32:13.658+0000 7fd1dec30780 -1 Falling back to public interface 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2026-02-17T04:32:13.960+0000 7fd1dec30780 -1 osd.5 95 log_to_monitors true 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: 1 2026-02-17T04:32:14.956 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: osd.5 up in weight 1 up_from 99 up_thru 99 down_at 96 last_clean_interval [93,95) [v2:127.0.0.1:6826/991125544,v1:127.0.0.1:6827/991125544] [v2:127.0.0.1:6828/991125544,v1:127.0.0.1:6829/991125544] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:14.957 INFO:tasks.workunit.client.0.trial090.stderr:620010: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620010: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: gps 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2026-02-17T04:32:13.471+0000 7f5ee8643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2026-02-17T04:32:13.472+0000 7f5ee8643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2026-02-17T04:32:13.473+0000 7f5ee8643780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 0 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2026-02-17T04:32:13.669+0000 7f5ee8643780 -1 Falling back to public interface 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2026-02-17T04:32:13.991+0000 7f5ee8643780 -1 osd.3 95 log_to_monitors true 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:14.961 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: 1 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: osd.3 up in weight 1 up_from 99 up_thru 99 down_at 96 last_clean_interval [67,95) [v2:127.0.0.1:6842/653042442,v1:127.0.0.1:6843/653042442] [v2:127.0.0.1:6844/653042442,v1:127.0.0.1:6845/653042442] exists,up afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:14.962 INFO:tasks.workunit.client.0.trial090.stderr:620008: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:15.456 INFO:tasks.workunit.client.0.trial090.stderr:620008: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:15.457 INFO:tasks.workunit.client.0.trial090.stderr:620010: 1 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 2 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 3 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 4 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 5 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 6 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 7 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 8 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: 9' 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:15.458 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836512 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836512 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512' 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694' 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.459 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542175 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542175 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175' 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762306 2026-02-17T04:32:15.460 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762306 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306' 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clet_timeout_delays: echo true 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:15.461 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 1 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 2 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 3 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 4 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 5 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 6 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 7 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 8 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: 9' 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:15.462 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705695 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705695 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695' 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:15.463 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542174 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542174 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174' 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762307 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762307 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307' 2026-02-17T04:32:15.464 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.819 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247838 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247838 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838' 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762307 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762307 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838 5-425201762307' 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.820 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953502 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953502 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838 5-425201762307 6-137438953502' 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789979 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789979 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838 5-425201762307 6-137438953502 7-158913789979' 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659164 2026-02-17T04:32:15.821 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659164 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838 5-425201762307 6-137438953502 7-158913789979 8-176093659164' 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958533 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958533 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705695 2-60129542174 3-425201762307 4-98784247838 5-425201762307 6-137438953502 7-158913789979 8-176093659164 9-399431958533' 2026-02-17T04:32:15.822 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubunone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247837 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247837 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837' 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762306 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762306 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837 5-425201762306' 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.823 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953501 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953501 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837 5-425201762306 6-137438953501' 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789980 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789980 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837 5-425201762306 6-137438953501 7-158913789980' 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659163 2026-02-17T04:32:15.824 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659163 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837 5-425201762306 6-137438953501 7-158913789980 8-176093659163' 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958534 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958534 2026-02-17T04:32:15.825 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-60129542175 3-425201762306 4-98784247837 5-425201762306 6-137438953501 7-158913789980 8-176093659163 9-399431958534' 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836512' 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.0 seq 21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836512 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-17T04:32:17.504 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.1 seq 38654705694 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705695 -lt 38654705694 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542175 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542175 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542175 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542175' 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.2 seq 60129542175 2026-02-17T04:32:17.505 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60tu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.508 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.0 seq 21474836511 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836511 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836511 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705695 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705695 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705695 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705695' 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.1 seq 38654705695 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705695 -lt 38654705695 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542174 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542174 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542174 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542174' 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.2 seq 60129542174 2026-02-17T04:32:17.509 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542175 -lt 60129542175 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-425201762306 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-425201762306 2026-02-17T04:32:18.021 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762306 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 425201762306' 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.3 seq 425201762306 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762307 -lt 425201762306 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.022 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247837 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247837 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247837 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247837' 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.4 seq 98784247837 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247838 -lt 98784247837 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-425201762306 2026-02-17T04:32:18.023 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-425201762306 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762306 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 425201762306' 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.5 seq 425201762306 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762307 -lt 425201762306 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953501 2026-02-17T04:32:18.024 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/129542175 -lt 60129542174 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-425201762307 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-425201762307 2026-02-17T04:32:18.025 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762307 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 425201762307' 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.3 seq 425201762307 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762307 -lt 425201762307 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247838 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247838 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.026 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247838 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247838' 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.4 seq 98784247838 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247838 -lt 98784247838 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-425201762307 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-425201762307 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762307 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 425201762307' 2026-02-17T04:32:18.027 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.5 seq 425201762307 2026-02-17T04:32:18.028 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:18.028 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762307 -lt 425201762307 2026-02-17T04:32:18.028 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.028 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953502 2026-02-17T04:32:18.028 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.535 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:18.535 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953501 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953501 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953501' 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.6 seq 137438953501 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953502 -lt 137438953501 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789980 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:18.536 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789980 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789980 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789980' 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.7 seq 158913789980 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789981 -lt 158913789980 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659163 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659163 2026-02-17T04:32:18.537 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659163 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659163' 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.8 seq 176093659163 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659165 -lt 176093659163 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958534 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958534 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.538 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958534 2026-02-17T04:32:18.542 INFO:tasks.workunit.client.0.trial090.stderr:620010: /standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:18.542 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953502 2026-02-17T04:32:18.542 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.542 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953502 2026-02-17T04:32:18.542 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953502' 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.6 seq 137438953502 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953502 -lt 137438953502 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789979 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789979 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789979 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789979' 2026-02-17T04:32:18.543 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.7 seq 158913789979 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789981 -lt 158913789979 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659164 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659164 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659164 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659164' 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.8 seq 176093659164 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:18.544 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659165 -lt 176093659164 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958533 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958533 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:18.545 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958533 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958533' 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: waiting osd.9 seq 399431958533 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958535 -lt 399431958533 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:19.306 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:19.307 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:620008: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 620006 2026-02-17T04:32:19.310 INFO:tasks.workunit.client.0.trial090.stderr:home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958534' 2026-02-17T04:32:19.310 INFO:tasks.workunit.client.0.trial090.stderr:620010: waiting osd.9 seq 399431958534 2026-02-17T04:32:19.310 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:19.310 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958535 -lt 399431958534 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:19.311 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:19.312 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:620010: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-17T04:32:19.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:32:19.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-17T04:32:19.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:32:19.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:32:19.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:32:19.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:32:19.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-17T04:32:19.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-17T04:32:19.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:32:19.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:32:19.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:19.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:19.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:19.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:19.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:19.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:32:19.800 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:32:19.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:19.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:19.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:19.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:19.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:19.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:19.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:00.208015+0000 '>' 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:19.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:20.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:20.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:20.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:20.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:20.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:20.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:20.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:21.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:00.208015+0000 '>' 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:21.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:22.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:22.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:22.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:22.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:22.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:22.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:22.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:22.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:00.208015+0000 '>' 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:22.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:23.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:23.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:23.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:23.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:23.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:23.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:23.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:23.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:00.208015+0000 '>' 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:23.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:24.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:24.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:24.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:32:24.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:32:24.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:24.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:24.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:19.918219+0000 '>' 2026-02-17T04:32:00.208015+0000 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:24.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 623455"' 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 623455' 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 623456"' 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 623456' 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 623455 623456' 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:32:24.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 623455 2026-02-17T04:32:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:32:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/623458: /' 2026-02-17T04:32:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/623460: /' 2026-02-17T04:32:25.071 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.071 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:25.071 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-17T04:32:25.071 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:25.071 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:25.072 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: _ 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: hinfo_key 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: snapset 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-17T04:32:25.073 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:25.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:25.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:25.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: start osd.5 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:32:25.077 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:25.078 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: _ 2026-02-17T04:32:25.079 INFO:tasks.workunit.client.0.trial090.stderr:623458: hinfo_key 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: snapset 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:32:25.080 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:25.081 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:25.082 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:32:25.083 INFO:tasks.workunit.client.0.trial090.stderr:623458: start osd.3 2026-02-17T04:32:26.577 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$nrecovery_ops 2026-02-17T04:32:26.577 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-17T04:32:26.577 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-17T04:32:26.577 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:26.577 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2026-02-17T04:32:25.087+0000 7f2f84015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2026-02-17T04:32:25.088+0000 7f2f84015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2026-02-17T04:32:25.089+0000 7f2f84015780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 0 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2026-02-17T04:32:25.319+0000 7f2f84015780 -1 Falling back to public interface 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2026-02-17T04:32:25.638+0000 7f2f84015780 -1 osd.5 100 log_to_monitors true 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: 1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: osd.5 up in weight 1 up_from 104 up_thru 104 down_at 101 last_clean_interval [99,100) [v2:127.0.0.1:6827/3773542965,v1:127.0.0.1:6829/3773542965] [v2:127.0.0.1:6830/3773542965,v1:127.0.0.1:6832/3773542965] exists,up 0c22539d-d708-49fa-b836-0d51a5e61077 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:26.578 INFO:tasks.workunit.client.0.trial090.stderr:623460: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623460: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/cephame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2026-02-17T04:32:25.092+0000 7f0953bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2026-02-17T04:32:25.094+0000 7f0953bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2026-02-17T04:32:25.094+0000 7f0953bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:26.590 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: 0 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2026-02-17T04:32:25.319+0000 7f0953bfd780 -1 Falling back to public interface 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2026-02-17T04:32:25.631+0000 7f0953bfd780 -1 osd.3 100 log_to_monitors true 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: 1 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: osd.3 up in weight 1 up_from 104 up_thru 104 down_at 101 last_clean_interval [99,100) [v2:127.0.0.1:6826/3886630450,v1:127.0.0.1:6828/3886630450] [v2:127.0.0.1:6831/3886630450,v1:127.0.0.1:6833/3886630450] exists,up afe6991b-c470-438e-b11d-a0c5bd0d684e 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:26.591 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_ti-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:27.074 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 1 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 2 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 3 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 4 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 5 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 6 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 7 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 8 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: 9' 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:27.075 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836515 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836515 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515' 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705698 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705698 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698' 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542178 2026-02-17T04:32:27.076 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542178 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178' 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598786 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598786 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786' 2026-02-17T04:32:27.077 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623460: //homemeout_delays 90 .1 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:27.092 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 1 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 2 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 3 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 4 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 5 2026-02-17T04:32:27.093 INFO:tasks.workunit.client.0.trial090.stderr:623458: 6 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: 7 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: 8 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: 9' 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836516 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836516 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516' 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:27.094 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705699 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705699 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699' 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542179 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542179 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179' 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598787 2026-02-17T04:32:27.095 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598787 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flu/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247841 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247841 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841' 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.436 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598786 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598786 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841 5-446676598786' 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953505 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953505 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841 5-446676598786 6-137438953505' 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789984 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789984 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841 5-446676598786 6-137438953505 7-158913789984' 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659167 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659167 2026-02-17T04:32:27.437 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841 5-446676598786 6-137438953505 7-158913789984 8-176093659167' 2026-02-17T04:32:27.438 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.438 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:27.438 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958537 2026-02-17T04:32:27.438 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958537 2026-02-17T04:32:27.458 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-446676598786 4-98784247841 5-446676598786 6-137438953505 7-158913789984 8-176093659167 9-399431958537'sh_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787' 2026-02-17T04:32:27.458 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.458 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247842 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247842 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842' 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598787 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598787 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842 5-446676598787' 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953506 2026-02-17T04:32:27.459 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953506 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842 5-446676598787 6-137438953506' 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789985 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789985 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842 5-446676598787 6-137438953506 7-158913789985' 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659168 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659168 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842 5-446676598787 6-137438953506 7-158913789985 8-176093659168' 2026-02-17T04:32:27.460 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:27.461 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-17T04:32:27.461 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958538 2026-02-17T04:32:27.461 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958538 2026-02-17T04:32:28.981 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836516 1-38654705699 2-60129542179 3-446676598787 4-98784247842 5-446676598787 6-137438953506 7-158913789985 8-176093659168 9-399431958538' 2026-02-17T04:32:28.981 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:28.981 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836516 2026-02-17T04:32:28.981 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836516 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836516 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836516' 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.0 seq 21474836516 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836516 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:28.982 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836516 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705699 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705699 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705699 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705699' 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.1 seq 38654705699 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705700 -lt 38654705699 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:28.983 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542179 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542179 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542179 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542179' 2026-02-17T04:32:28.984 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.2 seq 60129542179 2026-02-17T04:32:29.128 INFO:tasks.workunit.client.0.trial090.stderr:623 2026-02-17T04:32:29.128 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.128 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836515 2026-02-17T04:32:29.128 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.128 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836515 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836515 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.0 seq 21474836515 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836515 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836515 2026-02-17T04:32:29.129 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705698 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705698 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705698 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.1 seq 38654705698 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705700 -lt 38654705698 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.130 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542178 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542178 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542178 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542178' 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.2 seq 60129542178 2026-02-17T04:32:29.131 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542179 -lt 60129542178 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 446676598786' 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.3 seq 446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247841 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247841 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247841 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247841' 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.4 seq 98784247841 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247841 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-446676598786 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.651 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598786 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 446676598786' 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.5 seq 446676598786 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598786 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953505 2026-02-17T04:32:29.652 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542179 -lt 60129542179 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-446676598787 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-446676598787 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598787 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 446676598787' 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.3 seq 446676598787 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598787 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247842 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247842 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247842 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247842' 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.4 seq 98784247842 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247842 2026-02-17T04:32:29.669 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-446676598787 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-446676598787 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598787 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 446676598787' 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.5 seq 446676598787 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598787 2026-02-17T04:32:29.670 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.173 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/stand/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:30.173 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953505 2026-02-17T04:32:30.173 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953505 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953505' 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.6 seq 137438953505 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953505 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789984 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789984 2026-02-17T04:32:30.174 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789984 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789984' 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.7 seq 158913789984 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789985 -lt 158913789984 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659167 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659167 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659167 2026-02-17T04:32:30.175 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659167' 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.8 seq 176093659167 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659169 -lt 176093659167 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958537 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958537 2026-02-17T04:32:30.176 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399alone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953506 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953506 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953506 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953506' 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.6 seq 137438953506 2026-02-17T04:32:30.191 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953506 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-158913789985 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-158913789985 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789985 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 158913789985' 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.7 seq 158913789985 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789985 -lt 158913789985 2026-02-17T04:32:30.192 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-176093659168 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-176093659168 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659168 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 176093659168' 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.8 seq 176093659168 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659169 -lt 176093659168 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-399431958538 2026-02-17T04:32:30.193 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:30.194 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-17T04:32:30.194 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-399431958538 2026-02-17T04:32:30.940 INFO:tasks.workunit.client.0.trial090.stderr:623458: //h431958537 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958537' 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: waiting osd.9 seq 399431958537 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958539 -lt 399431958537 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:30.941 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:30.942 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:30.943 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:30.943 INFO:tasks.workunit.client.0.trial090.stderr:623460: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:30.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:30.965 INFO:tasks.workunit.client.0.trial090.stderr:ome/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958538 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 399431958538' 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: waiting osd.9 seq 399431958538 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958539 -lt 399431958538 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:30.966 INFO:tasks.workunit.client.0.trial090.stderr:623458: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 623456 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-17T04:32:30.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:32:30.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:30.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:30.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:31.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:31.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:32:31.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:32:31.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:32:31.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:32:31.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:32:31.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:32:31.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:32:31.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:32:31.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:32:31.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:32:31.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:32:31.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:32:31.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:32:31.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:32:31.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:32:31.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:31.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:31.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:31.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:31.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:32:31.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:32:31.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:32:31.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:32:31.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:32:31.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:32:31.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:32:31.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:32:31.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:32:31.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:32:31.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:32:31.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:32:31.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:32:31.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:32:31.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:32:31.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:32:31.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:32:31.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:32:31.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:32:31.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:32:31.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:32:31.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_replicated td/osd-scrub-repair 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:94: TEST_corrupt_and_repair_replicated: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:95: TEST_corrupt_and_repair_replicated: local poolname=rbd 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:97: TEST_corrupt_and_repair_replicated: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:32:31.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:32:31.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-17T04:32:31.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:31.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:32:31.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:32:31.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:32:31.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:32:31.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:32:31.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:32:31.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:32:31.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:32:31.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:32:31.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:32:31.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:32:31.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:32:31.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:32:31.248 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:32:31.248 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.248 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.249 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:32:31.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:32:31.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:98: TEST_corrupt_and_repair_replicated: run_mgr td/osd-scrub-repair x 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:32:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:32:31.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:32:31.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:31.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:31.372 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:31.372 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.372 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:31.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:32:31.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:99: TEST_corrupt_and_repair_replicated: run_osd td/osd-scrub-repair 0 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:31.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:31.392 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:32:31.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:32:31.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:32:31.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:32:31.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 2026-02-17T04:32:31.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4' 2026-02-17T04:32:31.395 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 2026-02-17T04:32:31.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:32:31.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBf75NpdyjeFxAAOS6jtgE1WxTGOJy7RdI2lQ== 2026-02-17T04:32:31.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBf75NpdyjeFxAAOS6jtgE1WxTGOJy7RdI2lQ=="}' 2026-02-17T04:32:31.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:32:31.483 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:32:31.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:32:31.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBf75NpdyjeFxAAOS6jtgE1WxTGOJy7RdI2lQ== --osd-uuid 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 2026-02-17T04:32:31.508 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:31.506+0000 7fdc20062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:31.509 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:31.507+0000 7fdc20062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:31.510 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:31.508+0000 7fdc20062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:31.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:31.508+0000 7fdc20062780 -1 bdev(0x390ec00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:32:31.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:31.509+0000 7fdc20062780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:32:31.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:32:31.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:32:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:32:31.918 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:32:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:32:32.005 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:32:32.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:32:32.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:32.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:32:32.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:32:32.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:32:32.021 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:32.019+0000 7f757c241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:32.022 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:32.020+0000 7f757c241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:32.023 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:32.021+0000 7f757c241780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:32.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:32.089 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:32:32.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:32.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:32:32.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:32.215 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:32.213+0000 7f757c241780 -1 Falling back to public interface 2026-02-17T04:32:32.607 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:32.605+0000 7f757c241780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:32:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:33.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:33.171 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:32:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:33.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:32:33.254 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1936028252,v1:127.0.0.1:6801/1936028252] [v2:127.0.0.1:6802/1936028252,v1:127.0.0.1:6803/1936028252] exists,up 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 2026-02-17T04:32:33.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:100: TEST_corrupt_and_repair_replicated: run_osd td/osd-scrub-repair 1 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:33.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:33.260 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:33.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b9f3bac1-cb04-4e57-992f-e532173d4501' 2026-02-17T04:32:33.262 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:33.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:32:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBh75NpbpXxDxAAmFvxQ6rmDpUgw94t5tUsDA== 2026-02-17T04:32:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBh75NpbpXxDxAAmFvxQ6rmDpUgw94t5tUsDA=="}' 2026-02-17T04:32:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b9f3bac1-cb04-4e57-992f-e532173d4501 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:32:33.348 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:32:33.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:32:33.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBh75NpbpXxDxAAmFvxQ6rmDpUgw94t5tUsDA== --osd-uuid b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:33.373 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.371+0000 7f890bbd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:33.375 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.373+0000 7f890bbd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:33.376 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.374+0000 7f890bbd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:33.376 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.374+0000 7f890bbd8780 -1 bdev(0x32d4c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:32:33.376 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.374+0000 7f890bbd8780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:32:33.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:32:33.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:32:33.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:32:33.735 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:32:33.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:32:33.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:32:33.946 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:32:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:32:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:32:33.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:32:33.960 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.958+0000 7f2322012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:33.961 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.959+0000 7f2322012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:33.962 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:33.960+0000 7f2322012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:34.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:34.092+0000 7f2322012780 -1 Falling back to public interface 2026-02-17T04:32:34.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:32:34.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:34.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:32:34.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:34.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:34.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:34.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:34.112 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:32:34.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:34.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:34.403 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:34.401+0000 7f2322012780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:32:35.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:35.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:35.277 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:32:35.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:35.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:35.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:35.442 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3440348186,v1:127.0.0.1:6811/3440348186] [v2:127.0.0.1:6812/3440348186,v1:127.0.0.1:6813/3440348186] exists,up b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:35.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:35.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:35.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:35.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:101: TEST_corrupt_and_repair_replicated: create_rbd_pool 2026-02-17T04:32:35.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:32:35.603 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:32:35.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:32:35.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:32:35.796 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:32:35.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:32:36.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:32:37.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:102: TEST_corrupt_and_repair_replicated: wait_for_clean 2026-02-17T04:32:37.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:37.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:37.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:37.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:37.065 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:37.065 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:37.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:37.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:37.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:37.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:37.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:37.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:37.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:37.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:37.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:37.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:37.315 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:32:37.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:37.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:37.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:37.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:32:37.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:32:37.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:32:37.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:37.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:37.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-17T04:32:37.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-17T04:32:37.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705666' 2026-02-17T04:32:37.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:37.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:32:37.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:37.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:37.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:32:37.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:37.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:32:37.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:32:37.438 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:32:37.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:37.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:32:37.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:37.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-17T04:32:37.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:37.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:37.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-17T04:32:37.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:37.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-17T04:32:37.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-17T04:32:37.609 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705666 2026-02-17T04:32:37.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:37.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705666 -lt 38654705666 2026-02-17T04:32:37.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:37.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:37.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:32:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:37.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:37.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:37.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:37.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:37.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:37.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:38.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:32:38.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:38.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:38.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:104: TEST_corrupt_and_repair_replicated: add_something td/osd-scrub-repair rbd 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:32:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-17T04:32:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:32:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:32:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:32:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:32:38.574 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:32:38.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:32:38.778 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:32:38.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:32:38.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:32:38.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:32:38.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:105: TEST_corrupt_and_repair_replicated: get_not_primary rbd SOMETHING 2026-02-17T04:32:38.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-17T04:32:38.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:32:38.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-17T04:32:38.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-17T04:32:38.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:32:38.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:32:38.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:32:38.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:32:38.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:32:38.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:105: TEST_corrupt_and_repair_replicated: corrupt_and_repair_one td/osd-scrub-repair rbd 0 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=0 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:32:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:39.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:39.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:39.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:32:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:32:39.351 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:39.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:39.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:39.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:39.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:32:39.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:32:39.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:39.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:39.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:39.407 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:39.405+0000 7fbd16029780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:39.409 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:39.407+0000 7fbd16029780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:39.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:39.408+0000 7fbd16029780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:39.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:32:39.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:39.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:32:39.574 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:39.573+0000 7fbd16029780 -1 Falling back to public interface 2026-02-17T04:32:39.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:39.877 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:39.875+0000 7fbd16029780 -1 osd.0 19 log_to_monitors true 2026-02-17T04:32:40.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:40.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:40.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:40.725 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:32:40.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:40.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/3588968879,v1:127.0.0.1:6801/3588968879] [v2:127.0.0.1:6802/3588968879,v1:127.0.0.1:6803/3588968879] exists,up 2c225e7a-f5e0-487b-8ff4-5facc64d5ef4 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:40.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:40.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:40.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:40.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:40.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:40.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:40.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:41.139 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:32:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:41.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-17T04:32:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-17T04:32:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810' 2026-02-17T04:32:41.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:41.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:41.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:32:41.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:32:41.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705668' 2026-02-17T04:32:41.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:41.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247810 2026-02-17T04:32:41.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:41.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:41.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247810 2026-02-17T04:32:41.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:41.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-17T04:32:41.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247810' 2026-02-17T04:32:41.262 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247810 2026-02-17T04:32:41.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:41.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 98784247810 2026-02-17T04:32:41.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:42.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:42.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:42.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-17T04:32:42.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:42.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:32:42.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:42.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:42.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:32:42.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:32:42.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:32:42.603 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705668 2026-02-17T04:32:42.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:42.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T04:32:42.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:42.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:42.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:42.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:32:42.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:42.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:42.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:43.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:32:43.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:43.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:43.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:43.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-17T04:32:43.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:32:43.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-17T04:32:43.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-17T04:32:43.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-17T04:32:43.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-17T04:32:43.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:43.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:43.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:43.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:43.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:43.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-17T04:32:43.846 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:32:43.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:43.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:44.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:35.793415+0000 '>' 2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:44.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:45.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:35.793415+0000 '>' 2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:45.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:46.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:46.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:46.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:46.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:46.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:46.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:46.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:46.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:35.793415+0000 '>' 2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:46.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:47.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:47.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:47.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:47.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:47.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:47.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:47.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:47.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:44.540086+0000 '>' 2026-02-17T04:32:35.793415+0000 2026-02-17T04:32:47.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:32:47.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:32:47.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:47.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:47.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:47.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:47.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:32:47.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:32:47.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-17T04:32:47.878 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-17T04:32:47.878 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:32:47.878 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:47.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:47.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:47.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:32:47.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:32:47.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:47.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:47.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:47.944 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:47.942+0000 7f2142062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:47.945 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:47.943+0000 7f2142062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:47.946 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:47.944+0000 7f2142062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:48.089 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:48.087+0000 7f2142062780 -1 Falling back to public interface 2026-02-17T04:32:48.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:32:48.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:48.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:48.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:48.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:48.419 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:48.417+0000 7f2142062780 -1 osd.1 26 log_to_monitors true 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:49.425 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 27 last_clean_interval [9,26) [v2:127.0.0.1:6810/1664893597,v1:127.0.0.1:6811/1664893597] [v2:127.0.0.1:6812/1664893597,v1:127.0.0.1:6813/1664893597] exists,up b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:49.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:49.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:49.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:49.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:49.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:49.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:49.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:49.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:49.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:49.680 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:32:49.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:49.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:49.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:49.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247812 2026-02-17T04:32:49.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247812 2026-02-17T04:32:49.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247812' 2026-02-17T04:32:49.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:49.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:49.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-17T04:32:49.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-17T04:32:49.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247812 1-128849018882' 2026-02-17T04:32:49.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:49.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247812 2026-02-17T04:32:49.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:49.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:49.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247812 2026-02-17T04:32:49.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:49.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247812 2026-02-17T04:32:49.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247812' 2026-02-17T04:32:49.800 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247812 2026-02-17T04:32:49.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:49.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247811 -lt 98784247812 2026-02-17T04:32:49.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:50.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:32:50.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:51.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247811 -lt 98784247812 2026-02-17T04:32:51.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:32:52.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:32:52.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:52.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247813 -lt 98784247812 2026-02-17T04:32:52.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:52.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018882 2026-02-17T04:32:52.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:52.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:52.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018882 2026-02-17T04:32:52.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:52.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-17T04:32:52.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018882' 2026-02-17T04:32:52.310 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 128849018882 2026-02-17T04:32:52.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:52.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018882 -lt 128849018882 2026-02-17T04:32:52.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:52.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:52.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:52.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:32:52.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:52.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:52.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:32:52.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:52.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:52.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:53.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:32:53.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:53.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:53.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:32:53.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:32:53.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:107: TEST_corrupt_and_repair_replicated: get_primary rbd SOMETHING 2026-02-17T04:32:53.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-17T04:32:53.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:32:53.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:32:53.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:32:53.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:107: TEST_corrupt_and_repair_replicated: corrupt_and_repair_one td/osd-scrub-repair rbd 1 2026-02-17T04:32:53.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-17T04:32:53.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:32:53.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:32:53.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:32:53.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:32:53.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:32:53.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:32:53.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:32:53.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:32:53.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-17T04:32:53.473 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:32:53.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:32:53.521 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:32:53.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:32:53.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:32:53.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:32:53.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:32:53.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:32:53.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:32:53.534 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:53.531+0000 7f930ae0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:53.534 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:53.533+0000 7f930ae0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:53.535 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:53.534+0000 7f930ae0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:32:53.665 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:53.663+0000 7f930ae0b780 -1 Falling back to public interface 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:53.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:53.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:32:53.982 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:32:53.980+0000 7f930ae0b780 -1 osd.1 31 log_to_monitors true 2026-02-17T04:32:54.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:32:54.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:32:54.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:32:54.850 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:32:54.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:32:54.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:32:55.016 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 35 up_thru 35 down_at 32 last_clean_interval [30,31) [v2:127.0.0.1:6810/3201068987,v1:127.0.0.1:6811/3201068987] [v2:127.0.0.1:6812/3201068987,v1:127.0.0.1:6813/3201068987] exists,up b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:32:55.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:32:55.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:32:55.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:32:55.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:32:55.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:32:55.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:32:55.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:32:55.265 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:32:55.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:32:55.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:55.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:32:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247815 2026-02-17T04:32:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247815 2026-02-17T04:32:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247815' 2026-02-17T04:32:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:32:55.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:32:55.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855362 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855362 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247815 1-150323855362' 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247815 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:55.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:32:55.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247815 2026-02-17T04:32:55.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:55.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247815 2026-02-17T04:32:55.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247815' 2026-02-17T04:32:55.386 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247815 2026-02-17T04:32:55.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:32:55.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247815 -lt 98784247815 2026-02-17T04:32:55.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:32:55.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-150323855362 2026-02-17T04:32:55.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:32:55.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:32:55.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855362 2026-02-17T04:32:55.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:32:55.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855362 2026-02-17T04:32:55.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 150323855362' 2026-02-17T04:32:55.556 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 150323855362 2026-02-17T04:32:55.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:32:55.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855362 2026-02-17T04:32:55.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:32:55.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:55.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:55.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:32:55.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:32:55.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:32:56.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:32:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:32:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:32:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:32:56.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-17T04:32:56.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:32:56.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-17T04:32:56.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-17T04:32:56.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-17T04:32:56.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-17T04:32:56.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:56.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:56.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:56.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:56.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:56.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-17T04:32:56.811 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:56.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:56.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:56.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:56.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:56.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:44.540086+0000 '>' 2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:56.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:57.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:57.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:57.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:57.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:57.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:57.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:57.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:58.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:44.540086+0000 '>' 2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:58.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:32:59.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:32:59.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:32:59.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:32:59.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:32:59.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:32:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:32:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:32:59.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:44.540086+0000 '>' 2026-02-17T04:32:44.540086+0000 2026-02-17T04:32:59.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:33:00.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:33:00.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:33:00.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:33:00.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:33:00.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:33:00.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:33:00.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:32:56.938794+0000 '>' 2026-02-17T04:32:44.540086+0000 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:00.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:33:00.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:00.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:00.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:00.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:00.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:00.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:00.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-17T04:33:00.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:00.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:00.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:33:00.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:00.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:00.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-17T04:33:00.630 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-17T04:33:00.630 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-17T04:33:00.630 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:33:00.630 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:00.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:00.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:00.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:00.673 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:00.673 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:00.673 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:00.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:00.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:00.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:00.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:00.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:33:00.675 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:33:00.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:00.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:33:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:33:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:00.688 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:00.686+0000 7f49bc671780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:00.689 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:00.687+0000 7f49bc671780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:00.690 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:00.688+0000 7f49bc671780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:00.811 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:00.809+0000 7f49bc671780 -1 Falling back to public interface 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:00.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:01.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:01.118 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:01.116+0000 7f49bc671780 -1 osd.1 37 log_to_monitors true 2026-02-17T04:33:02.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:02.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:02.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:02.007 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:02.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:02.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 41 up_thru 41 down_at 38 last_clean_interval [35,37) [v2:127.0.0.1:6810/1828340025,v1:127.0.0.1:6811/1828340025] [v2:127.0.0.1:6812/1828340025,v1:127.0.0.1:6813/1828340025] exists,up b9f3bac1-cb04-4e57-992f-e532173d4501 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:02.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:02.175 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:02.175 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:02.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:02.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:02.429 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:33:02.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:02.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:02.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:02.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247817 2026-02-17T04:33:02.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247817 2026-02-17T04:33:02.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247817' 2026-02-17T04:33:02.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:02.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659138 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659138 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247817 1-176093659138' 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247817 2026-02-17T04:33:02.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:02.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:02.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247817 2026-02-17T04:33:02.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:02.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247817 2026-02-17T04:33:02.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247817' 2026-02-17T04:33:02.546 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247817 2026-02-17T04:33:02.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:02.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247816 -lt 98784247817 2026-02-17T04:33:02.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:03.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:03.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:03.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247817 -lt 98784247817 2026-02-17T04:33:03.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:03.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-176093659138 2026-02-17T04:33:03.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:03.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:03.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-176093659138 2026-02-17T04:33:03.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:03.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659138 2026-02-17T04:33:03.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 176093659138' 2026-02-17T04:33:03.890 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 176093659138 2026-02-17T04:33:03.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:04.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659138 -lt 176093659138 2026-02-17T04:33:04.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:04.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:04.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:04.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:33:04.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:04.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:04.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:33:04.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:04.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:04.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:04.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:33:04.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:04.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:04.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:33:04.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:04.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:04.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:04.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:04.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:04.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:04.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:33:04.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:33:04.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:33:04.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:33:04.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:33:04.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:33:04.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:33:04.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:33:04.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:33:04.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:33:04.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:33:04.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:33:04.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:33:04.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:33:04.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:33:04.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:04.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:04.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:04.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:04.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:04.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:33:04.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:33:04.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:33:04.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:33:04.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:33:04.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:33:04.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:33:04.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:33:04.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:33:04.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:33:04.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:33:04.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:33:04.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:33:04.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:33:04.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:33:04.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:33:04.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:33:04.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:33:04.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:33:04.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_erasure_appends td/osd-scrub-repair 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5912: TEST_corrupt_scrub_erasure_appends: corrupt_scrub_erasure td/osd-scrub-repair false 2026-02-17T04:33:04.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3736: corrupt_scrub_erasure: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3737: corrupt_scrub_erasure: local allow_overwrites=false 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3738: corrupt_scrub_erasure: local poolname=ecpool 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3739: corrupt_scrub_erasure: local total_objs=7 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3741: corrupt_scrub_erasure: run_mon td/osd-scrub-repair a 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:33:04.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:33:04.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:33:04.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:04.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:04.823 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:04.824 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.824 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:04.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:33:04.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:33:04.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:33:04.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:33:04.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:33:04.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:33:04.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:33:04.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:33:04.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:33:04.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:33:04.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:33:04.892 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:33:04.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:33:04.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3742: corrupt_scrub_erasure: run_mgr td/osd-scrub-repair x 2026-02-17T04:33:04.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:33:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:33:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:33:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:33:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:33:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:33:05.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:33:05.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:05.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:05.018 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:05.018 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:05.018 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:05.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:05.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:33:05.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:33:05.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: seq 0 2 2026-02-17T04:33:05.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 0 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:05.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:05.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:33:05.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:33:05.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:33:05.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:05.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd' 2026-02-17T04:33:05.044 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:05.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:33:05.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCB75Np4enkAhAA9P3+WonDlwb1l0eSOhKz2Q== 2026-02-17T04:33:05.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCB75Np4enkAhAA9P3+WonDlwb1l0eSOhKz2Q=="}' 2026-02-17T04:33:05.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd -i td/osd-scrub-repair/0/new.json 2026-02-17T04:33:05.129 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:33:05.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:33:05.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCB75Np4enkAhAA9P3+WonDlwb1l0eSOhKz2Q== --osd-uuid 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:05.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.150+0000 7ff27a008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.154 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.152+0000 7ff27a008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.154 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.153+0000 7ff27a008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.155 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.153+0000 7ff27a008780 -1 bdev(0x2986c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:33:05.155 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.153+0000 7ff27a008780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:33:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:33:05.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:33:05.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:33:05.575 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:33:05.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:33:05.659 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:33:05.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:33:05.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:05.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:33:05.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:33:05.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:33:05.673 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.671+0000 7f9274c41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.675 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.673+0000 7f9274c41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.674+0000 7f9274c41780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:05.741 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:33:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:05.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:05.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:05.915 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:05.913+0000 7f9274c41780 -1 Falling back to public interface 2026-02-17T04:33:06.294 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:06.292+0000 7f9274c41780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:06.901 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2391880688,v1:127.0.0.1:6801/2391880688] [v2:127.0.0.1:6802/2391880688,v1:127.0.0.1:6803/2391880688] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 1 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:06.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:33:06.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:06.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:33:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:06.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 dd138961-cf15-45aa-8c8e-aae7eada9b4d' 2026-02-17T04:33:06.905 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:06.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:33:06.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCC75NpGSKKNhAAIQBPi69q18rKhGE4WHo3iw== 2026-02-17T04:33:06.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCC75NpGSKKNhAAIQBPi69q18rKhGE4WHo3iw=="}' 2026-02-17T04:33:06.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dd138961-cf15-45aa-8c8e-aae7eada9b4d -i td/osd-scrub-repair/1/new.json 2026-02-17T04:33:06.994 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:33:07.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:33:07.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCC75NpGSKKNhAAIQBPi69q18rKhGE4WHo3iw== --osd-uuid dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:07.019 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.017+0000 7fb70ec23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.020 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.019+0000 7fb70ec23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.021 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.019+0000 7fb70ec23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.021 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.020+0000 7fb70ec23780 -1 bdev(0x2c96c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:33:07.022 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.020+0000 7fb70ec23780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:33:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:33:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:33:07.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:33:07.351 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:33:07.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:33:07.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:33:07.562 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:33:07.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:07.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:33:07.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:33:07.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:33:07.578 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.577+0000 7fd859045780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.578+0000 7fd859045780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.580 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.579+0000 7fd859045780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:07.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:07.713+0000 7fd859045780 -1 Falling back to public interface 2026-02-17T04:33:07.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:33:07.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:07.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:07.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:07.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:07.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:07.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:07.728 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:33:07.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:07.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:07.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:08.009 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:08.008+0000 7fd859045780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:33:08.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:08.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:08.894 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:33:08.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:08.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:08.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:09.063 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/982728045,v1:127.0.0.1:6811/982728045] [v2:127.0.0.1:6812/982728045,v1:127.0.0.1:6813/982728045] exists,up dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 2 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:33:09.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:09.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:09.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:09.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 a63314be-95cd-441d-ac30-2f632fa7aeb9' 2026-02-17T04:33:09.072 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:09.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:33:09.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCF75Npq2eNBBAALW2VAzgDlrst/Z0+RjRXsQ== 2026-02-17T04:33:09.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCF75Npq2eNBBAALW2VAzgDlrst/Z0+RjRXsQ=="}' 2026-02-17T04:33:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a63314be-95cd-441d-ac30-2f632fa7aeb9 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:33:09.239 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:33:09.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:33:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCF75Npq2eNBBAALW2VAzgDlrst/Z0+RjRXsQ== --osd-uuid a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:09.265 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.264+0000 7fb002630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.266 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.265+0000 7fb002630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.267 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.266+0000 7fb002630780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.268 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.267+0000 7fb002630780 -1 bdev(0x3c76c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:33:09.268 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.267+0000 7fb002630780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:33:09.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:33:09.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:33:09.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:33:09.581 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:33:09.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:33:09.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:33:09.795 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:33:09.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:09.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:33:09.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:33:09.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:33:09.809 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.808+0000 7ffaa19e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.811 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.810+0000 7ffaa19e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.811 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.810+0000 7ffaa19e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:09.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:09.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:09.960 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:33:09.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:09.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:09.996 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:09.996+0000 7ffaa19e3780 -1 Falling back to public interface 2026-02-17T04:33:10.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:10.273 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:10.272+0000 7ffaa19e3780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:33:11.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:11.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:11.127 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:33:11.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:11.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:11.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:11.292 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2967945249,v1:127.0.0.1:6819/2967945249] [v2:127.0.0.1:6820/2967945249,v1:127.0.0.1:6821/2967945249] exists,up a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:11.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:11.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:11.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:11.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3746: corrupt_scrub_erasure: create_rbd_pool 2026-02-17T04:33:11.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:33:11.452 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:33:11.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:33:11.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:33:11.675 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:33:11.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:33:12.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:33:12.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3747: corrupt_scrub_erasure: create_pool foo 1 2026-02-17T04:33:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-17T04:33:13.163 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T04:33:13.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3749: corrupt_scrub_erasure: create_ec_pool ecpool false k=2 m=1 stripe_unit=2K --force 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:33:14.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 stripe_unit=2K --force 2026-02-17T04:33:14.390 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:33:14.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:33:14.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:33:14.695 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:33:14.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:15.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:15.709 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:15.709 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:15.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:15.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:15.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:15.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:15.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:16.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:33:16.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:33:16.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:33:16.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:16.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:33:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:33:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-17T04:33:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:16.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:16.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:33:16.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:33:16.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-17T04:33:16.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:16.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:33:16.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:16.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:16.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:33:16.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:16.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:33:16.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:33:16.150 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:33:16.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:16.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:33:16.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:17.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:17.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:17.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:33:17.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:17.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:33:17.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:17.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:17.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:33:17.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:17.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:33:17.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:33:17.491 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:33:17.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:17.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:33:17.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:17.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:33:17.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:17.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:17.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:33:17.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:17.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:33:17.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:33:17.661 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:33:17.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:17.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-17T04:33:17.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:17.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:17.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:18.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:18.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:18.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:18.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:18.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3750: corrupt_scrub_erasure: wait_for_clean 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:18.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:18.420 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:18.420 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:18.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:18.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:18.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:18.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:18.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:18.676 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:18.676 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:18.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:18.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:18.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:18.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:33:18.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:33:18.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:33:18.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:18.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:18.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:33:18.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:33:18.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T04:33:18.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:18.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542148' 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:33:18.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:18.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:18.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:33:18.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:18.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:33:18.855 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:33:18.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:33:18.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:19.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T04:33:19.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:20.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:20.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:20.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:33:20.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:20.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:33:20.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:20.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:20.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:33:20.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:20.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:33:20.194 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705668 2026-02-17T04:33:20.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:33:20.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T04:33:20.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:20.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:33:20.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:20.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:20.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:33:20.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:20.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:33:20.362 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542148 2026-02-17T04:33:20.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:33:20.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:20.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:33:20.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:20.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:20.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:20.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:20.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:20.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:20.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:20.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:20.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:20.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:21.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:21.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:21.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:21.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: seq 1 7 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ1 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ1 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ1 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:21.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:21.290 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:21.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:21.491 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:21.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 1 % 2 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3761: corrupt_scrub_erasure: local payload=UVWXYZZZ 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3762: corrupt_scrub_erasure: echo UVWXYZZZ 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3763: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:21.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:33:21.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:21.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:21.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:21.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:21.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:21.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:33:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:33:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:21.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:21.985 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:21.984+0000 7f545d02b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:21.986 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:21.986+0000 7f545d02b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:21.987 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:21.986+0000 7f545d02b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:22.122 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:22.120+0000 7f545d02b780 -1 Falling back to public interface 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:22.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:22.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:22.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:22.398 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:22.397+0000 7f545d02b780 -1 osd.1 31 log_to_monitors true 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:23.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:23.473 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 35 up_thru 35 down_at 32 last_clean_interval [9,31) [v2:127.0.0.1:6810/1901325006,v1:127.0.0.1:6811/1901325006] [v2:127.0.0.1:6812/1901325006,v1:127.0.0.1:6813/1901325006] exists,up dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:23.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:23.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:23.474 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:23.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:23.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:23.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:23.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:23.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:23.727 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:23.727 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:23.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:23.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:23.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:23.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:33:23.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:33:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:33:23.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:23.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855362 2026-02-17T04:33:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855362 2026-02-17T04:33:23.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-150323855362' 2026-02-17T04:33:23.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:23.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T04:33:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T04:33:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-150323855362 2-60129542150' 2026-02-17T04:33:23.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:23.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:33:23.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:23.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:23.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:33:23.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:23.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:33:23.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:33:23.907 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T04:33:23.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:24.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:33:24.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:25.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:25.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:33:25.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:25.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-150323855362 2026-02-17T04:33:25.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:25.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:25.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855362 2026-02-17T04:33:25.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:25.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855362 2026-02-17T04:33:25.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 150323855362' 2026-02-17T04:33:25.244 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 150323855362 2026-02-17T04:33:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:25.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855362 2026-02-17T04:33:25.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:25.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T04:33:25.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:25.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:25.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T04:33:25.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:25.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T04:33:25.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T04:33:25.418 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542150 2026-02-17T04:33:25.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:25.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T04:33:25.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:25.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:25.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:25.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:25.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:25.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:25.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:25.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:25.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:25.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:25.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:25.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:25.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:25.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:25.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ2 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ2 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ2 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:26.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:26.389 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:26.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:26.593 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:26.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 2 % 2 2026-02-17T04:33:26.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:33:26.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:26.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3768: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=1 2026-02-17T04:33:26.626 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:33:26.626 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:33:26.626 INFO:tasks.workunit.client.0.trial090.stderr:2048 bytes (2.0 kB, 2.0 KiB) copied, 6.0131e-05 s, 34.1 MB/s 2026-02-17T04:33:26.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3769: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:26.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:33:26.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:26.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:26.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:26.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:26.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:26.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:26.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:26.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:26.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:33:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:27.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:27.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:27.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:33:27.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:33:27.098 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:33:27.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:27.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:33:27.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:33:27.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:27.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:27.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:27.108 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:27.107+0000 7fe52a43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:27.109 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:27.109+0000 7fe52a43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:27.110 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:27.110+0000 7fe52a43b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:27.242 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:27.240+0000 7fe52a43b780 -1 Falling back to public interface 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:27.262 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:27.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:27.534 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:27.533+0000 7fe52a43b780 -1 osd.0 38 log_to_monitors true 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:28.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:28.591 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 42 up_thru 42 down_at 39 last_clean_interval [5,38) [v2:127.0.0.1:6800/1615211082,v1:127.0.0.1:6801/1615211082] [v2:127.0.0.1:6802/1615211082,v1:127.0.0.1:6803/1615211082] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:28.592 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:28.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:28.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:28.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:28.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:28.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:28.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626434 2026-02-17T04:33:28.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626434 2026-02-17T04:33:28.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626434' 2026-02-17T04:33:28.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:28.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:28.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-17T04:33:28.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-17T04:33:28.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626434 1-150323855364' 2026-02-17T04:33:28.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:28.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626434 1-150323855364 2-60129542152' 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-180388626434 2026-02-17T04:33:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:29.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:29.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-180388626434 2026-02-17T04:33:29.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:29.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626434 2026-02-17T04:33:29.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 180388626434' 2026-02-17T04:33:29.027 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 180388626434 2026-02-17T04:33:29.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:29.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626434 -lt 180388626434 2026-02-17T04:33:29.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:29.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-150323855364 2026-02-17T04:33:29.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:29.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:29.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855364 2026-02-17T04:33:29.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:29.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855364 2026-02-17T04:33:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 150323855364' 2026-02-17T04:33:29.195 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 150323855364 2026-02-17T04:33:29.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:29.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-17T04:33:29.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:29.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-17T04:33:29.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:29.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:29.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-17T04:33:29.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-17T04:33:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-17T04:33:29.364 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542152 2026-02-17T04:33:29.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:29.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542152 2026-02-17T04:33:29.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:29.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:29.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:29.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:29.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:29.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:29.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:29.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:29.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:29.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:30.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:30.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:30.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:30.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:30.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ3 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ3 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ3 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:30.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:30.340 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:30.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:30.544 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:30.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:30.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:30.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:30.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 3 % 2 2026-02-17T04:33:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:33:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3774: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:33:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:30.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:30.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:30.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:30.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:30.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ3 remove 2026-02-17T04:33:30.975 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#3:b197b25d:::EOBJ3:head# 2026-02-17T04:33:31.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:33:31.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:31.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:31.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:31.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:31.052 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:31.028+0000 7f6d7ca16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:31.052 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:31.029+0000 7f6d7ca16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:31.052 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:31.030+0000 7f6d7ca16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:31.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:31.162+0000 7f6d7ca16780 -1 Falling back to public interface 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:31.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:31.181 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:31.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:31.430 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:31.429+0000 7f6d7ca16780 -1 osd.1 46 log_to_monitors true 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:32.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:32.517 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 47 last_clean_interval [35,46) [v2:127.0.0.1:6810/2530269608,v1:127.0.0.1:6811/2530269608] [v2:127.0.0.1:6812/2530269608,v1:127.0.0.1:6813/2530269608] exists,up dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:32.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:32.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:32.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:32.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:32.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:32.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:32.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:32.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:32.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:32.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:32.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:32.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:32.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:32.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:32.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:32.773 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:32.773 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:32.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:32.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:32.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:32.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626436 2026-02-17T04:33:32.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626436 2026-02-17T04:33:32.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626436' 2026-02-17T04:33:32.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:32.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:32.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364802 2026-02-17T04:33:32.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364802 2026-02-17T04:33:32.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626436 1-214748364802' 2026-02-17T04:33:32.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:32.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:32.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-180388626436 1-214748364802 2-60129542154' 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-180388626436 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:32.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:32.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-180388626436 2026-02-17T04:33:32.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:32.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626436 2026-02-17T04:33:32.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 180388626436' 2026-02-17T04:33:32.956 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 180388626436 2026-02-17T04:33:32.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:33.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626436 -lt 180388626436 2026-02-17T04:33:33.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:33.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364802 2026-02-17T04:33:33.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:33.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:33.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364802 2026-02-17T04:33:33.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:33.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364802 2026-02-17T04:33:33.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364802' 2026-02-17T04:33:33.125 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 214748364802 2026-02-17T04:33:33.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364802 -lt 214748364802 2026-02-17T04:33:33.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:33.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-17T04:33:33.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:33.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-17T04:33:33.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-17T04:33:33.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-17T04:33:33.294 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542154 2026-02-17T04:33:33.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:33.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-17T04:33:33.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:33.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:33.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:33.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:33.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:33.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:33.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:33.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:33.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:33.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:34.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ4 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ4 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ4 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:34.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:34.258 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:34.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:34.461 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:34.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:34.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:34.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:34.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 4 % 2 2026-02-17T04:33:34.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:33:34.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:34.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3778: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key1-EOBJ4 val1-EOBJ4 2026-02-17T04:33:34.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3779: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key2-EOBJ4 val2-EOBJ4 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3782: corrupt_scrub_erasure: echo -n bad-val 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3783: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:33:34.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:34.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:34.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:34.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:34.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:33:34.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:34.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:33:34.783 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:33:34.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:34.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:33:34.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:33:34.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:34.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:34.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:34.794 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:34.792+0000 7fe3e9fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:34.795 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:34.794+0000 7fe3e9fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:34.796 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:34.794+0000 7fe3e9fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:34.927 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:34.925+0000 7fe3e9fe3780 -1 Falling back to public interface 2026-02-17T04:33:34.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:33:34.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:34.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:35.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:35.217 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:35.214+0000 7fe3e9fe3780 -1 osd.0 54 log_to_monitors true 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:36.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:36.279 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [42,54) [v2:127.0.0.1:6800/2374588691,v1:127.0.0.1:6801/2374588691] [v2:127.0.0.1:6802/2374588691,v1:127.0.0.1:6803/2374588691] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:36.280 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:36.281 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:36.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:36.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:36.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:36.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:36.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:36.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103170 2026-02-17T04:33:36.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103170 2026-02-17T04:33:36.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170' 2026-02-17T04:33:36.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:36.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:36.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364804 2026-02-17T04:33:36.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364804 2026-02-17T04:33:36.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170 1-214748364804' 2026-02-17T04:33:36.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:36.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:36.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-17T04:33:36.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-17T04:33:36.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170 1-214748364804 2-60129542156' 2026-02-17T04:33:36.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:36.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103170 2026-02-17T04:33:36.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:36.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:36.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103170 2026-02-17T04:33:36.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:36.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103170 2026-02-17T04:33:36.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103170' 2026-02-17T04:33:36.721 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 249108103170 2026-02-17T04:33:36.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:36.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626436 -lt 249108103170 2026-02-17T04:33:36.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:37.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:37.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:38.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103170 -lt 249108103170 2026-02-17T04:33:38.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:38.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364804 2026-02-17T04:33:38.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:38.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:38.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364804 2026-02-17T04:33:38.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:38.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364804 2026-02-17T04:33:38.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364804' 2026-02-17T04:33:38.060 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 214748364804 2026-02-17T04:33:38.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:38.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364804 -lt 214748364804 2026-02-17T04:33:38.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:38.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-17T04:33:38.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:38.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:38.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-17T04:33:38.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:38.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-17T04:33:38.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-17T04:33:38.231 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542156 2026-02-17T04:33:38.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:38.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-17T04:33:38.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:38.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:38.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:38.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:38.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:38.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:38.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:38.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:38.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:38.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3784: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:38.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:38.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:39.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:39.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:33:39.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:39.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:39.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:33:39.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:39.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:33:39.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:33:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:33:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:33:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:39.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:39.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:33:39.245 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:33:39.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:39.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:33:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:33:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:39.255 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:39.253+0000 7f134f850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:39.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:39.255+0000 7f134f850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:39.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:39.255+0000 7f134f850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:39.411 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:39.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:39.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:39.429 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:39.427+0000 7f134f850780 -1 Falling back to public interface 2026-02-17T04:33:39.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:39.744 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:39.742+0000 7f134f850780 -1 osd.2 59 log_to_monitors true 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:40.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [14,59) [v2:127.0.0.1:6818/2083937883,v1:127.0.0.1:6819/2083937883] [v2:127.0.0.1:6820/2083937883,v1:127.0.0.1:6821/2083937883] exists,up a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:40.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:40.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:40.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:40.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:40.996 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:40.997 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:40.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:40.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:40.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:41.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103172 2026-02-17T04:33:41.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103172 2026-02-17T04:33:41.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172' 2026-02-17T04:33:41.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:41.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:41.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364805 2026-02-17T04:33:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364805 2026-02-17T04:33:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172 1-214748364805' 2026-02-17T04:33:41.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:41.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:41.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939650 2026-02-17T04:33:41.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939650 2026-02-17T04:33:41.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172 1-214748364805 2-270582939650' 2026-02-17T04:33:41.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:41.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103172 2026-02-17T04:33:41.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:41.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:41.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103172 2026-02-17T04:33:41.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:41.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103172 2026-02-17T04:33:41.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103172' 2026-02-17T04:33:41.180 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 249108103172 2026-02-17T04:33:41.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103172 -lt 249108103172 2026-02-17T04:33:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:41.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364805 2026-02-17T04:33:41.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:41.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:41.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364805 2026-02-17T04:33:41.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:41.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364805 2026-02-17T04:33:41.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364805' 2026-02-17T04:33:41.351 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 214748364805 2026-02-17T04:33:41.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364804 -lt 214748364805 2026-02-17T04:33:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:42.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:42.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:42.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364804 -lt 214748364805 2026-02-17T04:33:42.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:43.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:33:43.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:43.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364806 -lt 214748364805 2026-02-17T04:33:43.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:43.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939650 2026-02-17T04:33:43.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:43.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:43.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939650 2026-02-17T04:33:43.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:43.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939650 2026-02-17T04:33:43.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 270582939650' 2026-02-17T04:33:43.855 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 270582939650 2026-02-17T04:33:43.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:44.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939650 -lt 270582939650 2026-02-17T04:33:44.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:44.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:44.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:44.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:44.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:44.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:44.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:44.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:44.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3785: corrupt_scrub_erasure: echo -n val3-EOBJ4 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3786: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:33:44.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:44.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:44.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:44.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:33:44.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:44.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:44.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:44.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:33:44.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:33:44.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:44.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:44.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:44.867 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:44.865+0000 7f570482d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:44.868 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:44.867+0000 7f570482d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:44.869 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:44.867+0000 7f570482d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:33:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:45.050 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:45.048+0000 7f570482d780 -1 Falling back to public interface 2026-02-17T04:33:45.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:45.385 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:45.383+0000 7f570482d780 -1 osd.2 65 log_to_monitors true 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:46.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:33:46.348 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [63,65) [v2:127.0.0.1:6818/3611869089,v1:127.0.0.1:6819/3611869089] [v2:127.0.0.1:6820/3611869089,v1:127.0.0.1:6821/3611869089] exists,up a63314be-95cd-441d-ac30-2f632fa7aeb9 2026-02-17T04:33:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:46.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:46.350 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:46.350 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:46.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:46.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:46.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:46.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:46.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:46.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:46.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:46.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:46.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:46.608 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:46.608 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:46.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:46.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:46.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103174 2026-02-17T04:33:46.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103174 2026-02-17T04:33:46.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174' 2026-02-17T04:33:46.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:46.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:46.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364808 2026-02-17T04:33:46.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364808 2026-02-17T04:33:46.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174 1-214748364808' 2026-02-17T04:33:46.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:46.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174 1-214748364808 2-296352743426' 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103174 2026-02-17T04:33:46.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:46.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:46.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103174 2026-02-17T04:33:46.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:46.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103174 2026-02-17T04:33:46.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103174' 2026-02-17T04:33:46.790 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 249108103174 2026-02-17T04:33:46.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103172 -lt 249108103174 2026-02-17T04:33:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:47.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:47.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:48.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103174 -lt 249108103174 2026-02-17T04:33:48.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:48.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364808 2026-02-17T04:33:48.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:48.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:48.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364808 2026-02-17T04:33:48.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:48.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364808 2026-02-17T04:33:48.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364808' 2026-02-17T04:33:48.132 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 214748364808 2026-02-17T04:33:48.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:48.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364808 -lt 214748364808 2026-02-17T04:33:48.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:48.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743426 2026-02-17T04:33:48.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:48.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:48.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743426 2026-02-17T04:33:48.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:48.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-17T04:33:48.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743426' 2026-02-17T04:33:48.302 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743426 2026-02-17T04:33:48.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:48.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743426 -lt 296352743426 2026-02-17T04:33:48.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:48.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:48.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:48.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:48.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:48.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:48.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:48.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:48.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:48.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:48.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:48.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:48.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:48.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:48.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:49.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:49.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:49.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:49.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3787: corrupt_scrub_erasure: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-17T04:33:49.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ5 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ5 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ5 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:49.272 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:49.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:49.476 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:49.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:49.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:49.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:49.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 5 % 2 2026-02-17T04:33:49.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:33:49.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:49.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3792: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=2 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records in 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records out 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 5.8389e-05 s, 70.2 MB/s 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3793: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:49.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:49.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:49.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:49.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:49.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:49.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:33:49.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:49.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:49.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:33:49.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:33:49.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:49.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:49.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:49.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:33:49.957 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:33:49.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:49.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:33:49.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:33:49.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:49.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:49.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:49.966 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:49.965+0000 7fe5b3027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:49.968 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:49.966+0000 7fe5b3027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:49.969 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:49.967+0000 7fe5b3027780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:50.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:50.139 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:50.137+0000 7fe5b3027780 -1 Falling back to public interface 2026-02-17T04:33:50.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:50.426 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:50.424+0000 7fe5b3027780 -1 osd.1 73 log_to_monitors true 2026-02-17T04:33:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:51.286 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:51.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:51.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [50,73) [v2:127.0.0.1:6810/1129881481,v1:127.0.0.1:6811/1129881481] [v2:127.0.0.1:6812/1129881481,v1:127.0.0.1:6813/1129881481] exists,up dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:51.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:51.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:51.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:51.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:51.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:51.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:51.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:51.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:51.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:51.704 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:51.705 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:51.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:51.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:51.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:51.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103176 2026-02-17T04:33:51.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103176 2026-02-17T04:33:51.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176' 2026-02-17T04:33:51.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:51.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:51.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-17T04:33:51.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-17T04:33:51.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176 1-330712481794' 2026-02-17T04:33:51.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:51.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:51.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743428 2026-02-17T04:33:51.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743428 2026-02-17T04:33:51.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176 1-330712481794 2-296352743428' 2026-02-17T04:33:51.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:51.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103176 2026-02-17T04:33:51.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:51.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:51.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103176 2026-02-17T04:33:51.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:51.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103176 2026-02-17T04:33:51.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103176' 2026-02-17T04:33:51.886 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 249108103176 2026-02-17T04:33:51.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:52.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103175 -lt 249108103176 2026-02-17T04:33:52.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:33:53.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:33:53.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:53.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103176 -lt 249108103176 2026-02-17T04:33:53.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:53.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481794 2026-02-17T04:33:53.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:53.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:53.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481794 2026-02-17T04:33:53.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:53.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-17T04:33:53.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481794' 2026-02-17T04:33:53.228 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 330712481794 2026-02-17T04:33:53.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:53.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481794 -lt 330712481794 2026-02-17T04:33:53.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:53.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743428 2026-02-17T04:33:53.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:53.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:53.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743428 2026-02-17T04:33:53.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:53.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743428 2026-02-17T04:33:53.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743428' 2026-02-17T04:33:53.400 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743428 2026-02-17T04:33:53.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:53.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743428 -lt 296352743428 2026-02-17T04:33:53.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:53.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:53.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:53.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:53.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:53.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:53.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:53.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:53.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:53.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:53.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:53.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:53.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:53.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:53.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:54.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:54.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:54.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:54.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ6 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ6 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ6 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:33:54.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:33:54.368 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:33:54.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:33:54.572 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:33:54.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:33:54.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:33:54.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:33:54.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 6 % 2 2026-02-17T04:33:54.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3797: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:33:54.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:54.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:54.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:54.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:54.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:54.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:54.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:33:54.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:54.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:33:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:33:55.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:55.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:55.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:33:55.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:33:55.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:55.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:55.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:55.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:33:55.041 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:55.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:55.053 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:55.051+0000 7fa35a246780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:55.055 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:55.053+0000 7fa35a246780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:55.056 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:55.054+0000 7fa35a246780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:55.204 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:55.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:55.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:55.269 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:55.267+0000 7fa35a246780 -1 Falling back to public interface 2026-02-17T04:33:55.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:55.561 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:55.559+0000 7fa35a246780 -1 osd.0 80 log_to_monitors true 2026-02-17T04:33:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:56.369 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [58,80) [v2:127.0.0.1:6800/1552546096,v1:127.0.0.1:6801/1552546096] [v2:127.0.0.1:6802/1552546096,v1:127.0.0.1:6803/1552546096] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:56.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:56.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:33:56.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:33:56.785 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:56.785 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:33:56.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:33:56.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:56.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:33:56.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-17T04:33:56.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-17T04:33:56.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866' 2026-02-17T04:33:56.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:56.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:33:56.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481796 2026-02-17T04:33:56.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481796 2026-02-17T04:33:56.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796' 2026-02-17T04:33:56.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:33:56.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743430 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743430 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796 2-296352743430' 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252866 2026-02-17T04:33:56.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:56.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:33:56.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252866 2026-02-17T04:33:56.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:56.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-17T04:33:56.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252866' 2026-02-17T04:33:56.965 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252866 2026-02-17T04:33:56.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:33:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252866 2026-02-17T04:33:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:57.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481796 2026-02-17T04:33:57.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:57.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:33:57.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481796 2026-02-17T04:33:57.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:57.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481796 2026-02-17T04:33:57.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481796' 2026-02-17T04:33:57.136 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 330712481796 2026-02-17T04:33:57.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:33:57.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481796 -lt 330712481796 2026-02-17T04:33:57.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:33:57.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743430 2026-02-17T04:33:57.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:33:57.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:33:57.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743430 2026-02-17T04:33:57.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:33:57.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743430 2026-02-17T04:33:57.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743430' 2026-02-17T04:33:57.305 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743430 2026-02-17T04:33:57.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:33:57.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743430 -lt 296352743430 2026-02-17T04:33:57.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:33:57.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:57.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:57.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:33:57.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:33:57.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:33:57.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:33:57.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:33:57.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:33:57.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:33:58.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:33:58.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3798: corrupt_scrub_erasure: echo -n bad-val 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3799: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:33:58.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:33:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:33:58.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:58.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:33:58.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:33:58.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:33:58.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:33:58.327 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:33:58.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:33:58.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:33:58.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:33:58.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:33:58.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:33:58.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:33:58.339 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:58.337+0000 7fc51bc33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:58.340 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:58.338+0000 7fc51bc33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:58.341 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:58.339+0000 7fc51bc33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:33:58.465 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:58.462+0000 7fc51bc33780 -1 Falling back to public interface 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:33:58.492 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:33:58.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:58.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:58.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:33:58.760 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:33:58.758+0000 7fc51bc33780 -1 osd.1 85 log_to_monitors true 2026-02-17T04:33:59.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:33:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:33:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:33:59.662 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:33:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:33:59.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 89 up_thru 89 down_at 86 last_clean_interval [77,85) [v2:127.0.0.1:6810/641522134,v1:127.0.0.1:6811/641522134] [v2:127.0.0.1:6812/641522134,v1:127.0.0.1:6813/641522134] exists,up dd138961-cf15-45aa-8c8e-aae7eada9b4d 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:33:59.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:33:59.829 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:33:59.829 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:33:59.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:33:59.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:33:59.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:33:59.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:33:59.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:33:59.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:33:59.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:33:59.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:33:59.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:00.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:00.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-17T04:34:00.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-17T04:34:00.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867' 2026-02-17T04:34:00.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:00.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:00.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089346 2026-02-17T04:34:00.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089346 2026-02-17T04:34:00.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-382252089346' 2026-02-17T04:34:00.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:00.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:00.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743431 2026-02-17T04:34:00.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743431 2026-02-17T04:34:00.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-382252089346 2-296352743431' 2026-02-17T04:34:00.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:00.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252867 2026-02-17T04:34:00.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:00.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:00.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252867 2026-02-17T04:34:00.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:00.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-17T04:34:00.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252867' 2026-02-17T04:34:00.261 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252867 2026-02-17T04:34:00.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:00.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252867 2026-02-17T04:34:00.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:01.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:01.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:01.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252868 -lt 360777252867 2026-02-17T04:34:01.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:01.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089346 2026-02-17T04:34:01.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:01.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:01.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089346 2026-02-17T04:34:01.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:01.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089346 2026-02-17T04:34:01.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089346' 2026-02-17T04:34:01.597 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089346 2026-02-17T04:34:01.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:01.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089346 -lt 382252089346 2026-02-17T04:34:01.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:01.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743431 2026-02-17T04:34:01.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:01.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:01.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743431 2026-02-17T04:34:01.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743431 2026-02-17T04:34:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743431' 2026-02-17T04:34:01.775 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743431 2026-02-17T04:34:01.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:01.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743432 -lt 296352743431 2026-02-17T04:34:01.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:01.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:01.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:02.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:02.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:02.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:02.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:02.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:02.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:02.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:02.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:02.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:02.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ7 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ7 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ7 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:34:02.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:34:02.743 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:34:02.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:34:02.947 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:34:02.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:34:02.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:34:02.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:34:02.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 7 % 2 2026-02-17T04:34:02.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:34:02.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:34:02.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3803: corrupt_scrub_erasure: local payload=MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-17T04:34:02.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3804: corrupt_scrub_erasure: echo MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-17T04:34:02.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3805: corrupt_scrub_erasure: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/DIFFERENT 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3808: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:34:02.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:03.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ1 get-attr hinfo_key 2026-02-17T04:34:03.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:03.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:03.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:34:03.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:34:03.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:34:03.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:34:03.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:34:03.202 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:03.200+0000 7fac89dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:03.203 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:03.202+0000 7fac89dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:03.204 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:03.202+0000 7fac89dd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:03.338 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:03.337+0000 7fac89dd6780 -1 Falling back to public interface 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:03.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:03.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:03.355 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:34:03.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:03.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:03.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:03.659 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:03.657+0000 7fac89dd6780 -1 osd.0 92 log_to_monitors true 2026-02-17T04:34:04.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:04.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:04.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:04.523 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:04.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:04.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:04.691 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 96 up_thru 96 down_at 93 last_clean_interval [84,92) [v2:127.0.0.1:6800/2413619613,v1:127.0.0.1:6801/2413619613] [v2:127.0.0.1:6802/2413619613,v1:127.0.0.1:6803/2413619613] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:04.692 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:04.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:04.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:04.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:04.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:04.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:04.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:04.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:04.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:04.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:04.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860418 2026-02-17T04:34:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860418 2026-02-17T04:34:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418' 2026-02-17T04:34:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:05.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:05.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089348 2026-02-17T04:34:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089348 2026-02-17T04:34:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348' 2026-02-17T04:34:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:05.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:05.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743433 2026-02-17T04:34:05.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743433 2026-02-17T04:34:05.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348 2-296352743433' 2026-02-17T04:34:05.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:05.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-412316860418 2026-02-17T04:34:05.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:05.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-412316860418 2026-02-17T04:34:05.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:05.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=412316860418 2026-02-17T04:34:05.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 412316860418' 2026-02-17T04:34:05.131 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 412316860418 2026-02-17T04:34:05.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:05.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860418 -lt 412316860418 2026-02-17T04:34:05.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:05.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089348 2026-02-17T04:34:05.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:05.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:05.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089348 2026-02-17T04:34:05.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:05.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089348 2026-02-17T04:34:05.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089348' 2026-02-17T04:34:05.297 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089348 2026-02-17T04:34:05.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:05.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089348 -lt 382252089348 2026-02-17T04:34:05.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:05.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743433 2026-02-17T04:34:05.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:05.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:05.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743433 2026-02-17T04:34:05.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:05.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743433 2026-02-17T04:34:05.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743433' 2026-02-17T04:34:05.470 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743433 2026-02-17T04:34:05.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:05.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743432 -lt 296352743433 2026-02-17T04:34:05.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:06.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:06.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:06.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743432 -lt 296352743433 2026-02-17T04:34:06.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:07.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:34:07.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:07.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743434 -lt 296352743433 2026-02-17T04:34:07.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:07.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:07.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:08.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:08.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:08.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:08.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:08.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:08.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3809: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:34:08.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:08.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:08.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:08.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:08.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:08.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:34:08.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:08.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:34:08.815 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:34:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:34:08.826 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:08.824+0000 7f8ebf7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:08.827 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:08.825+0000 7f8ebf7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:08.828 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:08.826+0000 7f8ebf7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:08.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:08.950+0000 7f8ebf7fd780 -1 Falling back to public interface 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:08.980 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:34:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:09.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:09.290 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:09.288+0000 7f8ebf7fd780 -1 osd.0 97 log_to_monitors true 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:10.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 101 up_thru 101 down_at 98 last_clean_interval [96,97) [v2:127.0.0.1:6800/1434037413,v1:127.0.0.1:6801/1434037413] [v2:127.0.0.1:6802/1434037413,v1:127.0.0.1:6803/1434037413] exists,up 5e1cc309-58e2-4a1e-9ed4-0e3bc7c718cd 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:10.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:10.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:10.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:10.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:10.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696898 2026-02-17T04:34:10.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696898 2026-02-17T04:34:10.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898' 2026-02-17T04:34:10.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:10.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:10.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089350 2026-02-17T04:34:10.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089350 2026-02-17T04:34:10.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898 1-382252089350' 2026-02-17T04:34:10.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:10.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:10.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743436 2026-02-17T04:34:10.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743436 2026-02-17T04:34:10.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898 1-382252089350 2-296352743436' 2026-02-17T04:34:10.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:10.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696898 2026-02-17T04:34:10.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:10.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:10.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696898 2026-02-17T04:34:10.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:10.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696898 2026-02-17T04:34:10.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696898' 2026-02-17T04:34:10.753 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 433791696898 2026-02-17T04:34:10.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:10.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860418 -lt 433791696898 2026-02-17T04:34:10.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:11.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:11.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:12.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696898 -lt 433791696898 2026-02-17T04:34:12.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:12.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089350 2026-02-17T04:34:12.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:12.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:12.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089350 2026-02-17T04:34:12.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:12.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089350 2026-02-17T04:34:12.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089350' 2026-02-17T04:34:12.091 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089350 2026-02-17T04:34:12.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:12.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089350 -lt 382252089350 2026-02-17T04:34:12.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:12.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743436 2026-02-17T04:34:12.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:12.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:12.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743436 2026-02-17T04:34:12.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:12.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743436 2026-02-17T04:34:12.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743436' 2026-02-17T04:34:12.261 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743436 2026-02-17T04:34:12.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:12.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743436 -lt 296352743436 2026-02-17T04:34:12.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:12.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:12.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:12.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:12.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:12.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:12.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:12.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:13.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:13.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3810: corrupt_scrub_erasure: rm -f td/osd-scrub-repair/hinfo 2026-02-17T04:34:13.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: get_pg ecpool EOBJ0 2026-02-17T04:34:13.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:34:13.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=EOBJ0 2026-02-17T04:34:13.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool EOBJ0 2026-02-17T04:34:13.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:34:13.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: local pg=3.0 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3818: corrupt_scrub_erasure: pg_scrub 3.0 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:13.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:34:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:34:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:34:13.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:34:13.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:13.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:13.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:13.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696899 2026-02-17T04:34:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696899 2026-02-17T04:34:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696899' 2026-02-17T04:34:13.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:13.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:13.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089351 2026-02-17T04:34:13.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089351 2026-02-17T04:34:13.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696899 1-382252089351' 2026-02-17T04:34:13.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:13.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:13.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743437 2026-02-17T04:34:13.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743437 2026-02-17T04:34:13.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696899 1-382252089351 2-296352743437' 2026-02-17T04:34:13.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:13.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696899 2026-02-17T04:34:13.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:13.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:13.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696899 2026-02-17T04:34:13.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:13.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696899 2026-02-17T04:34:13.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696899' 2026-02-17T04:34:13.757 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 433791696899 2026-02-17T04:34:13.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:13.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696898 -lt 433791696899 2026-02-17T04:34:13.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:14.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:14.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:15.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696898 -lt 433791696899 2026-02-17T04:34:15.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:16.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:34:16.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:16.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696900 -lt 433791696899 2026-02-17T04:34:16.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:16.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089351 2026-02-17T04:34:16.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:16.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:16.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089351 2026-02-17T04:34:16.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:16.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089351 2026-02-17T04:34:16.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089351' 2026-02-17T04:34:16.271 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 382252089351 2026-02-17T04:34:16.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:16.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089352 -lt 382252089351 2026-02-17T04:34:16.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:16.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743437 2026-02-17T04:34:16.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:16.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:16.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743437 2026-02-17T04:34:16.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:16.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743437 2026-02-17T04:34:16.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743437' 2026-02-17T04:34:16.440 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 296352743437 2026-02-17T04:34:16.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:16.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743437 -lt 296352743437 2026-02-17T04:34:16.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:34:16.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:34:16.609 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:34:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:34:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:34:16.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:34:16.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:34:16.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:34:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:34:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:34:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:34:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:34:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:34:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:34:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:34:16.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:16.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:34:16.991 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0s0 on osd.1 to scrub 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:34:17.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:17.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:34:17.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:17.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:34:17.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:33:14.693649+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:17.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:34:18.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:34:18.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:18.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:34:18.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:18.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:34:18.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:18.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:34:18.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:33:14.693649+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:18.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:34:19.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:34:19.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:19.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:34:19.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:19.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:34:19.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:19.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:34:19.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:17.661954+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:19.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:34:19.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3820: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-17T04:34:19.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:34:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: test 1 = 1 2026-02-17T04:34:19.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:34:19.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-17T04:34:19.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3826: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-17T04:34:19.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:34:19.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: epoch=101 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:34:19.537 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:34:19.538 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:34:19.538 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:34:19.538 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:34:19.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:34:19.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:34:19.551 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:34:19.552 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:34:19.552 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:34:19.552 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:34:19.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:34:19.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:34:19.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4459: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:34:19.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:34:19.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4460: corrupt_scrub_erasure: test no = yes 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4465: corrupt_scrub_erasure: test '' = yes 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4470: corrupt_scrub_erasure: pg_deep_scrub 3.0 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:19.567 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:19.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:19.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:19.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:19.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:34:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:34:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:34:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:34:19.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:19.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:19.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:20.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696902 2026-02-17T04:34:20.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696902 2026-02-17T04:34:20.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902' 2026-02-17T04:34:20.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:20.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:20.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089354 2026-02-17T04:34:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089354 2026-02-17T04:34:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902 1-382252089354' 2026-02-17T04:34:20.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:20.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:20.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743439 2026-02-17T04:34:20.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743439 2026-02-17T04:34:20.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902 1-382252089354 2-296352743439' 2026-02-17T04:34:20.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:20.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696902 2026-02-17T04:34:20.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:20.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:20.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696902 2026-02-17T04:34:20.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:20.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696902 2026-02-17T04:34:20.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696902' 2026-02-17T04:34:20.133 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 433791696902 2026-02-17T04:34:20.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696900 -lt 433791696902 2026-02-17T04:34:20.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:21.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:21.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696902 -lt 433791696902 2026-02-17T04:34:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:21.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089354 2026-02-17T04:34:21.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:21.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:21.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089354 2026-02-17T04:34:21.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:21.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089354 2026-02-17T04:34:21.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089354' 2026-02-17T04:34:21.474 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 382252089354 2026-02-17T04:34:21.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:21.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089354 -lt 382252089354 2026-02-17T04:34:21.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:21.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743439 2026-02-17T04:34:21.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:21.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:21.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743439 2026-02-17T04:34:21.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743439 2026-02-17T04:34:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743439' 2026-02-17T04:34:21.647 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 296352743439 2026-02-17T04:34:21.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743440 -lt 296352743439 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:34:21.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:34:21.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:21.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:34:21.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:21.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:34:22.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:22.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:34:22.202 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0s0 on osd.1 to deep-scrub 2026-02-17T04:34:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:33:14.693649+0000 last_deep_scrub_stamp 2026-02-17T04:34:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:34:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:34:22.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:22.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:34:22.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:33:14.693649+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:22.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:34:23.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:34:23.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:23.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:34:23.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:23.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:34:23.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:23.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:34:23.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:33:14.693649+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:23.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:34:24.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:34:24.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:24.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:34:24.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:24.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:34:24.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:24.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:34:24.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:33:14.693649+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:24.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:34:25.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:34:25.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:34:25.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:34:25.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:34:25.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:34:25.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:34:25.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:34:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:22.687288+0000 '>' 2026-02-17T04:33:14.693649+0000 2026-02-17T04:34:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:34:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4472: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-17T04:34:25.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:34:25.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: test 1 = 1 2026-02-17T04:34:25.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:34:25.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-17T04:34:25.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4478: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-17T04:34:25.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4479: corrupt_scrub_erasure: cp td/osd-scrub-repair/json /tmp/rrr6.json 2026-02-17T04:34:25.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:34:25.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: epoch=101 2026-02-17T04:34:25.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4483: corrupt_scrub_erasure: '[' false = true ']' 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:34:25.933 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:34:25.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:34:25.946 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:34:25.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:34:25.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5891: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:34:25.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:34:25.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5892: corrupt_scrub_erasure: test no = yes 2026-02-17T04:34:25.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5903: corrupt_scrub_erasure: test '' = yes 2026-02-17T04:34:25.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5908: corrupt_scrub_erasure: ceph osd pool rm ecpool ecpool --yes-i-really-really-mean-it 2026-02-17T04:34:26.197 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' removed 2026-02-17T04:34:26.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:34:26.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:26.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:26.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:26.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:34:26.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:34:26.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:34:26.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:34:26.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:34:26.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:34:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:34:26.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:34:26.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:34:26.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:34:26.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:34:26.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:34:26.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:34:26.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:34:26.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:34:26.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:26.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:26.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:34:26.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:34:26.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:34:26.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:34:26.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:34:26.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:34:26.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:34:26.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:34:26.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:34:26.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:34:26.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:34:26.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:34:26.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:34:26.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:34:26.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:34:26.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:34:26.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:34:26.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:34:26.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:34:26.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:34:26.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_erasure_overwrites td/osd-scrub-repair 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5916: TEST_corrupt_scrub_erasure_overwrites: '[' true = true ']' 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5917: TEST_corrupt_scrub_erasure_overwrites: corrupt_scrub_erasure td/osd-scrub-repair true 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3736: corrupt_scrub_erasure: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3737: corrupt_scrub_erasure: local allow_overwrites=true 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3738: corrupt_scrub_erasure: local poolname=ecpool 2026-02-17T04:34:26.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3739: corrupt_scrub_erasure: local total_objs=7 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3741: corrupt_scrub_erasure: run_mon td/osd-scrub-repair a 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:34:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:34:26.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:34:26.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:26.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:26.379 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:26.379 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.379 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:26.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:34:26.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:34:26.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:34:26.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:34:26.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:34:26.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:34:26.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.405 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:34:26.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:34:26.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:34:26.450 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:34:26.451 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:34:26.451 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.452 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.452 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:34:26.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:34:26.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:34:26.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3742: corrupt_scrub_erasure: run_mgr td/osd-scrub-repair x 2026-02-17T04:34:26.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:34:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:34:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:34:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:34:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.577 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:26.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:34:26.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:34:26.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: seq 0 2 2026-02-17T04:34:26.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:34:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 0 2026-02-17T04:34:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:34:26.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:26.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:26.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:26.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:34:26.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:34:26.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:34:26.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:34:26.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:34:26.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 db3c1e19-a330-4e9b-8119-05b9a78ea285' 2026-02-17T04:34:26.610 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:34:26.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:34:26.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDS75NpfWQ0JBAAXc96AI+NFSfn5Gd86lUDDA== 2026-02-17T04:34:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDS75NpfWQ0JBAAXc96AI+NFSfn5Gd86lUDDA=="}' 2026-02-17T04:34:26.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db3c1e19-a330-4e9b-8119-05b9a78ea285 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:34:26.688 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:34:26.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:34:26.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDS75NpfWQ0JBAAXc96AI+NFSfn5Gd86lUDDA== --osd-uuid db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:34:26.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:26.712+0000 7f4ba744a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:26.714 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:26.714+0000 7f4ba744a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:26.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:26.715+0000 7f4ba744a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:26.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:26.715+0000 7f4ba744a780 -1 bdev(0x3df6c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:34:26.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:26.715+0000 7f4ba744a780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:34:27.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:34:27.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:34:27.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:34:27.168 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:34:27.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:34:27.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:34:27.254 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:34:27.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:27.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:34:27.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:34:27.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:34:27.268 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:27.267+0000 7f5158a45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:27.269 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:27.268+0000 7f5158a45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:27.270 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:27.269+0000 7f5158a45780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:27.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:34:27.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:27.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:34:27.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:27.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:27.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:27.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:27.335 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:34:27.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:27.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:27.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:27.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:27.467+0000 7f5158a45780 -1 Falling back to public interface 2026-02-17T04:34:27.818 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:27.817+0000 7f5158a45780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:28.496 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3216973672,v1:127.0.0.1:6801/3216973672] [v2:127.0.0.1:6802/3216973672,v1:127.0.0.1:6803/3216973672] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 1 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:34:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:28.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:28.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:34:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:28.505 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:28.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b0e2e379-6a4c-46a0-8a9f-942b7a7a104a' 2026-02-17T04:34:28.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:34:28.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDU75NpJjBTHhAAGELAJnhPIZbGOVZKgnuleQ== 2026-02-17T04:34:28.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDU75NpJjBTHhAAGELAJnhPIZbGOVZKgnuleQ=="}' 2026-02-17T04:34:28.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b0e2e379-6a4c-46a0-8a9f-942b7a7a104a -i td/osd-scrub-repair/1/new.json 2026-02-17T04:34:28.590 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:34:28.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:34:28.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDU75NpJjBTHhAAGELAJnhPIZbGOVZKgnuleQ== --osd-uuid b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:28.616 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:28.615+0000 7f08c3c61780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:28.617 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:28.616+0000 7f08c3c61780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:28.618 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:28.617+0000 7f08c3c61780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:28.618 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:28.617+0000 7f08c3c61780 -1 bdev(0x267ec00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:34:28.619 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:28.617+0000 7f08c3c61780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:34:28.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:34:28.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:34:28.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:34:28.945 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:34:28.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:34:29.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:34:29.156 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:34:29.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:29.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:34:29.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:34:29.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:34:29.170 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:29.169+0000 7ff78e9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:29.171 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:29.170+0000 7ff78e9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:29.172 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:29.171+0000 7ff78e9fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:29.301 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:29.300+0000 7ff78e9fd780 -1 Falling back to public interface 2026-02-17T04:34:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:34:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:34:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:29.326 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:34:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:29.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:29.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:29.577 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:29.576+0000 7ff78e9fd780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:34:30.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:30.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:30.492 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:34:30.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:30.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:30.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:30.657 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1861216006,v1:127.0.0.1:6811/1861216006] [v2:127.0.0.1:6812/1861216006,v1:127.0.0.1:6813/1861216006] exists,up b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:30.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:30.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:30.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 2 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:30.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:30.663 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:30.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:34:30.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5df940cc-3d81-4e4a-a09b-6244378b9911' 2026-02-17T04:34:30.666 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:34:30.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:34:30.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDW75NpwnbuJxAAzBUlwNJlF6ONMO1wBhz8xA== 2026-02-17T04:34:30.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDW75NpwnbuJxAAzBUlwNJlF6ONMO1wBhz8xA=="}' 2026-02-17T04:34:30.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5df940cc-3d81-4e4a-a09b-6244378b9911 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:34:30.836 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:34:30.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:34:30.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDW75NpwnbuJxAAzBUlwNJlF6ONMO1wBhz8xA== --osd-uuid 5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:34:30.860 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:30.859+0000 7f3181032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:30.861 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:30.861+0000 7f3181032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:30.862 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:30.862+0000 7f3181032780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:30.863 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:30.862+0000 7f3181032780 -1 bdev(0x43aec00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:34:30.863 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:30.862+0000 7f3181032780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:34:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:34:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:34:31.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:34:31.182 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:34:31.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:34:31.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:34:31.400 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:34:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:34:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:34:31.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:34:31.414 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:31.413+0000 7f1762633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:31.415 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:31.414+0000 7f1762633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:31.416 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:31.415+0000 7f1762633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:34:31.619 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:31.618+0000 7f1762633780 -1 Falling back to public interface 2026-02-17T04:34:31.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:31.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:31.905+0000 7f1762633780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:34:32.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:32.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:32.735 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:34:32.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:32.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:32.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:34:32.903 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1304139587,v1:127.0.0.1:6819/1304139587] [v2:127.0.0.1:6820/1304139587,v1:127.0.0.1:6821/1304139587] exists,up 5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:34:32.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:32.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:32.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:32.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3746: corrupt_scrub_erasure: create_rbd_pool 2026-02-17T04:34:32.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:34:33.062 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:34:33.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:34:33.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:34:33.283 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:34:33.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:34:34.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:34:34.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3747: corrupt_scrub_erasure: create_pool foo 1 2026-02-17T04:34:34.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-17T04:34:34.773 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T04:34:34.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:34:35.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3749: corrupt_scrub_erasure: create_ec_pool ecpool true k=2 m=1 stripe_unit=2K --force 2026-02-17T04:34:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:34:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:34:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:34:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:34:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 stripe_unit=2K --force 2026-02-17T04:34:36.000 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:34:36.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:34:36.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:34:36.305 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:34:36.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:34:37.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:34:37.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:34:37.529 INFO:tasks.workunit.client.0.trial090.stderr:set pool 3 allow_ec_overwrites to true 2026-02-17T04:34:37.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:34:37.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:37.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:37.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:37.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:37.539 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:37.539 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:37.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:37.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:37.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:37.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:37.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:37.793 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:37.794 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:37.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:37.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:37.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:37.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:34:37.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:34:37.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:34:37.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:37.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:34:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:34:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-17T04:34:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:37.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:37.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:37.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:37.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:34:37.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:37.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:34:37.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:34:37.976 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:34:37.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:38.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:34:38.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:39.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:39.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:39.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:34:39.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:39.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:34:39.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:39.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:39.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:34:39.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:39.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:34:39.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:34:39.313 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:34:39.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:34:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:39.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:34:39.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:34:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:39.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:34:39.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:34:39.487 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:34:39.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:39.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-17T04:34:39.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:39.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:39.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:39.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:39.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:39.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:40.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:40.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:40.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:40.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:40.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3750: corrupt_scrub_erasure: wait_for_clean 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:40.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:40.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:40.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:40.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:40.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:40.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:40.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:40.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:40.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:40.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:40.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:34:40.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:34:40.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:34:40.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:40.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:40.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:34:40.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:34:40.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-17T04:34:40.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:40.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:40.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:34:40.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:34:40.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542148' 2026-02-17T04:34:40.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:40.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:34:40.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:40.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:40.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:34:40.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:40.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:34:40.685 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:34:40.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:34:40.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:40.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:34:40.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:40.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:34:40.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:40.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:40.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:34:40.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:40.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:34:40.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:34:40.855 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705668 2026-02-17T04:34:40.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:41.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T04:34:41.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:41.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:34:41.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:41.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:41.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:34:41.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:41.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:34:41.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:34:41.031 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542148 2026-02-17T04:34:41.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:41.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542148 2026-02-17T04:34:41.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:42.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:42.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:42.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542148 2026-02-17T04:34:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:43.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:34:43.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:43.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:34:43.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:43.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:43.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:43.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:43.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:43.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:43.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:43.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:43.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:44.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:44.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:44.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:44.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: seq 1 7 2026-02-17T04:34:44.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ1 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ1 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ1 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:34:44.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:34:44.335 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:34:44.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:34:44.539 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:34:44.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:34:44.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:34:44.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:34:44.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 1 % 2 2026-02-17T04:34:44.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:34:44.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:34:44.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3761: corrupt_scrub_erasure: local payload=UVWXYZZZ 2026-02-17T04:34:44.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3762: corrupt_scrub_erasure: echo UVWXYZZZ 2026-02-17T04:34:44.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3763: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:34:44.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:44.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:44.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:44.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:44.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:34:44.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:45.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:34:45.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:45.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:34:45.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:34:45.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:34:45.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:45.021 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:45.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:34:45.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:34:45.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:34:45.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:34:45.028 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:45.026+0000 7f1ac0c33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:45.030 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:45.028+0000 7f1ac0c33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:45.030 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:45.029+0000 7f1ac0c33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:45.181 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:34:45.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:45.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:45.221 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:45.219+0000 7f1ac0c33780 -1 Falling back to public interface 2026-02-17T04:34:45.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:45.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:45.516+0000 7f1ac0c33780 -1 osd.1 33 log_to_monitors true 2026-02-17T04:34:46.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:46.348 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:46.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 37 up_thru 37 down_at 34 last_clean_interval [9,33) [v2:127.0.0.1:6810/3994718161,v1:127.0.0.1:6811/3994718161] [v2:127.0.0.1:6812/3994718161,v1:127.0.0.1:6813/3994718161] exists,up b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:46.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:46.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:46.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:46.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:46.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:46.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:46.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:46.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:46.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:46.764 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:46.765 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:46.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:46.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:46.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:46.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:34:46.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:34:46.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:34:46.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:46.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:46.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789954 2026-02-17T04:34:46.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789954 2026-02-17T04:34:46.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-158913789954' 2026-02-17T04:34:46.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:46.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-158913789954 2-60129542150' 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:34:46.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:46.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:46.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:34:46.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:46.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:34:46.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:34:46.945 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T04:34:46.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:47.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:34:47.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:48.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:48.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:48.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:34:48.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:49.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:34:49.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:49.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:34:49.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:49.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-158913789954 2026-02-17T04:34:49.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:49.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:49.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789954 2026-02-17T04:34:49.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:49.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789954 2026-02-17T04:34:49.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 158913789954' 2026-02-17T04:34:49.452 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 158913789954 2026-02-17T04:34:49.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:49.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789954 -lt 158913789954 2026-02-17T04:34:49.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:49.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T04:34:49.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:49.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:49.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T04:34:49.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:49.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T04:34:49.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T04:34:49.621 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542150 2026-02-17T04:34:49.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:49.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-17T04:34:49.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:49.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:49.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:50.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:50.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:50.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:50.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:50.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:50.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:50.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ2 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ2 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:34:50.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ2 2026-02-17T04:34:50.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:34:50.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:34:50.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:34:50.604 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:34:50.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:34:50.810 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:34:50.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:34:50.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:34:50.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:34:50.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 2 % 2 2026-02-17T04:34:50.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:34:50.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:34:50.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3768: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=1 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:2048 bytes (2.0 kB, 2.0 KiB) copied, 5.7367e-05 s, 35.7 MB/s 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3769: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:34:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:50.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:51.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:51.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:51.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:34:51.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:34:51.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:34:51.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:34:51.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:51.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:34:51.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:34:51.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:51.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:34:51.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:51.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:34:51.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:34:51.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:34:51.314 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:51.312+0000 7f9e3fc2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:51.315 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:51.313+0000 7f9e3fc2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:51.316 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:51.314+0000 7f9e3fc2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:51.453 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:51.451+0000 7f9e3fc2b780 -1 Falling back to public interface 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:51.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:51.465 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:34:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:51.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:51.726 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:51.724+0000 7f9e3fc2b780 -1 osd.0 40 log_to_monitors true 2026-02-17T04:34:52.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:52.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:52.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:52.634 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:52.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:52.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:34:52.800 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 44 up_thru 44 down_at 41 last_clean_interval [5,40) [v2:127.0.0.1:6800/3906835619,v1:127.0.0.1:6801/3906835619] [v2:127.0.0.1:6802/3906835619,v1:127.0.0.1:6803/3906835619] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:52.801 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:52.802 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:52.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:52.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:52.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:52.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:52.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:52.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:53.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:53.055 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:53.055 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:53.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:53.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:53.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-17T04:34:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-17T04:34:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026' 2026-02-17T04:34:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:53.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:53.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789956 2026-02-17T04:34:53.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789956 2026-02-17T04:34:53.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026 1-158913789956' 2026-02-17T04:34:53.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:53.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:53.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T04:34:53.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T04:34:53.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026 1-158913789956 2-60129542153' 2026-02-17T04:34:53.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:53.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561026 2026-02-17T04:34:53.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:53.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:53.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561026 2026-02-17T04:34:53.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:53.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-17T04:34:53.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561026' 2026-02-17T04:34:53.236 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 188978561026 2026-02-17T04:34:53.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:53.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 188978561026 2026-02-17T04:34:53.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:54.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:34:54.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:54.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 188978561026 2026-02-17T04:34:54.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:34:55.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:34:55.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-17T04:34:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:55.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-158913789956 2026-02-17T04:34:55.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:55.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:34:55.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789956 2026-02-17T04:34:55.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:55.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789956 2026-02-17T04:34:55.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 158913789956' 2026-02-17T04:34:55.747 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 158913789956 2026-02-17T04:34:55.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:34:55.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-17T04:34:55.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:55.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T04:34:55.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:55.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:34:55.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T04:34:55.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:55.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T04:34:55.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T04:34:55.919 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542153 2026-02-17T04:34:55.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:34:56.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T04:34:56.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:34:56.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:56.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:56.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:34:56.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:34:56.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:34:56.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:34:56.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:34:56.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ3 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ3 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ3 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:34:56.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:34:56.851 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:34:56.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:34:57.053 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:34:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:34:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:34:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:34:57.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 3 % 2 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3774: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:34:57.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:34:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ3 remove 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:34:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ3 remove 2026-02-17T04:34:57.475 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#3:b197b25d:::EOBJ3:head# 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:34:57.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:34:57.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:34:57.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:34:57.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:34:57.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:34:57.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:34:57.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:34:57.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:34:57.535 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:57.533+0000 7f6e52e3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:57.536 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:57.534+0000 7f6e52e3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:57.537 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:57.535+0000 7f6e52e3b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:34:57.678 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:57.676+0000 7f6e52e3b780 -1 Falling back to public interface 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:34:57.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:57.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:34:57.687 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:34:57.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:57.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:57.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:34:57.963 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:34:57.961+0000 7f6e52e3b780 -1 osd.1 48 log_to_monitors true 2026-02-17T04:34:58.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:34:58.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:34:58.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:34:58.851 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:58.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:34:58.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:34:59.014 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 49 last_clean_interval [37,48) [v2:127.0.0.1:6810/4152083693,v1:127.0.0.1:6811/4152083693] [v2:127.0.0.1:6812/4152083693,v1:127.0.0.1:6813/4152083693] exists,up b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:34:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:34:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:34:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:34:59.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:34:59.016 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:34:59.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:34:59.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:34:59.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:34:59.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:34:59.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:34:59.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:34:59.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:34:59.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:34:59.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:34:59.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:34:59.268 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:34:59.268 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:34:59.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:34:59.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:59.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:34:59.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561028 2026-02-17T04:34:59.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561028 2026-02-17T04:34:59.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028' 2026-02-17T04:34:59.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:59.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:34:59.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299394 2026-02-17T04:34:59.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299394 2026-02-17T04:34:59.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028 1-223338299394' 2026-02-17T04:34:59.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:34:59.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:34:59.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-17T04:34:59.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-17T04:34:59.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028 1-223338299394 2-60129542155' 2026-02-17T04:34:59.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:34:59.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561028 2026-02-17T04:34:59.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:34:59.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:34:59.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561028 2026-02-17T04:34:59.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:34:59.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561028 2026-02-17T04:34:59.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561028' 2026-02-17T04:34:59.450 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 188978561028 2026-02-17T04:34:59.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:34:59.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561027 -lt 188978561028 2026-02-17T04:34:59.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:00.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:00.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:00.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561028 -lt 188978561028 2026-02-17T04:35:00.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:00.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299394 2026-02-17T04:35:00.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:00.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:00.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299394 2026-02-17T04:35:00.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:00.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299394 2026-02-17T04:35:00.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299394' 2026-02-17T04:35:00.793 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 223338299394 2026-02-17T04:35:00.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:00.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299394 -lt 223338299394 2026-02-17T04:35:00.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:00.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-17T04:35:00.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:00.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:00.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-17T04:35:00.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:00.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-17T04:35:00.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-17T04:35:00.969 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542155 2026-02-17T04:35:00.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:01.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-17T04:35:01.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:01.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:01.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:01.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:01.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:01.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:01.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:01.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:01.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:01.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:01.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:01.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:01.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:35:01.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ4 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ4 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ4 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:35:01.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:35:01.946 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:35:01.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:35:02.151 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:35:02.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:35:02.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:35:02.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:35:02.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 4 % 2 2026-02-17T04:35:02.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:35:02.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:35:02.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3778: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key1-EOBJ4 val1-EOBJ4 2026-02-17T04:35:02.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3779: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key2-EOBJ4 val2-EOBJ4 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3782: corrupt_scrub_erasure: echo -n bad-val 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3783: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:02.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:35:02.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:02.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:02.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:02.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:02.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:35:02.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:02.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:35:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:02.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:35:02.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:02.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:35:02.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:35:02.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:02.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:02.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:02.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:02.489+0000 7f2430035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:02.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:02.490+0000 7f2430035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:02.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:02.491+0000 7f2430035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:02.626 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:02.624+0000 7f2430035780 -1 Falling back to public interface 2026-02-17T04:35:02.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:02.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:02.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:02.907 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:02.905+0000 7f2430035780 -1 osd.0 55 log_to_monitors true 2026-02-17T04:35:03.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:03.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:03.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:03.817 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:03.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:03.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:03.984 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 59 up_thru 59 down_at 56 last_clean_interval [44,55) [v2:127.0.0.1:6800/2877230195,v1:127.0.0.1:6801/2877230195] [v2:127.0.0.1:6802/2877230195,v1:127.0.0.1:6803/2877230195] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:35:03.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:03.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:03.985 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:03.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:03.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:03.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:04.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:04.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:04.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:04.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:04.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:04.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:04.245 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:04.245 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:04.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:04.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:04.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:04.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070466 2026-02-17T04:35:04.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070466 2026-02-17T04:35:04.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466' 2026-02-17T04:35:04.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:04.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:04.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299396 2026-02-17T04:35:04.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299396 2026-02-17T04:35:04.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466 1-223338299396' 2026-02-17T04:35:04.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:04.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:04.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-17T04:35:04.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-17T04:35:04.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466 1-223338299396 2-60129542157' 2026-02-17T04:35:04.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:04.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070466 2026-02-17T04:35:04.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:04.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:04.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070466 2026-02-17T04:35:04.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:04.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070466 2026-02-17T04:35:04.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070466' 2026-02-17T04:35:04.428 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 253403070466 2026-02-17T04:35:04.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:04.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561029 -lt 253403070466 2026-02-17T04:35:04.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:05.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:05.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070466 -lt 253403070466 2026-02-17T04:35:05.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:05.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299396 2026-02-17T04:35:05.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:05.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:05.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299396 2026-02-17T04:35:05.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299396 2026-02-17T04:35:05.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299396' 2026-02-17T04:35:05.764 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 223338299396 2026-02-17T04:35:05.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:05.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299396 -lt 223338299396 2026-02-17T04:35:05.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:05.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-17T04:35:05.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:05.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:05.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-17T04:35:05.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:05.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-17T04:35:05.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-17T04:35:05.934 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542157 2026-02-17T04:35:05.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:06.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542157 -lt 60129542157 2026-02-17T04:35:06.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:06.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:06.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:06.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:06.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:06.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:06.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:06.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:06.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:06.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3784: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:06.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:06.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:06.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:06.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:07.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:35:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-17T04:35:07.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:35:07.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:07.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:07.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:07.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:35:07.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:07.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:35:07.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:35:07.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:07.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:07.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:07.159 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:07.158+0000 7f2e92232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:07.161 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:07.159+0000 7f2e92232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:07.162 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:07.160+0000 7f2e92232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:07.283 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:07.282+0000 7f2e92232780 -1 Falling back to public interface 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:35:07.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:07.606 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:07.604+0000 7f2e92232780 -1 osd.2 60 log_to_monitors true 2026-02-17T04:35:08.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:08.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:08.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:08.484 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:08.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:08.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:35:08.649 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 64 up_thru 64 down_at 61 last_clean_interval [14,60) [v2:127.0.0.1:6818/2666101451,v1:127.0.0.1:6819/2666101451] [v2:127.0.0.1:6820/2666101451,v1:127.0.0.1:6821/2666101451] exists,up 5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:35:08.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:08.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:08.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:08.650 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:08.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:08.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:08.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:08.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:08.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:08.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:08.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:08.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:08.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:08.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:08.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070468 2026-02-17T04:35:08.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070468 2026-02-17T04:35:08.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468' 2026-02-17T04:35:08.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:08.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:09.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299398 2026-02-17T04:35:09.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299398 2026-02-17T04:35:09.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468 1-223338299398' 2026-02-17T04:35:09.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:09.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:09.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906946 2026-02-17T04:35:09.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906946 2026-02-17T04:35:09.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468 1-223338299398 2-274877906946' 2026-02-17T04:35:09.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:09.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070468 2026-02-17T04:35:09.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:09.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070468 2026-02-17T04:35:09.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:09.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070468 2026-02-17T04:35:09.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070468' 2026-02-17T04:35:09.080 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 253403070468 2026-02-17T04:35:09.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:09.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070468 2026-02-17T04:35:09.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:10.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:10.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:10.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070467 -lt 253403070468 2026-02-17T04:35:10.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:11.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:11.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:11.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070468 -lt 253403070468 2026-02-17T04:35:11.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:11.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299398 2026-02-17T04:35:11.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:11.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:11.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299398 2026-02-17T04:35:11.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:11.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299398 2026-02-17T04:35:11.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299398' 2026-02-17T04:35:11.589 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 223338299398 2026-02-17T04:35:11.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:11.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299398 -lt 223338299398 2026-02-17T04:35:11.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:11.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-274877906946 2026-02-17T04:35:11.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:11.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:11.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-274877906946 2026-02-17T04:35:11.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906946 2026-02-17T04:35:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 274877906946' 2026-02-17T04:35:11.759 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 274877906946 2026-02-17T04:35:11.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:11.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906946 -lt 274877906946 2026-02-17T04:35:11.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:11.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:11.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:12.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:12.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:12.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:12.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:12.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:12.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:12.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:12.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:12.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:12.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3785: corrupt_scrub_erasure: echo -n val3-EOBJ4 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3786: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:12.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:35:12.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:12.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:35:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:35:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:12.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:12.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:12.778+0000 7f41f4fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:12.782 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:12.780+0000 7f41f4fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:12.782 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:12.781+0000 7f41f4fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:12.913 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:12.911+0000 7f41f4fe3780 -1 Falling back to public interface 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:12.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:35:13.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:13.190 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:13.188+0000 7f41f4fe3780 -1 osd.2 65 log_to_monitors true 2026-02-17T04:35:14.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:14.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:14.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:14.108 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:14.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:14.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [64,65) [v2:127.0.0.1:6818/1059146440,v1:127.0.0.1:6819/1059146440] [v2:127.0.0.1:6820/1059146440,v1:127.0.0.1:6821/1059146440] exists,up 5df940cc-3d81-4e4a-a09b-6244378b9911 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:14.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:14.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:14.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:14.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:14.531 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:14.531 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:14.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:14.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:14.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070470 2026-02-17T04:35:14.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070470 2026-02-17T04:35:14.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470' 2026-02-17T04:35:14.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:14.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:14.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299400 2026-02-17T04:35:14.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299400 2026-02-17T04:35:14.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470 1-223338299400' 2026-02-17T04:35:14.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:14.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:14.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-17T04:35:14.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-17T04:35:14.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470 1-223338299400 2-296352743426' 2026-02-17T04:35:14.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:14.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070470 2026-02-17T04:35:14.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:14.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070470 2026-02-17T04:35:14.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070470 2026-02-17T04:35:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070470' 2026-02-17T04:35:14.713 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 253403070470 2026-02-17T04:35:14.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:14.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070470 -lt 253403070470 2026-02-17T04:35:14.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:14.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299400 2026-02-17T04:35:14.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:14.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:14.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299400 2026-02-17T04:35:14.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:14.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299400 2026-02-17T04:35:14.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299400' 2026-02-17T04:35:14.883 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 223338299400 2026-02-17T04:35:14.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:15.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299399 -lt 223338299400 2026-02-17T04:35:15.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:16.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:16.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:16.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299399 -lt 223338299400 2026-02-17T04:35:16.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:17.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:17.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:17.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299400 -lt 223338299400 2026-02-17T04:35:17.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:17.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743426 2026-02-17T04:35:17.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:17.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:17.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743426 2026-02-17T04:35:17.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:17.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-17T04:35:17.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743426' 2026-02-17T04:35:17.389 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743426 2026-02-17T04:35:17.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:17.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743426 -lt 296352743426 2026-02-17T04:35:17.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:17.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:17.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:17.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:17.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:17.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:17.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:17.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:17.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:18.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:18.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:18.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:18.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3787: corrupt_scrub_erasure: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-17T04:35:18.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ5 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ5 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ5 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:35:18.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:35:18.354 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:35:18.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:35:18.559 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:35:18.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:35:18.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:35:18.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:35:18.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 5 % 2 2026-02-17T04:35:18.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:35:18.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:35:18.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3792: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=2 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records in 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records out 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 8.4066e-05 s, 48.7 MB/s 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3793: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:35:18.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:18.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:18.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:35:18.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:18.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:18.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:35:18.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:18.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:35:18.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:19.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:19.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:19.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:19.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:35:19.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:35:19.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:19.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:19.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:19.048 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:19.046+0000 7f3c19bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:19.049 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:19.047+0000 7f3c19bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:19.050 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:19.048+0000 7f3c19bd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:19.189 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:19.186+0000 7f3c19bd8780 -1 Falling back to public interface 2026-02-17T04:35:19.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:35:19.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:19.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:35:19.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:19.494 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:19.492+0000 7f3c19bd8780 -1 osd.1 73 log_to_monitors true 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:20.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [52,73) [v2:127.0.0.1:6810/3352418825,v1:127.0.0.1:6811/3352418825] [v2:127.0.0.1:6812/3352418825,v1:127.0.0.1:6813/3352418825] exists,up b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:20.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:20.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:20.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:20.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:20.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:20.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:20.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:20.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:20.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:20.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:20.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:20.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070472 2026-02-17T04:35:20.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070472 2026-02-17T04:35:20.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472' 2026-02-17T04:35:20.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:20.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:20.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-17T04:35:20.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-17T04:35:20.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472 1-330712481794' 2026-02-17T04:35:20.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:20.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:20.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743428 2026-02-17T04:35:20.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743428 2026-02-17T04:35:20.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472 1-330712481794 2-296352743428' 2026-02-17T04:35:20.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:20.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070472 2026-02-17T04:35:20.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:20.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:20.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070472 2026-02-17T04:35:20.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:20.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070472 2026-02-17T04:35:20.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070472' 2026-02-17T04:35:20.978 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 253403070472 2026-02-17T04:35:20.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:21.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070471 -lt 253403070472 2026-02-17T04:35:21.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:22.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:22.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070471 -lt 253403070472 2026-02-17T04:35:22.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:23.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:23.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:23.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070472 -lt 253403070472 2026-02-17T04:35:23.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:23.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481794 2026-02-17T04:35:23.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:23.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:23.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481794 2026-02-17T04:35:23.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:23.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-17T04:35:23.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481794' 2026-02-17T04:35:23.490 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 330712481794 2026-02-17T04:35:23.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:23.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481794 -lt 330712481794 2026-02-17T04:35:23.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:23.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743428 2026-02-17T04:35:23.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:23.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:23.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743428 2026-02-17T04:35:23.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:23.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743428 2026-02-17T04:35:23.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743428' 2026-02-17T04:35:23.662 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743428 2026-02-17T04:35:23.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:23.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743428 -lt 296352743428 2026-02-17T04:35:23.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:23.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:23.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:24.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:24.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:24.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:24.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:24.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:24.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:24.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ6 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ6 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:35:24.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:35:24.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ6 2026-02-17T04:35:24.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:35:24.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:35:24.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:35:24.636 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:35:24.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:35:24.841 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:35:24.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:35:24.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:35:24.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:35:24.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 6 % 2 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3797: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:35:24.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:25.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ6 rm-attr hinfo_key 2026-02-17T04:35:25.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:25.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:25.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:35:25.318 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:35:25.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:25.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:35:25.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:35:25.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:25.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:25.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:25.330 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:25.329+0000 7fbab2a85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:25.332 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:25.330+0000 7fbab2a85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:25.333 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:25.331+0000 7fbab2a85780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:25.458 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:25.457+0000 7fbab2a85780 -1 Falling back to public interface 2026-02-17T04:35:25.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:35:25.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:25.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:35:25.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:25.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:25.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:25.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:25.480 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:25.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:25.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:25.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:25.762 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:25.760+0000 7fbab2a85780 -1 osd.0 80 log_to_monitors true 2026-02-17T04:35:26.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:26.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:26.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:26.650 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:26.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:26.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:26.823 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [59,80) [v2:127.0.0.1:6800/237161605,v1:127.0.0.1:6801/237161605] [v2:127.0.0.1:6802/237161605,v1:127.0.0.1:6803/237161605] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:35:26.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:26.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:26.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:26.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:26.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:26.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:26.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:26.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:26.825 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:26.825 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:26.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:26.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:26.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:26.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:27.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:27.079 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:27.080 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:27.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:27.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:27.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:27.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-17T04:35:27.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-17T04:35:27.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866' 2026-02-17T04:35:27.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:27.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:27.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481796 2026-02-17T04:35:27.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481796 2026-02-17T04:35:27.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796' 2026-02-17T04:35:27.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:27.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:27.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743430 2026-02-17T04:35:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743430 2026-02-17T04:35:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796 2-296352743430' 2026-02-17T04:35:27.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:27.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252866 2026-02-17T04:35:27.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:27.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:27.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252866 2026-02-17T04:35:27.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-17T04:35:27.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252866' 2026-02-17T04:35:27.263 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252866 2026-02-17T04:35:27.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:27.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 360777252866 2026-02-17T04:35:27.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:28.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:28.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:28.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 360777252866 2026-02-17T04:35:28.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:29.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:29.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:29.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252866 2026-02-17T04:35:29.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481796 2026-02-17T04:35:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:29.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:29.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481796 2026-02-17T04:35:29.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:29.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481796 2026-02-17T04:35:29.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481796' 2026-02-17T04:35:29.773 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 330712481796 2026-02-17T04:35:29.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:29.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481796 -lt 330712481796 2026-02-17T04:35:29.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:29.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743430 2026-02-17T04:35:29.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:29.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:29.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743430 2026-02-17T04:35:29.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:29.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743430 2026-02-17T04:35:29.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743430' 2026-02-17T04:35:29.948 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743430 2026-02-17T04:35:29.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:30.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743431 -lt 296352743430 2026-02-17T04:35:30.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:30.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:30.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:30.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:30.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:30.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:30.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:30.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:30.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:30.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:30.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3798: corrupt_scrub_erasure: echo -n bad-val 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3799: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:30.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:30.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:35:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:31.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:31.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:35:31.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:31.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:35:31.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:35:31.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:31.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:31.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:31.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:35:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:35:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:31.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:31.173 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:31.172+0000 7f8855e34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:31.174 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:31.173+0000 7f8855e34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:31.175 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:31.174+0000 7f8855e34780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:31.314 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:31.313+0000 7f8855e34780 -1 Falling back to public interface 2026-02-17T04:35:31.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:35:31.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:31.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:35:31.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:35:31.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:31.607 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:31.606+0000 7f8855e34780 -1 osd.1 85 log_to_monitors true 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:32.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 89 up_thru 89 down_at 86 last_clean_interval [77,85) [v2:127.0.0.1:6810/3319258111,v1:127.0.0.1:6811/3319258111] [v2:127.0.0.1:6812/3319258111,v1:127.0.0.1:6813/3319258111] exists,up b0e2e379-6a4c-46a0-8a9f-942b7a7a104a 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:32.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:32.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:32.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:32.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:32.670 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:32.670 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:32.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:32.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:32.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:32.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:32.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:32.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:32.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:32.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:32.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:32.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:32.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252868 2026-02-17T04:35:32.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252868 2026-02-17T04:35:32.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252868' 2026-02-17T04:35:32.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:32.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:33.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089346 2026-02-17T04:35:33.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089346 2026-02-17T04:35:33.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252868 1-382252089346' 2026-02-17T04:35:33.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:33.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:33.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743432 2026-02-17T04:35:33.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743432 2026-02-17T04:35:33.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252868 1-382252089346 2-296352743432' 2026-02-17T04:35:33.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:33.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252868 2026-02-17T04:35:33.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:33.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:33.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252868 2026-02-17T04:35:33.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:33.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252868 2026-02-17T04:35:33.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252868' 2026-02-17T04:35:33.106 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252868 2026-02-17T04:35:33.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252868 2026-02-17T04:35:33.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:34.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:34.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252868 2026-02-17T04:35:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:35.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:35.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:35.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252868 -lt 360777252868 2026-02-17T04:35:35.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:35.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089346 2026-02-17T04:35:35.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:35.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:35.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089346 2026-02-17T04:35:35.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:35.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089346 2026-02-17T04:35:35.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089346' 2026-02-17T04:35:35.616 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089346 2026-02-17T04:35:35.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089346 -lt 382252089346 2026-02-17T04:35:35.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:35.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743432 2026-02-17T04:35:35.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:35.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:35.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743432 2026-02-17T04:35:35.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:35.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743432 2026-02-17T04:35:35.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743432' 2026-02-17T04:35:35.787 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743432 2026-02-17T04:35:35.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:35.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743433 -lt 296352743432 2026-02-17T04:35:35.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:35.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:35.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:36.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:36.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:36.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:36.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:36.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:36.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:36.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:36.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:36.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ7 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ7 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ7 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:35:36.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:35:36.801 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:35:36.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:35:37.003 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:35:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:35:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:35:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:35:37.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 7 % 2 2026-02-17T04:35:37.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-17T04:35:37.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-17T04:35:37.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3803: corrupt_scrub_erasure: local payload=MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-17T04:35:37.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3804: corrupt_scrub_erasure: echo MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-17T04:35:37.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3805: corrupt_scrub_erasure: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/DIFFERENT 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3808: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:35:37.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:37.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:37.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:37.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:37.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-17T04:35:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:37.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:35:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:37.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ1 get-attr hinfo_key 2026-02-17T04:35:37.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:35:37.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:35:37.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:37.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:37.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:35:37.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:35:37.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:37.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:37.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:37.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:37.255+0000 7f2a805e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:37.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:37.257+0000 7f2a805e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:37.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:37.258+0000 7f2a805e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:37.379 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:37.378+0000 7f2a805e3780 -1 Falling back to public interface 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:37.412 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:37.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:37.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:37.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:37.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:37.675+0000 7f2a805e3780 -1 osd.0 92 log_to_monitors true 2026-02-17T04:35:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:38.577 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:38.742 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 96 up_thru 96 down_at 93 last_clean_interval [84,92) [v2:127.0.0.1:6800/2236932142,v1:127.0.0.1:6801/2236932142] [v2:127.0.0.1:6802/2236932142,v1:127.0.0.1:6803/2236932142] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:35:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:38.743 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:38.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:38.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:38.999 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:39.000 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:39.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:39.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:39.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:39.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860418 2026-02-17T04:35:39.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860418 2026-02-17T04:35:39.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418' 2026-02-17T04:35:39.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:39.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089348 2026-02-17T04:35:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089348 2026-02-17T04:35:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348' 2026-02-17T04:35:39.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:39.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:39.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743435 2026-02-17T04:35:39.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743435 2026-02-17T04:35:39.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348 2-296352743435' 2026-02-17T04:35:39.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:39.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-412316860418 2026-02-17T04:35:39.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:39.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:39.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-412316860418 2026-02-17T04:35:39.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:39.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=412316860418 2026-02-17T04:35:39.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 412316860418' 2026-02-17T04:35:39.180 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 412316860418 2026-02-17T04:35:39.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:39.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 412316860418 2026-02-17T04:35:39.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:40.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:40.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:40.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 412316860418 2026-02-17T04:35:40.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:41.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:41.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:41.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860418 -lt 412316860418 2026-02-17T04:35:41.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:41.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089348 2026-02-17T04:35:41.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:41.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:41.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089348 2026-02-17T04:35:41.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:41.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089348 2026-02-17T04:35:41.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089348' 2026-02-17T04:35:41.690 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089348 2026-02-17T04:35:41.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:41.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089348 -lt 382252089348 2026-02-17T04:35:41.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:41.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743435 2026-02-17T04:35:41.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:41.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:41.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743435 2026-02-17T04:35:41.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:41.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743435 2026-02-17T04:35:41.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743435' 2026-02-17T04:35:41.860 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743435 2026-02-17T04:35:41.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:42.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743435 -lt 296352743435 2026-02-17T04:35:42.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:42.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:42.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:42.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:42.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:42.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:42.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:42.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:42.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:42.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:42.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:42.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:42.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:42.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:42.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:42.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3809: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:35:42.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:35:42.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:35:42.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:35:42.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:35:42.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:35:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:42.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-17T04:35:42.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:35:42.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:35:42.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:35:42.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:35:42.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:35:42.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:35:42.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:35:42.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:35:42.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:35:42.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:35:42.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:35:42.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:35:42.885 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:42.884+0000 7f9fefa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:42.887 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:42.886+0000 7f9fefa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:42.888 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:42.887+0000 7f9fefa3a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:35:43.034 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:43.033+0000 7f9fefa3a780 -1 Falling back to public interface 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:35:43.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:43.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:35:43.038 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:35:43.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:43.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:43.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:35:43.302 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:35:43.301+0000 7f9fefa3a780 -1 osd.0 98 log_to_monitors true 2026-02-17T04:35:44.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:35:44.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:35:44.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:35:44.206 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:44.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:35:44.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:35:44.371 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 102 up_thru 102 down_at 99 last_clean_interval [96,98) [v2:127.0.0.1:6800/3298006598,v1:127.0.0.1:6801/3298006598] [v2:127.0.0.1:6802/3298006598,v1:127.0.0.1:6803/3298006598] exists,up db3c1e19-a330-4e9b-8119-05b9a78ea285 2026-02-17T04:35:44.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:35:44.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:35:44.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:35:44.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:35:44.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:35:44.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:35:44.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:35:44.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:35:44.373 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:44.373 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:44.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:35:44.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:35:44.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:35:44.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:35:44.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:44.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:44.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:44.628 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:44.629 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:44.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:44.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:44.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664194 2026-02-17T04:35:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664194 2026-02-17T04:35:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664194' 2026-02-17T04:35:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:44.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:44.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089350 2026-02-17T04:35:44.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089350 2026-02-17T04:35:44.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664194 1-382252089350' 2026-02-17T04:35:44.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:44.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743437 2026-02-17T04:35:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743437 2026-02-17T04:35:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664194 1-382252089350 2-296352743437' 2026-02-17T04:35:44.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:44.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-438086664194 2026-02-17T04:35:44.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:44.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:44.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-438086664194 2026-02-17T04:35:44.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:44.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664194 2026-02-17T04:35:44.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 438086664194' 2026-02-17T04:35:44.810 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 438086664194 2026-02-17T04:35:44.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:44.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 438086664194 2026-02-17T04:35:44.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:45.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:45.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:46.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 438086664194 2026-02-17T04:35:46.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:47.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:47.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:47.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664194 -lt 438086664194 2026-02-17T04:35:47.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:47.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089350 2026-02-17T04:35:47.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:47.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:47.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089350 2026-02-17T04:35:47.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:47.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089350 2026-02-17T04:35:47.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089350' 2026-02-17T04:35:47.322 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 382252089350 2026-02-17T04:35:47.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:47.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089350 -lt 382252089350 2026-02-17T04:35:47.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:47.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743437 2026-02-17T04:35:47.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:47.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:47.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743437 2026-02-17T04:35:47.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:47.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743437 2026-02-17T04:35:47.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743437' 2026-02-17T04:35:47.492 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 296352743437 2026-02-17T04:35:47.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:47.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743437 -lt 296352743437 2026-02-17T04:35:47.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:35:47.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:47.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:47.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:35:47.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:35:47.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:35:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:35:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:35:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:35:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:35:48.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:35:48.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:35:48.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:35:48.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3810: corrupt_scrub_erasure: rm -f td/osd-scrub-repair/hinfo 2026-02-17T04:35:48.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: get_pg ecpool EOBJ0 2026-02-17T04:35:48.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:35:48.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=EOBJ0 2026-02-17T04:35:48.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool EOBJ0 2026-02-17T04:35:48.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:35:48.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: local pg=3.0 2026-02-17T04:35:48.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3818: corrupt_scrub_erasure: pg_scrub 3.0 2026-02-17T04:35:48.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:35:48.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:48.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:48.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:48.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:48.820 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:48.820 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:48.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664196 2026-02-17T04:35:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664196 2026-02-17T04:35:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664196' 2026-02-17T04:35:48.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:48.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:48.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089352 2026-02-17T04:35:48.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089352 2026-02-17T04:35:48.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664196 1-382252089352' 2026-02-17T04:35:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:48.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:35:48.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743439 2026-02-17T04:35:48.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743439 2026-02-17T04:35:48.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664196 1-382252089352 2-296352743439' 2026-02-17T04:35:48.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:48.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-438086664196 2026-02-17T04:35:49.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:49.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:35:49.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-438086664196 2026-02-17T04:35:49.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:49.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664196 2026-02-17T04:35:49.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 438086664196' 2026-02-17T04:35:49.003 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 438086664196 2026-02-17T04:35:49.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:49.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664196 2026-02-17T04:35:49.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:50.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:35:50.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:50.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664196 2026-02-17T04:35:50.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:35:51.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:35:51.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:35:51.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664196 -lt 438086664196 2026-02-17T04:35:51.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:51.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089352 2026-02-17T04:35:51.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:51.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:35:51.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089352 2026-02-17T04:35:51.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:51.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089352 2026-02-17T04:35:51.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089352' 2026-02-17T04:35:51.517 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 382252089352 2026-02-17T04:35:51.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:35:51.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089352 -lt 382252089352 2026-02-17T04:35:51.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:35:51.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743439 2026-02-17T04:35:51.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:35:51.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:35:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743439 2026-02-17T04:35:51.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:35:51.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743439 2026-02-17T04:35:51.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743439' 2026-02-17T04:35:51.691 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 296352743439 2026-02-17T04:35:51.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:35:51.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743439 -lt 296352743439 2026-02-17T04:35:51.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:35:51.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:35:51.860 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:35:51.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:35:51.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:35:51.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:35:51.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:35:51.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:51.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:51.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:52.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:52.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:35:52.241 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0s0 on osd.1 to scrub 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:52.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:52.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:52.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:52.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:53.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:53.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:53.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:53.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:53.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:53.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:53.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:53.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:53.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:54.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:54.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:54.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:54.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:54.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:54.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:54.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:54.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:54.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:55.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:55.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:55.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:55.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:55.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:55.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:55.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:55.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:55.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:56.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:56.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:56.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:56.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:56.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:56.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:56.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:57.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:57.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:58.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:58.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:58.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:58.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:58.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:58.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:58.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:58.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:58.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:35:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:35:59.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:35:59.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:35:59.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:35:59.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:35:59.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:35:59.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:35:59.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:35:52.653203+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:35:59.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:35:59.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3820: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-17T04:35:59.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:35:59.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: test 1 = 1 2026-02-17T04:35:59.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:35:59.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-17T04:35:59.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3826: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-17T04:35:59.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:35:59.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: epoch=102 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:35:59.461 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:35:59.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:35:59.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:35:59.476 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:35:59.476 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:35:59.476 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:35:59.476 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:35:59.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:35:59.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4459: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:35:59.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4460: corrupt_scrub_erasure: test no = yes 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4465: corrupt_scrub_erasure: test '' = yes 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4470: corrupt_scrub_erasure: pg_deep_scrub 3.0 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:35:59.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:35:59.493 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:35:59.493 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:35:59.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:35:59.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:35:59.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:35:59.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:35:59.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:35:59.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:35:59.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:35:59.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:35:59.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:35:59.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:35:59.876 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:35:59.876 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:35:59.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:35:59.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:59.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:35:59.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664199 2026-02-17T04:35:59.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664199 2026-02-17T04:35:59.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664199' 2026-02-17T04:35:59.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:59.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:35:59.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089355 2026-02-17T04:35:59.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089355 2026-02-17T04:35:59.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664199 1-382252089355' 2026-02-17T04:35:59.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:35:59.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:36:00.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743442 2026-02-17T04:36:00.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743442 2026-02-17T04:36:00.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-438086664199 1-382252089355 2-296352743442' 2026-02-17T04:36:00.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:00.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-438086664199 2026-02-17T04:36:00.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:00.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:00.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-438086664199 2026-02-17T04:36:00.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:00.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664199 2026-02-17T04:36:00.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 438086664199' 2026-02-17T04:36:00.062 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 438086664199 2026-02-17T04:36:00.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:00.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664198 -lt 438086664199 2026-02-17T04:36:00.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:01.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:01.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:01.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664199 -lt 438086664199 2026-02-17T04:36:01.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:01.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089355 2026-02-17T04:36:01.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:01.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:01.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089355 2026-02-17T04:36:01.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:01.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089355 2026-02-17T04:36:01.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089355' 2026-02-17T04:36:01.395 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 382252089355 2026-02-17T04:36:01.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:01.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089355 -lt 382252089355 2026-02-17T04:36:01.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:01.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743442 2026-02-17T04:36:01.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:01.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:36:01.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743442 2026-02-17T04:36:01.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:01.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743442 2026-02-17T04:36:01.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743442' 2026-02-17T04:36:01.569 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 296352743442 2026-02-17T04:36:01.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:36:01.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743442 -lt 296352743442 2026-02-17T04:36:01.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:36:01.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:36:01.738 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:36:01.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:36:01.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:36:01.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:36:01.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:36:01.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:36:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:36:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:36:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:36:01.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:36:01.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:01.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:01.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:01.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:01.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:01.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:01.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:36:02.121 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0s0 on osd.1 to deep-scrub 2026-02-17T04:36:02.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:34:36.303323+0000 last_deep_scrub_stamp 2026-02-17T04:36:02.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:02.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:02.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:02.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:03.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:03.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:03.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:03.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:03.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:03.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:03.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:03.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:03.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:04.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:04.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:04.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:04.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:04.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:04.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:04.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:04.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:04.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:05.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:05.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:05.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:05.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:05.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:05.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:05.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:05.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:06.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:06.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:06.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:06.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:06.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:06.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:06.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:06.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:06.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:07.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:07.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:07.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:07.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:07.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:07.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:07.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:08.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:34:36.303323+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:08.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:09.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:09.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:09.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:09.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:09.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:09.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:09.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:09.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:02.492205+0000 '>' 2026-02-17T04:34:36.303323+0000 2026-02-17T04:36:09.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:36:09.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4472: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-17T04:36:09.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:36:09.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: test 1 = 1 2026-02-17T04:36:09.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:36:09.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-17T04:36:09.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4478: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-17T04:36:09.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4479: corrupt_scrub_erasure: cp td/osd-scrub-repair/json /tmp/rrr6.json 2026-02-17T04:36:09.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:36:09.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: epoch=102 2026-02-17T04:36:09.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4483: corrupt_scrub_erasure: '[' true = true ']' 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:36:09.346 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:36:09.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:36:09.360 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq .inconsistents 2026-02-17T04:36:09.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:36:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5891: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:36:09.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:36:09.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5892: corrupt_scrub_erasure: test no = yes 2026-02-17T04:36:09.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5903: corrupt_scrub_erasure: test '' = yes 2026-02-17T04:36:09.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5908: corrupt_scrub_erasure: ceph osd pool rm ecpool ecpool --yes-i-really-really-mean-it 2026-02-17T04:36:09.587 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' removed 2026-02-17T04:36:09.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:36:09.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:36:09.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:36:09.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:09.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:09.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:09.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:09.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:09.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:09.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:36:09.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:36:09.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:36:09.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:36:09.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:36:09.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:36:09.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:36:09.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:36:09.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:36:09.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:36:09.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:36:09.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:36:09.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:36:09.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:36:09.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:36:09.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:09.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:09.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:09.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:09.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:09.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:36:09.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:36:09.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:36:09.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:36:09.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:36:09.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:36:09.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:36:09.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:36:09.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:36:09.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:36:09.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:36:09.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:36:09.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:36:09.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:36:09.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:36:09.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:36:09.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:36:09.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:36:09.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:36:09.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:36:09.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_replicated td/osd-scrub-repair 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1050: TEST_corrupt_scrub_replicated: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1051: TEST_corrupt_scrub_replicated: local poolname=csr_pool 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1052: TEST_corrupt_scrub_replicated: local total_objs=19 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1054: TEST_corrupt_scrub_replicated: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:36:09.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:09.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:36:09.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:36:09.798 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:36:09.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:36:09.799 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:36:09.799 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.799 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.799 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:36:09.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:36:09.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:36:09.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:36:09.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:36:09.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:36:09.843 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:36:09.843 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.843 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:36:09.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:36:09.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:36:09.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1055: TEST_corrupt_scrub_replicated: run_mgr td/osd-scrub-repair x 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:36:09.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:36:09.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:36:09.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:09.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:09.967 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:09.967 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.968 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:09.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:36:09.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:36:09.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1056: TEST_corrupt_scrub_replicated: run_osd td/osd-scrub-repair 0 2026-02-17T04:36:09.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:09.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:36:09.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:09.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:36:09.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:36:09.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:36:09.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:09.991 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:09.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 76db967e-ef86-4a80-92b6-56f605d53d75' 2026-02-17T04:36:09.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:36:09.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA58JNpfhBpOxAArvlr2x8lta2NM2NT177gIg== 2026-02-17T04:36:09.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA58JNpfhBpOxAArvlr2x8lta2NM2NT177gIg=="}' 2026-02-17T04:36:09.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 76db967e-ef86-4a80-92b6-56f605d53d75 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:36:10.081 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:36:10.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:36:10.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA58JNpfhBpOxAArvlr2x8lta2NM2NT177gIg== --osd-uuid 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:10.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.102+0000 7f96e0e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.105 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.104+0000 7f96e0e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.104+0000 7f96e0e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.105+0000 7f96e0e11780 -1 bdev(0x2eb4c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:36:10.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.105+0000 7f96e0e11780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:36:10.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:36:10.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:36:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:36:10.499 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:36:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:36:10.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:36:10.587 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:36:10.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:10.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:36:10.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:36:10.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:36:10.602 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.600+0000 7f2cdc008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.603 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.602+0000 7f2cdc008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.604 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.602+0000 7f2cdc008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:10.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:36:10.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:10.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:36:10.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:10.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:10.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:10.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:10.670 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:36:10.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:10.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:10.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:10.825 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:10.823+0000 7f2cdc008780 -1 Falling back to public interface 2026-02-17T04:36:11.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.161+0000 7f2cdc008780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:11.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:11.834 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/677073408,v1:127.0.0.1:6801/677073408] [v2:127.0.0.1:6802/677073408,v1:127.0.0.1:6803/677073408] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1057: TEST_corrupt_scrub_replicated: run_osd td/osd-scrub-repair 1 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:11.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:36:11.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:11.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:11.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 06a3f185-038e-4b6c-94be-0814cac75e6e' 2026-02-17T04:36:11.845 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:11.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:36:11.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA78JNpgr+FMhAAXRXRd9pa0KrPTD+CAPj/kA== 2026-02-17T04:36:11.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA78JNpgr+FMhAAXRXRd9pa0KrPTD+CAPj/kA=="}' 2026-02-17T04:36:11.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06a3f185-038e-4b6c-94be-0814cac75e6e -i td/osd-scrub-repair/1/new.json 2026-02-17T04:36:11.930 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:36:11.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:36:11.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA78JNpgr+FMhAAXRXRd9pa0KrPTD+CAPj/kA== --osd-uuid 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:11.954 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.952+0000 7f66d8c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:11.955 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.953+0000 7f66d8c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:11.957 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.954+0000 7f66d8c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:11.957 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.954+0000 7f66d8c31780 -1 bdev(0x2a84c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:36:11.957 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:11.955+0000 7f66d8c31780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:36:12.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:36:12.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:36:12.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:36:12.347 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:36:12.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:36:12.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:36:12.569 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:36:12.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:12.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:36:12.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:36:12.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:36:12.583 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:12.582+0000 7f84e8441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:12.585 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:12.583+0000 7f84e8441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:12.586 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:12.584+0000 7f84e8441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:12.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:12.714+0000 7f84e8441780 -1 Falling back to public interface 2026-02-17T04:36:12.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:36:12.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:12.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:36:12.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:12.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:12.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:13.015 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:13.013+0000 7f84e8441780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:36:13.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:13.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:13.901 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:36:13.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:13.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:13.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:14.068 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/69171327,v1:127.0.0.1:6811/69171327] [v2:127.0.0.1:6812/69171327,v1:127.0.0.1:6813/69171327] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:14.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:14.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:14.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:14.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1058: TEST_corrupt_scrub_replicated: create_rbd_pool 2026-02-17T04:36:14.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:36:14.228 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:36:14.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:36:14.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:36:14.415 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:36:14.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:36:15.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:36:15.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1059: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-17T04:36:15.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:15.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:15.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:15.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:15.706 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:15.706 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:15.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:15.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:15.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:15.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:15.961 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:15.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:15.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:16.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:36:16.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:36:16.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:36:16.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:16.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:16.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-17T04:36:16.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-17T04:36:16.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705666' 2026-02-17T04:36:16.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:16.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:36:16.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:16.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:16.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:36:16.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:36:16.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:36:16.087 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:36:16.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:16.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:36:16.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:16.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-17T04:36:16.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:16.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:16.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-17T04:36:16.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:16.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-17T04:36:16.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-17T04:36:16.260 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705666 2026-02-17T04:36:16.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:16.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705665 -lt 38654705666 2026-02-17T04:36:16.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:17.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:17.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:17.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705665 -lt 38654705666 2026-02-17T04:36:17.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:18.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:36:18.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:18.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705666 -lt 38654705666 2026-02-17T04:36:18.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:18.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:18.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:18.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:18.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:19.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:36:19.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:19.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:19.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:19.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:36:19.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:19.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:19.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1061: TEST_corrupt_scrub_replicated: create_pool foo 1 2026-02-17T04:36:19.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-17T04:36:19.567 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T04:36:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:36:20.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1062: TEST_corrupt_scrub_replicated: create_pool csr_pool 1 1 2026-02-17T04:36:20.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-17T04:36:20.791 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' created 2026-02-17T04:36:20.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:36:21.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1063: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-17T04:36:21.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:21.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:21.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:21.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:21.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:21.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:21.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:21.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:21.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:21.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:21.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:21.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:21.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:21.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:21.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:22.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:22.070 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:22.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:22.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:22.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:22.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T04:36:22.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T04:36:22.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T04:36:22.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:22.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:22.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:22.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:22.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T04:36:22.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:22.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T04:36:22.192 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836484 2026-02-17T04:36:22.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T04:36:22.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:22.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836484 2026-02-17T04:36:22.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:23.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:23.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:23.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836484 2026-02-17T04:36:23.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:24.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:36:24.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:24.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-17T04:36:24.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:24.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:36:24.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:24.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:24.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:36:24.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:24.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:36:24.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:36:24.701 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705668 2026-02-17T04:36:24.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:24.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T04:36:24.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:24.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:24.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:25.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:25.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:36:25.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:25.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:25.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:25.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:36:25.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:25.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:25.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: seq 1 19 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ1 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:25.689 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:25.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:25.893 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:25.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-17T04:36:25.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-17T04:36:25.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:25.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ2 2026-02-17T04:36:25.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:25.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:26.196 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:26.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:26.398 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:26.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:26.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:26.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:26.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-17T04:36:26.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-17T04:36:26.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ3 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ3 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ3 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:26.671 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:26.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:26.875 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:26.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:26.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:26.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:26.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ3 hdr-ROBJ3 2026-02-17T04:36:26.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ3 key-ROBJ3 val-ROBJ3 2026-02-17T04:36:26.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:26.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ4 2026-02-17T04:36:26.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ4 2026-02-17T04:36:26.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:26.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:26.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ4 2026-02-17T04:36:26.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:26.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:26.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:27.178 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:27.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:27.386 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:27.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:27.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:27.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:27.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ4 hdr-ROBJ4 2026-02-17T04:36:27.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ4 key-ROBJ4 val-ROBJ4 2026-02-17T04:36:27.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:27.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ5 2026-02-17T04:36:27.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ5 2026-02-17T04:36:27.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:27.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:27.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ5 2026-02-17T04:36:27.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:27.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:27.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:27.656 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:27.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:27.860 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:27.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:27.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:27.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:27.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ5 hdr-ROBJ5 2026-02-17T04:36:27.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ5 key-ROBJ5 val-ROBJ5 2026-02-17T04:36:27.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ6 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ6 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ6 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:27.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:28.136 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:28.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:28.341 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:28.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:28.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:28.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:28.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ6 hdr-ROBJ6 2026-02-17T04:36:28.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ6 key-ROBJ6 val-ROBJ6 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ7 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ7 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ7 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:28.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:28.614 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:28.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:28.818 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:28.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:28.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:28.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:28.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ7 hdr-ROBJ7 2026-02-17T04:36:28.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ7 key-ROBJ7 val-ROBJ7 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ8 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ8 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:28.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ8 2026-02-17T04:36:28.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:28.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:28.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:29.121 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:29.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:29.324 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:29.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:29.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ8 hdr-ROBJ8 2026-02-17T04:36:29.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ8 key-ROBJ8 val-ROBJ8 2026-02-17T04:36:29.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:29.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ9 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ9 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:29.607 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:29.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:29.811 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:29.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:29.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:29.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:29.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ9 hdr-ROBJ9 2026-02-17T04:36:29.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ9 key-ROBJ9 val-ROBJ9 2026-02-17T04:36:29.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ10 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ10 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:30.083 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:30.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:30.288 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:30.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:30.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:30.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:30.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ10 hdr-ROBJ10 2026-02-17T04:36:30.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ10 key-ROBJ10 val-ROBJ10 2026-02-17T04:36:30.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:30.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ11 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ11 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ11 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:30.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:30.567 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:30.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:30.771 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:30.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:30.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:30.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ11 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:30.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ11 hdr-ROBJ11 2026-02-17T04:36:30.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ11 key-ROBJ11 val-ROBJ11 2026-02-17T04:36:30.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ12 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ12 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ12 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:30.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:31.045 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:31.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:31.248 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:31.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:31.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:31.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ12 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:31.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ12 hdr-ROBJ12 2026-02-17T04:36:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ12 key-ROBJ12 val-ROBJ12 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ13 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ13 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:31.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ13 2026-02-17T04:36:31.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:31.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:31.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:31.520 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:31.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:31.724 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:31.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:31.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:31.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ13 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:31.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ13 hdr-ROBJ13 2026-02-17T04:36:31.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ13 key-ROBJ13 val-ROBJ13 2026-02-17T04:36:31.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ14 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ14 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ14 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:31.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:32.002 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:32.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:32.208 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:32.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:32.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:32.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ14 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:32.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ14 hdr-ROBJ14 2026-02-17T04:36:32.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ14 key-ROBJ14 val-ROBJ14 2026-02-17T04:36:32.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ15 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ15 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ15 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:32.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:32.485 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:32.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:32.690 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:32.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:32.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:32.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ15 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:32.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ15 hdr-ROBJ15 2026-02-17T04:36:32.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ15 key-ROBJ15 val-ROBJ15 2026-02-17T04:36:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ16 2026-02-17T04:36:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ16 2026-02-17T04:36:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:32.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ16 2026-02-17T04:36:32.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:32.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:32.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:32.967 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:32.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:33.171 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:33.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:33.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:33.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ16 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:33.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ16 hdr-ROBJ16 2026-02-17T04:36:33.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ16 key-ROBJ16 val-ROBJ16 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ17 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ17 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:33.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ17 2026-02-17T04:36:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:33.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:33.443 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:33.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:33.647 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:33.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:33.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:33.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ17 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:33.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ17 hdr-ROBJ17 2026-02-17T04:36:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ17 key-ROBJ17 val-ROBJ17 2026-02-17T04:36:33.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:33.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ18 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ18 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ18 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:33.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:33.919 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:33.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:34.123 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:34.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:34.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:34.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ18 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:34.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ18 hdr-ROBJ18 2026-02-17T04:36:34.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ18 key-ROBJ18 val-ROBJ18 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ19 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ19 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ19 2026-02-17T04:36:34.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:36:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:36:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:36:34.398 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:36:34.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:36:34.603 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:36:34.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:36:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:36:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:36:34.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ19 hdr-ROBJ19 2026-02-17T04:36:34.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ19 key-ROBJ19 val-ROBJ19 2026-02-17T04:36:34.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1074: TEST_corrupt_scrub_replicated: dd if=/dev/zero of=td/osd-scrub-repair/new.ROBJ19 bs=1024 count=1025 2026-02-17T04:36:34.666 INFO:tasks.workunit.client.0.trial090.stderr:1025+0 records in 2026-02-17T04:36:34.666 INFO:tasks.workunit.client.0.trial090.stderr:1025+0 records out 2026-02-17T04:36:34.667 INFO:tasks.workunit.client.0.trial090.stderr:1049600 bytes (1.0 MB, 1.0 MiB) copied, 0.00158753 s, 661 MB/s 2026-02-17T04:36:34.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1075: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/new.ROBJ19 2026-02-17T04:36:34.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1076: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ19 2026-02-17T04:36:34.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1078: TEST_corrupt_scrub_replicated: get_pg csr_pool ROBJ0 2026-02-17T04:36:34.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-17T04:36:34.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-17T04:36:34.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:36:34.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:36:34.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1078: TEST_corrupt_scrub_replicated: local pg=3.0 2026-02-17T04:36:34.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1079: TEST_corrupt_scrub_replicated: get_primary csr_pool ROBJ0 2026-02-17T04:36:34.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-17T04:36:34.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-17T04:36:34.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:36:34.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:36:35.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1079: TEST_corrupt_scrub_replicated: local primary=1 2026-02-17T04:36:35.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: get_asok_path osd.0 2026-02-17T04:36:35.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:36:35.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:36:35.025 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:36:35.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:35.026 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:35.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:36:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: CEPH_ARGS= 2026-02-17T04:36:35.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: ceph daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-17T04:36:35.069 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:36:35.069 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-17T04:36:35.070 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: get_asok_path osd.1 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:36:35.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: CEPH_ARGS= 2026-02-17T04:36:35.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: ceph daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-17T04:36:35.118 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:36:35.118 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-17T04:36:35.119 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:36:35.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1086: TEST_corrupt_scrub_replicated: pg_deep_scrub 3.0 2026-02-17T04:36:35.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:36:35.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:36:35.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:36:35.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:36:35.124 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:35.124 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:35.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:35.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:35.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:35.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:36:35.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:36:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:36:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:36:35.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:35.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:35.512 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:35.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:35.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T04:36:35.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T04:36:35.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T04:36:35.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:35.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:35.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-17T04:36:35.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-17T04:36:35.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-17T04:36:35.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:35.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T04:36:35.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:35.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:35.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T04:36:35.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:35.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T04:36:35.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T04:36:35.636 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836488 2026-02-17T04:36:35.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:35.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-17T04:36:35.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:36.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:36.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-17T04:36:36.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:36.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-17T04:36:36.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:36.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:36.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-17T04:36:36.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:36.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-17T04:36:36.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T04:36:36.982 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705672 2026-02-17T04:36:36.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:37.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T04:36:37.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:36:37.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:36:37.147 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:36:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:36:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:36:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:36:37.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:36:37.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:37.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:37.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:37.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:37.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:36:37.532 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-17T04:36:37.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:36:20.789956+0000 last_deep_scrub_stamp 2026-02-17T04:36:37.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:36:37.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:37.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:37.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:37.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:20.789956+0000 '>' 2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:37.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:38.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:38.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:38.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:38.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:38.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:20.789956+0000 '>' 2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:38.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:39.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:39.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:39.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:39.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:39.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:39.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:39.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:20.789956+0000 '>' 2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:40.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:36:41.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:36:41.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:36:41.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:36:41.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:36:41.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:36:41.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:36:41.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:36:41.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:20.789956+0000 2026-02-17T04:36:41.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:36:41.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: seq 1 19 2026-02-17T04:36:41.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:41.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ1 2026-02-17T04:36:41.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 1 % 2 2026-02-17T04:36:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:36:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:36:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1097: TEST_corrupt_scrub_replicated: local payload=UVWXYZZZ 2026-02-17T04:36:41.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1098: TEST_corrupt_scrub_replicated: echo UVWXYZZZ 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1099: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:41.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:36:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:41.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:41.423 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#-5:00000000:::deep_scrub_3.0:head#, (61) No data available 2026-02-17T04:36:41.424 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#-5:00000000:::scrub_3.0:head#, (61) No data available 2026-02-17T04:36:41.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:36:41.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:41.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:36:41.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:41.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:41.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:36:41.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:36:41.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:36:41.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:36:41.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:36:41.475 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:41.474+0000 7f956cc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:41.476 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:41.474+0000 7f956cc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:41.477 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:41.475+0000 7f956cc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:41.605 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:41.603+0000 7f956cc32780 -1 Falling back to public interface 2026-02-17T04:36:41.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:36:41.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:41.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:41.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:41.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:41.905+0000 7f956cc32780 -1 osd.1 60 log_to_monitors true 2026-02-17T04:36:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:42.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:42.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:42.801 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:36:42.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:42.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 64 up_thru 64 down_at 61 last_clean_interval [9,60) [v2:127.0.0.1:6810/4292508379,v1:127.0.0.1:6811/4292508379] [v2:127.0.0.1:6812/4292508379,v1:127.0.0.1:6813/4292508379] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:42.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:42.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:43.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:43.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:43.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:43.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:43.224 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:43.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:43.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:43.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:43.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:36:43.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:36:43.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:36:43.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:43.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:43.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906946 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906946 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-274877906946' 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:43.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:43.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:36:43.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:36:43.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:36:43.344 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836491 2026-02-17T04:36:43.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:43.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-17T04:36:43.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:44.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:44.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:44.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:36:44.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:44.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-274877906946 2026-02-17T04:36:44.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:44.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:44.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-274877906946 2026-02-17T04:36:44.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:44.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906946 2026-02-17T04:36:44.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 274877906946' 2026-02-17T04:36:44.684 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 274877906946 2026-02-17T04:36:44.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:44.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906946 -lt 274877906946 2026-02-17T04:36:44.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:44.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:44.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:45.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:45.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:45.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:36:45.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:45.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:45.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:45.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:36:45.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:45.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:45.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:45.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ2 2026-02-17T04:36:45.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 2 % 2 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1104: TEST_corrupt_scrub_replicated: local payload=UVWXYZ 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1105: TEST_corrupt_scrub_replicated: echo UVWXYZ 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1106: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:36:45.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:36:45.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:45.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:45.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:45.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:45.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:45.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:36:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:36:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:36:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:36:45.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:36:45.714 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:45.713+0000 7f4e81448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:45.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:45.715+0000 7f4e81448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:45.717 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:45.716+0000 7f4e81448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:45.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:36:45.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:45.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:45.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:45.881 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:45.880+0000 7f4e81448780 -1 Falling back to public interface 2026-02-17T04:36:46.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:46.200 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:46.199+0000 7f4e81448780 -1 osd.0 67 log_to_monitors true 2026-02-17T04:36:47.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:47.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:47.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:47.033 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:36:47.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:47.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 71 up_thru 71 down_at 68 last_clean_interval [5,67) [v2:127.0.0.1:6800/4255699511,v1:127.0.0.1:6801/4255699511] [v2:127.0.0.1:6802/4255699511,v1:127.0.0.1:6803/4255699511] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:47.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:47.199 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:47.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:47.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:47.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:47.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:47.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:47.460 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:47.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:47.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:47.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:47.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678018 2026-02-17T04:36:47.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678018 2026-02-17T04:36:47.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678018' 2026-02-17T04:36:47.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:47.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:47.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906948 2026-02-17T04:36:47.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906948 2026-02-17T04:36:47.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678018 1-274877906948' 2026-02-17T04:36:47.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:47.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-304942678018 2026-02-17T04:36:47.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:47.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:47.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-304942678018 2026-02-17T04:36:47.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:47.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678018 2026-02-17T04:36:47.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 304942678018' 2026-02-17T04:36:47.581 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 304942678018 2026-02-17T04:36:47.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:47.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 304942678018 2026-02-17T04:36:47.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:48.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:48.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:48.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678018 -lt 304942678018 2026-02-17T04:36:48.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:48.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-274877906948 2026-02-17T04:36:48.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:48.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:48.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-274877906948 2026-02-17T04:36:48.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:48.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906948 2026-02-17T04:36:48.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 274877906948' 2026-02-17T04:36:48.925 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 274877906948 2026-02-17T04:36:48.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:49.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906948 -lt 274877906948 2026-02-17T04:36:49.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:49.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:49.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:49.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:49.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:36:49.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:49.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:49.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:49.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:36:49.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:49.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:49.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:49.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ3 2026-02-17T04:36:49.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 3 % 2 2026-02-17T04:36:49.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:36:49.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:36:49.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1111: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:49.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:49.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:49.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:49.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:49.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:49.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:36:49.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:36:49.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:36:49.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:36:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:36:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ3 remove 2026-02-17T04:36:49.892 INFO:tasks.workunit.client.0.trial090.stdout:remove #3:f2a5b2a4:::ROBJ3:head# 2026-02-17T04:36:49.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:36:49.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:49.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:36:49.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:36:49.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:49.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:49.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:49.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:36:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:36:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:36:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:36:49.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:36:49.948 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:49.947+0000 7fbc6b00c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:49.949 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:49.948+0000 7fbc6b00c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:49.950 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:49.949+0000 7fbc6b00c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:50.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:50.101 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:36:50.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:50.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:50.165 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:50.164+0000 7fbc6b00c780 -1 Falling back to public interface 2026-02-17T04:36:50.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:50.460 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:50.459+0000 7fbc6b00c780 -1 osd.1 74 log_to_monitors true 2026-02-17T04:36:51.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:51.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:51.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:51.268 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:36:51.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:51.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:51.431 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [64,74) [v2:127.0.0.1:6810/3636266540,v1:127.0.0.1:6811/3636266540] [v2:127.0.0.1:6812/3636266540,v1:127.0.0.1:6813/3636266540] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:51.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:51.432 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:51.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:51.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:51.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:51.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:51.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:51.687 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:51.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:51.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:51.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678020 2026-02-17T04:36:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678020 2026-02-17T04:36:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678020' 2026-02-17T04:36:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:51.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:51.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-17T04:36:51.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-17T04:36:51.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-304942678020 1-335007449090' 2026-02-17T04:36:51.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:51.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-304942678020 2026-02-17T04:36:51.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:51.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:51.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-304942678020 2026-02-17T04:36:51.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:51.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=304942678020 2026-02-17T04:36:51.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 304942678020' 2026-02-17T04:36:51.809 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 304942678020 2026-02-17T04:36:51.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:51.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678018 -lt 304942678020 2026-02-17T04:36:51.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:36:52.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:36:52.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:53.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 304942678020 -lt 304942678020 2026-02-17T04:36:53.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:53.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449090 2026-02-17T04:36:53.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:53.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:53.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449090 2026-02-17T04:36:53.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:53.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-17T04:36:53.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449090' 2026-02-17T04:36:53.151 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 335007449090 2026-02-17T04:36:53.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:53.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449090 -lt 335007449090 2026-02-17T04:36:53.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:53.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:53.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:53.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:36:53.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:53.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:53.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:36:53.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:53.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:53.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:53.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:36:53.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:53.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:53.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:53.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ4 2026-02-17T04:36:53.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 4 % 2 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1116: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:53.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:53.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:36:54.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:36:54.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:36:54.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:36:54.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:36:54.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:36:54.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:36:54.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:54.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:54.167 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:54.167 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:54.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:36:54.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:36:54.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:36:54.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:36:54.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:36:54.182 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:54.181+0000 7f8551c83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:54.183 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:54.183+0000 7f8551c83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:54.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:54.184+0000 7f8551c83780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:54.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:54.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:54.337 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:36:54.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:54.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:54.357 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:54.356+0000 7f8551c83780 -1 Falling back to public interface 2026-02-17T04:36:54.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:54.650 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:54.649+0000 7f8551c83780 -1 osd.0 80 log_to_monitors true 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:55.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:36:55.671 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [71,80) [v2:127.0.0.1:6800/1106867027,v1:127.0.0.1:6801/1106867027] [v2:127.0.0.1:6802/1106867027,v1:127.0.0.1:6803/1106867027] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:36:55.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:55.672 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:55.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:55.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:55.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:55.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:55.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:55.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:55.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:55.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:55.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:55.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:55.930 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:55.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:55.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:55.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:55.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-17T04:36:55.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-17T04:36:55.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866' 2026-02-17T04:36:55.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:55.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:56.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449092 2026-02-17T04:36:56.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449092 2026-02-17T04:36:56.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-335007449092' 2026-02-17T04:36:56.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:56.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252866 2026-02-17T04:36:56.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:56.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:56.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252866 2026-02-17T04:36:56.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:56.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-17T04:36:56.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252866' 2026-02-17T04:36:56.051 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252866 2026-02-17T04:36:56.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:56.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252866 2026-02-17T04:36:56.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:56.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449092 2026-02-17T04:36:56.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:56.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:36:56.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449092 2026-02-17T04:36:56.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:56.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449092 2026-02-17T04:36:56.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449092' 2026-02-17T04:36:56.219 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 335007449092 2026-02-17T04:36:56.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:36:56.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449092 -lt 335007449092 2026-02-17T04:36:56.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:36:56.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:56.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:56.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:36:56.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:36:56.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:36:56.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:36:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:36:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:36:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:36:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:36:56.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:36:56.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:36:56.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:36:56.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ5 2026-02-17T04:36:56.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 5 % 2 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1121: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:36:56.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:36:56.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:36:57.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:36:57.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:57.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:36:57.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:36:57.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:36:57.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:36:57.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:36:57.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:36:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:36:57.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:36:57.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:36:57.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:36:57.241 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:57.240+0000 7f3fb9c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:57.242 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:57.241+0000 7f3fb9c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:57.243 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:57.242+0000 7f3fb9c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:57.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:36:57.404 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:36:57.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:57.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:57.451 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:57.450+0000 7f3fb9c25780 -1 Falling back to public interface 2026-02-17T04:36:57.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:36:57.776 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:36:57.775+0000 7f3fb9c25780 -1 osd.1 86 log_to_monitors true 2026-02-17T04:36:58.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:36:58.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:36:58.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:36:58.575 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:36:58.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:36:58.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:36:58.744 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 90 up_thru 90 down_at 87 last_clean_interval [78,86) [v2:127.0.0.1:6810/337883263,v1:127.0.0.1:6811/337883263] [v2:127.0.0.1:6812/337883263,v1:127.0.0.1:6813/337883263] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:36:58.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:36:58.746 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:36:58.746 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:36:58.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:36:58.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:36:58.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:36:58.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:36:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:36:59.003 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:36:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:36:59.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:59.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:36:59.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-17T04:36:59.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-17T04:36:59.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867' 2026-02-17T04:36:59.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:36:59.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:36:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056642 2026-02-17T04:36:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056642 2026-02-17T04:36:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-386547056642' 2026-02-17T04:36:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:36:59.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252867 2026-02-17T04:36:59.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:36:59.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:36:59.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252867 2026-02-17T04:36:59.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:36:59.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-17T04:36:59.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252867' 2026-02-17T04:36:59.126 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252867 2026-02-17T04:36:59.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:36:59.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252867 2026-02-17T04:36:59.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:00.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:00.294 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:00.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252868 -lt 360777252867 2026-02-17T04:37:00.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:00.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056642 2026-02-17T04:37:00.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:00.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:00.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056642 2026-02-17T04:37:00.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:00.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056642 2026-02-17T04:37:00.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056642' 2026-02-17T04:37:00.465 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 386547056642 2026-02-17T04:37:00.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:00.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056642 -lt 386547056642 2026-02-17T04:37:00.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:00.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:00.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:00.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:00.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:01.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:01.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:01.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:01.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:01.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:01.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:01.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:01.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:01.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ6 2026-02-17T04:37:01.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 6 % 2 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1126: TEST_corrupt_scrub_replicated: echo extra 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1127: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:01.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:01.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:01.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:01.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:01.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:01.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:37:01.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:01.473 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:37:01.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:37:01.475 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:37:01.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:01.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:37:01.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:37:01.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:01.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:01.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:01.489 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:01.488+0000 7fa14f5d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:01.490 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:01.490+0000 7fa14f5d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:01.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:01.490+0000 7fa14f5d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:01.634 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:01.633+0000 7fa14f5d6780 -1 Falling back to public interface 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:01.644 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:01.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:01.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:01.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:01.908 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:01.907+0000 7fa14f5d6780 -1 osd.0 91 log_to_monitors true 2026-02-17T04:37:02.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:02.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:02.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:02.811 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:02.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:02.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 95 up_thru 95 down_at 92 last_clean_interval [84,91) [v2:127.0.0.1:6800/69225994,v1:127.0.0.1:6801/69225994] [v2:127.0.0.1:6802/69225994,v1:127.0.0.1:6803/69225994] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:02.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:02.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:02.975 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:02.975 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:02.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:02.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:02.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:03.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:03.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:03.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:03.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:03.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:03.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:03.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:03.229 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:03.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:03.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:03.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:03.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893122 2026-02-17T04:37:03.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893122 2026-02-17T04:37:03.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893122' 2026-02-17T04:37:03.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:03.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:03.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056644 2026-02-17T04:37:03.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056644 2026-02-17T04:37:03.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893122 1-386547056644' 2026-02-17T04:37:03.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893122 2026-02-17T04:37:03.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:03.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:03.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893122 2026-02-17T04:37:03.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:03.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893122 2026-02-17T04:37:03.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893122' 2026-02-17T04:37:03.352 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 408021893122 2026-02-17T04:37:03.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:03.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 408021893122 2026-02-17T04:37:03.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:04.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:04.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:04.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893122 -lt 408021893122 2026-02-17T04:37:04.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:04.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056644 2026-02-17T04:37:04.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:04.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:04.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056644 2026-02-17T04:37:04.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056644 2026-02-17T04:37:04.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056644' 2026-02-17T04:37:04.692 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 386547056644 2026-02-17T04:37:04.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:04.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056644 -lt 386547056644 2026-02-17T04:37:04.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:04.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:04.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:05.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:05.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:05.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:05.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:05.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:05.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1128: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/extra-val 2026-02-17T04:37:05.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:05.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ7 2026-02-17T04:37:05.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 7 % 2 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1133: TEST_corrupt_scrub_replicated: echo -n newheader 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1134: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:37:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:05.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:05.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:05.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:05.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:05.686 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:05.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:05.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:05.700 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:05.700+0000 7fa04f862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:05.702 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:05.701+0000 7fa04f862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:05.703 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:05.702+0000 7fa04f862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:05.839 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:05.838+0000 7fa04f862780 -1 Falling back to public interface 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:05.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:05.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:06.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:06.166 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:06.164+0000 7fa04f862780 -1 osd.1 97 log_to_monitors true 2026-02-17T04:37:07.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:07.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:07.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:07.030 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:07.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:07.199 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 101 up_thru 101 down_at 98 last_clean_interval [90,97) [v2:127.0.0.1:6810/2669767879,v1:127.0.0.1:6811/2669767879] [v2:127.0.0.1:6812/2669767879,v1:127.0.0.1:6813/2669767879] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:07.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:07.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:07.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:07.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:07.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:07.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:07.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:07.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:07.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:07.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:07.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:07.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:07.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:07.457 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:07.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:07.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:07.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:07.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893124 2026-02-17T04:37:07.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893124 2026-02-17T04:37:07.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893124' 2026-02-17T04:37:07.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:07.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696898 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696898 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893124 1-433791696898' 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893124 2026-02-17T04:37:07.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:07.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:07.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893124 2026-02-17T04:37:07.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:07.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893124 2026-02-17T04:37:07.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893124' 2026-02-17T04:37:07.582 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 408021893124 2026-02-17T04:37:07.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:07.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893122 -lt 408021893124 2026-02-17T04:37:07.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:08.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:08.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:08.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893124 -lt 408021893124 2026-02-17T04:37:08.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:08.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-433791696898 2026-02-17T04:37:08.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:08.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:08.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-433791696898 2026-02-17T04:37:08.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:08.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696898 2026-02-17T04:37:08.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 433791696898' 2026-02-17T04:37:08.917 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 433791696898 2026-02-17T04:37:08.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:09.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696898 -lt 433791696898 2026-02-17T04:37:09.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:09.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:09.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:09.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:09.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:09.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:09.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:09.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:09.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:09.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:09.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:09.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:09.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:09.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:09.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:09.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:09.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:09.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1135: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/hdr 2026-02-17T04:37:09.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:09.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ8 2026-02-17T04:37:09.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 8 % 2 2026-02-17T04:37:09.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:09.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:09.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1139: TEST_corrupt_scrub_replicated: rados --pool csr_pool setxattr ROBJ8 key1-ROBJ8 val1-ROBJ8 2026-02-17T04:37:09.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1140: TEST_corrupt_scrub_replicated: rados --pool csr_pool setxattr ROBJ8 key2-ROBJ8 val2-ROBJ8 2026-02-17T04:37:09.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1143: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-17T04:37:09.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1144: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:37:09.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:09.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:09.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:09.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:09.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:09.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:10.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:10.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:10.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:37:10.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:37:10.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:10.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:10.164 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:10.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:10.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:10.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:10.176 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:10.174+0000 7f834342e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:10.177 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:10.175+0000 7f834342e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:10.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:10.176+0000 7f834342e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:10.328 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:10.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:10.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:10.355 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:10.354+0000 7f834342e780 -1 Falling back to public interface 2026-02-17T04:37:10.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:10.678 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:10.676+0000 7f834342e780 -1 osd.0 102 log_to_monitors true 2026-02-17T04:37:11.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:11.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:11.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:11.498 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:11.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:11.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:11.664 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 106 up_thru 106 down_at 103 last_clean_interval [95,102) [v2:127.0.0.1:6800/504029283,v1:127.0.0.1:6801/504029283] [v2:127.0.0.1:6802/504029283,v1:127.0.0.1:6803/504029283] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:37:11.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:11.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:11.665 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:11.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:11.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:11.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:11.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:11.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:11.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:11.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:11.923 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:11.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:11.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:11.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:11.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533378 2026-02-17T04:37:11.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533378 2026-02-17T04:37:11.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533378' 2026-02-17T04:37:11.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:11.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:12.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696900 2026-02-17T04:37:12.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696900 2026-02-17T04:37:12.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533378 1-433791696900' 2026-02-17T04:37:12.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:12.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533378 2026-02-17T04:37:12.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:12.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:12.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533378 2026-02-17T04:37:12.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:12.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533378 2026-02-17T04:37:12.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533378' 2026-02-17T04:37:12.044 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533378 2026-02-17T04:37:12.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:12.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533378 -lt 455266533378 2026-02-17T04:37:12.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:12.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-433791696900 2026-02-17T04:37:12.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:12.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:12.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-433791696900 2026-02-17T04:37:12.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:12.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696900 2026-02-17T04:37:12.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 433791696900' 2026-02-17T04:37:12.214 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 433791696900 2026-02-17T04:37:12.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:12.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696900 -lt 433791696900 2026-02-17T04:37:12.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:12.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:12.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:12.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:12.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:12.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:12.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:12.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:12.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1145: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:37:13.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:13.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:13.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:13.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:13.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:13.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:13.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:13.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:13.218 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:13.216+0000 7fbbd3a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:13.219 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:13.217+0000 7fbbd3a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:13.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:13.218+0000 7fbbd3a16780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:13.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:13.369+0000 7fbbd3a16780 -1 Falling back to public interface 2026-02-17T04:37:13.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:13.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:13.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:13.697 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:13.695+0000 7fbbd3a16780 -1 osd.1 108 log_to_monitors true 2026-02-17T04:37:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:14.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:14.538 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:14.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:14.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 112 up_thru 112 down_at 109 last_clean_interval [101,108) [v2:127.0.0.1:6810/3549653051,v1:127.0.0.1:6811/3549653051] [v2:127.0.0.1:6812/3549653051,v1:127.0.0.1:6813/3549653051] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:14.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:14.703 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:14.704 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:14.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:14.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:14.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:14.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:14.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:14.958 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:14.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:14.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:14.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:15.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533379 2026-02-17T04:37:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533379 2026-02-17T04:37:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533379' 2026-02-17T04:37:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:15.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=481036337154 2026-02-17T04:37:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 481036337154 2026-02-17T04:37:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533379 1-481036337154' 2026-02-17T04:37:15.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:15.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533379 2026-02-17T04:37:15.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:15.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:15.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533379 2026-02-17T04:37:15.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:15.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533379 2026-02-17T04:37:15.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533379' 2026-02-17T04:37:15.080 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533379 2026-02-17T04:37:15.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:15.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533378 -lt 455266533379 2026-02-17T04:37:15.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:16.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:16.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:16.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533380 -lt 455266533379 2026-02-17T04:37:16.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:16.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-481036337154 2026-02-17T04:37:16.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:16.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:16.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-481036337154 2026-02-17T04:37:16.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:16.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=481036337154 2026-02-17T04:37:16.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 481036337154' 2026-02-17T04:37:16.427 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 481036337154 2026-02-17T04:37:16.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:16.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 481036337154 -lt 481036337154 2026-02-17T04:37:16.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:16.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:16.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:16.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:16.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:16.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:16.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:16.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:16.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:16.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:16.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:16.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:16.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:16.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1146: TEST_corrupt_scrub_replicated: echo -n val3-ROBJ8 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1147: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:17.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:17.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:17.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:37:17.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:17.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:17.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:17.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:17.431 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:17.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:17.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:17.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:17.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:17.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:17.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:17.446 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:17.444+0000 7fd2fd062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:17.447 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:17.445+0000 7fd2fd062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:17.448 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:17.446+0000 7fd2fd062780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:17.568 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:17.566+0000 7fd2fd062780 -1 Falling back to public interface 2026-02-17T04:37:17.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:17.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:17.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:17.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:17.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:17.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:17.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:17.599 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:17.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:17.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:17.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:17.836 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:17.834+0000 7fd2fd062780 -1 osd.1 113 log_to_monitors true 2026-02-17T04:37:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:18.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:18.767 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:18.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 117 up_thru 117 down_at 114 last_clean_interval [112,113) [v2:127.0.0.1:6810/1235972379,v1:127.0.0.1:6811/1235972379] [v2:127.0.0.1:6812/1235972379,v1:127.0.0.1:6813/1235972379] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:18.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:18.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:19.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:19.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:19.191 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:19.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:19.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:19.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533381 2026-02-17T04:37:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533381 2026-02-17T04:37:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533381' 2026-02-17T04:37:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:19.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=502511173634 2026-02-17T04:37:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 502511173634 2026-02-17T04:37:19.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533381 1-502511173634' 2026-02-17T04:37:19.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:19.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533381 2026-02-17T04:37:19.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:19.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533381 2026-02-17T04:37:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:19.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533381 2026-02-17T04:37:19.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533381' 2026-02-17T04:37:19.312 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533381 2026-02-17T04:37:19.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:19.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533380 -lt 455266533381 2026-02-17T04:37:19.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:20.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:20.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:20.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533381 -lt 455266533381 2026-02-17T04:37:20.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:20.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-502511173634 2026-02-17T04:37:20.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:20.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:20.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-502511173634 2026-02-17T04:37:20.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:20.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=502511173634 2026-02-17T04:37:20.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 502511173634' 2026-02-17T04:37:20.658 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 502511173634 2026-02-17T04:37:20.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:20.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 502511173634 -lt 502511173634 2026-02-17T04:37:20.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:20.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:20.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:21.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:21.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:21.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:21.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:21.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:21.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:21.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:21.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:21.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:21.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1148: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-17T04:37:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-17T04:37:21.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 9 % 2 2026-02-17T04:37:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1152: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:37:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:21.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:21.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:21.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:21.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:21.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:21.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:21.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 get-attr _ 2026-02-17T04:37:21.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:21.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:21.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:21.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:21.612 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:21.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:21.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:21.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:21.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:21.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:21.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:21.626 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:21.624+0000 7f82cee0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:21.627 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:21.625+0000 7f82cee0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:21.628 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:21.626+0000 7f82cee0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:21.769 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:21.767+0000 7f82cee0b780 -1 Falling back to public interface 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:21.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:22.060 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:22.058+0000 7f82cee0b780 -1 osd.1 119 log_to_monitors true 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:22.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:23.117 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 123 up_thru 123 down_at 120 last_clean_interval [117,119) [v2:127.0.0.1:6810/627456520,v1:127.0.0.1:6811/627456520] [v2:127.0.0.1:6812/627456520,v1:127.0.0.1:6813/627456520] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:23.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:23.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:23.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:23.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:23.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:23.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:23.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:23.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:23.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:23.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:23.374 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:23.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:23.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:23.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533383 2026-02-17T04:37:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533383 2026-02-17T04:37:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533383' 2026-02-17T04:37:23.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:23.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:23.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=528280977410 2026-02-17T04:37:23.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 528280977410 2026-02-17T04:37:23.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533383 1-528280977410' 2026-02-17T04:37:23.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:23.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533383 2026-02-17T04:37:23.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:23.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:23.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533383 2026-02-17T04:37:23.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:23.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533383 2026-02-17T04:37:23.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533383' 2026-02-17T04:37:23.495 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533383 2026-02-17T04:37:23.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:23.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533382 -lt 455266533383 2026-02-17T04:37:23.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:24.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:24.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:24.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533383 -lt 455266533383 2026-02-17T04:37:24.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:24.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-528280977410 2026-02-17T04:37:24.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:24.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:24.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-528280977410 2026-02-17T04:37:24.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:24.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=528280977410 2026-02-17T04:37:24.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 528280977410' 2026-02-17T04:37:24.835 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 528280977410 2026-02-17T04:37:24.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:25.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 528280977410 -lt 528280977410 2026-02-17T04:37:25.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:25.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:25.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:25.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:25.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:25.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:25.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:25.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:25.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:25.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:25.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:25.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:25.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1153: TEST_corrupt_scrub_replicated: echo -n D 2026-02-17T04:37:25.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1154: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-17T04:37:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1155: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:37:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:25.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:25.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:37:25.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:25.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:25.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:25.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:25.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:25.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:25.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:25.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:25.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:25.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:25.884 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:25.882+0000 7f22b4a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:25.885 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:25.883+0000 7f22b4a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:25.886 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:25.884+0000 7f22b4a09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:26.015 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:26.013+0000 7f22b4a09780 -1 Falling back to public interface 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:26.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:26.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:26.038 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:26.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:26.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:26.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:26.324 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:26.322+0000 7f22b4a09780 -1 osd.1 124 log_to_monitors true 2026-02-17T04:37:27.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:27.204 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:27.368 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 128 up_thru 128 down_at 125 last_clean_interval [123,124) [v2:127.0.0.1:6810/2295872835,v1:127.0.0.1:6811/2295872835] [v2:127.0.0.1:6812/2295872835,v1:127.0.0.1:6813/2295872835] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:27.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:27.370 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:27.370 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:27.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:27.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:27.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:27.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:27.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:27.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:27.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:27.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:27.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:27.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:27.626 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:27.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:27.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:27.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:27.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533385 2026-02-17T04:37:27.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533385 2026-02-17T04:37:27.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533385' 2026-02-17T04:37:27.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:27.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=549755813890 2026-02-17T04:37:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 549755813890 2026-02-17T04:37:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533385 1-549755813890' 2026-02-17T04:37:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:27.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533385 2026-02-17T04:37:27.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:27.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:27.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533385 2026-02-17T04:37:27.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:27.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533385 2026-02-17T04:37:27.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533385' 2026-02-17T04:37:27.749 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533385 2026-02-17T04:37:27.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533384 -lt 455266533385 2026-02-17T04:37:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:28.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:28.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:29.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533385 -lt 455266533385 2026-02-17T04:37:29.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:29.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-549755813890 2026-02-17T04:37:29.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:29.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:29.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-549755813890 2026-02-17T04:37:29.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:29.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=549755813890 2026-02-17T04:37:29.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 549755813890' 2026-02-17T04:37:29.091 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 549755813890 2026-02-17T04:37:29.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:29.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 549755813890 -lt 549755813890 2026-02-17T04:37:29.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:29.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:29.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:29.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:29.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:29.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:29.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:29.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:29.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:29.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:29.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:29.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:29.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:29.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1156: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-17T04:37:29.867 INFO:tasks.workunit.client.0.trial090.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-17T04:37:29.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:29.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-17T04:37:29.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 10 % 2 2026-02-17T04:37:29.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:29.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:29.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:29.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ11 2026-02-17T04:37:29.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 11 % 2 2026-02-17T04:37:29.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:29.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:29.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:29.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ12 2026-02-17T04:37:29.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 12 % 2 2026-02-17T04:37:29.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:29.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:29.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:29.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ13 2026-02-17T04:37:29.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 13 % 2 2026-02-17T04:37:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:29.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ14 2026-02-17T04:37:29.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 14 % 2 2026-02-17T04:37:29.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1165: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1166: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:29.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:29.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:30.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:30.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:37:30.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:30.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:30.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:37:30.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:37:30.322 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:37:30.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:30.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:37:30.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:37:30.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:30.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:30.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:30.333 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:30.331+0000 7f91b382d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:30.334 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:30.332+0000 7f91b382d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:30.335 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:30.333+0000 7f91b382d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:30.473 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:30.471+0000 7f91b382d780 -1 Falling back to public interface 2026-02-17T04:37:30.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:37:30.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:30.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:30.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:30.778 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:30.776+0000 7f91b382d780 -1 osd.0 130 log_to_monitors true 2026-02-17T04:37:31.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:31.657 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 134 up_thru 134 down_at 131 last_clean_interval [106,130) [v2:127.0.0.1:6800/3730978091,v1:127.0.0.1:6801/3730978091] [v2:127.0.0.1:6802/3730978091,v1:127.0.0.1:6803/3730978091] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:31.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:31.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:32.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:32.084 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:32.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:32.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:32.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617666 2026-02-17T04:37:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617666 2026-02-17T04:37:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617666' 2026-02-17T04:37:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:32.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:32.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=549755813892 2026-02-17T04:37:32.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 549755813892 2026-02-17T04:37:32.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617666 1-549755813892' 2026-02-17T04:37:32.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:32.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617666 2026-02-17T04:37:32.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:32.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:32.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617666 2026-02-17T04:37:32.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:32.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617666 2026-02-17T04:37:32.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617666' 2026-02-17T04:37:32.206 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617666 2026-02-17T04:37:32.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:32.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 575525617666 2026-02-17T04:37:32.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:33.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:33.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:33.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 575525617666 2026-02-17T04:37:33.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:34.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:37:34.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:34.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617666 -lt 575525617666 2026-02-17T04:37:34.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:34.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-549755813892 2026-02-17T04:37:34.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:34.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:34.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-549755813892 2026-02-17T04:37:34.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:34.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=549755813892 2026-02-17T04:37:34.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 549755813892' 2026-02-17T04:37:34.713 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 549755813892 2026-02-17T04:37:34.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:34.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 549755813892 -lt 549755813892 2026-02-17T04:37:34.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:34.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:34.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:35.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:35.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:35.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:35.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:35.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:35.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:35.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:35.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:35.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:35.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:35.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1167: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:35.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:35.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:35.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:35.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:35.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:35.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:35.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:35.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ14 rm-attr _ 2026-02-17T04:37:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:35.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:35.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:35.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:35.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:35.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:35.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:35.741 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:35.739+0000 7fa1e4237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:35.742 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:35.740+0000 7fa1e4237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:35.743 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:35.741+0000 7fa1e4237780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:35.879 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:35.877+0000 7fa1e4237780 -1 Falling back to public interface 2026-02-17T04:37:35.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:35.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:36.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:36.196 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:36.194+0000 7fa1e4237780 -1 osd.1 135 log_to_monitors true 2026-02-17T04:37:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:37.069 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 139 up_thru 139 down_at 136 last_clean_interval [128,135) [v2:127.0.0.1:6810/3493107426,v1:127.0.0.1:6811/3493107426] [v2:127.0.0.1:6812/3493107426,v1:127.0.0.1:6813/3493107426] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:37.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:37.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:37.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:37.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:37.496 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:37.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:37.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:37.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617668 2026-02-17T04:37:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617668 2026-02-17T04:37:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617668' 2026-02-17T04:37:37.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:37.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:37.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=597000454146 2026-02-17T04:37:37.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 597000454146 2026-02-17T04:37:37.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617668 1-597000454146' 2026-02-17T04:37:37.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:37.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617668 2026-02-17T04:37:37.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:37.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:37.619 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617668 2026-02-17T04:37:37.619 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:37.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617668 2026-02-17T04:37:37.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617668' 2026-02-17T04:37:37.620 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617668 2026-02-17T04:37:37.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:37.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617667 -lt 575525617668 2026-02-17T04:37:37.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:38.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:38.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:38.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617668 -lt 575525617668 2026-02-17T04:37:38.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:38.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-597000454146 2026-02-17T04:37:38.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:38.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:38.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-597000454146 2026-02-17T04:37:38.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:38.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=597000454146 2026-02-17T04:37:38.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 597000454146' 2026-02-17T04:37:38.962 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 597000454146 2026-02-17T04:37:38.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:39.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 597000454146 -lt 597000454146 2026-02-17T04:37:39.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:39.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:39.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:39.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:39.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:39.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:39.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:39.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:39.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:39.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:39.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:39.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:39.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:39.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:39.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:39.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:39.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:39.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:39.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1168: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/bad-val 2026-02-17T04:37:39.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:39.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ15 2026-02-17T04:37:39.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 15 % 2 2026-02-17T04:37:39.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:39.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:39.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1172: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:37:39.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:39.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:39.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ15 rm-attr _ 2026-02-17T04:37:39.937 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:37:39.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:39.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:39.988 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:39.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:39.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:39.990 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:39.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:39.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:39.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:39.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:39.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:39.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:40.001 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:39.999+0000 7f8c52a5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:40.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:40.001+0000 7f8c52a5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:40.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:40.002+0000 7f8c52a5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:40.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:40.173 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:40.171+0000 7f8c52a5f780 -1 Falling back to public interface 2026-02-17T04:37:40.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:40.465 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:40.463+0000 7f8c52a5f780 -1 osd.1 140 log_to_monitors true 2026-02-17T04:37:41.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:41.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:41.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:41.318 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:41.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:41.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:41.482 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 144 up_thru 144 down_at 141 last_clean_interval [139,140) [v2:127.0.0.1:6810/4004775675,v1:127.0.0.1:6811/4004775675] [v2:127.0.0.1:6812/4004775675,v1:127.0.0.1:6813/4004775675] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:41.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:41.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:41.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:41.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:41.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:41.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:41.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:41.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:41.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:41.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:41.749 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:41.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:41.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:41.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:41.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617670 2026-02-17T04:37:41.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617670 2026-02-17T04:37:41.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617670' 2026-02-17T04:37:41.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:41.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:41.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290626 2026-02-17T04:37:41.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290626 2026-02-17T04:37:41.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617670 1-618475290626' 2026-02-17T04:37:41.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:41.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617670 2026-02-17T04:37:41.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:41.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:41.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617670 2026-02-17T04:37:41.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:41.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617670 2026-02-17T04:37:41.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617670' 2026-02-17T04:37:41.871 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617670 2026-02-17T04:37:41.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617668 -lt 575525617670 2026-02-17T04:37:42.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:43.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:43.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:43.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617670 -lt 575525617670 2026-02-17T04:37:43.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:43.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290626 2026-02-17T04:37:43.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:43.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:43.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290626 2026-02-17T04:37:43.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290626 2026-02-17T04:37:43.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290626' 2026-02-17T04:37:43.213 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 618475290626 2026-02-17T04:37:43.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:43.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290626 -lt 618475290626 2026-02-17T04:37:43.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:43.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:43.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:43.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:43.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:43.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:43.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:43.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:43.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:43.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:43.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:43.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:43.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:43.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:43.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ16 2026-02-17T04:37:43.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 16 % 2 2026-02-17T04:37:43.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:37:43.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:43.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1176: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:37:43.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:43.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:43.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:43.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:43.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:44.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:44.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:44.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ16 rm-attr snapset 2026-02-17T04:37:44.187 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:37:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:37:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:44.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:37:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:37:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:44.247 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:44.245+0000 7f36de266780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:44.248 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:44.246+0000 7f36de266780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:44.249 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:44.247+0000 7f36de266780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:44.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:37:44.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:44.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:44.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:44.469 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:44.467+0000 7f36de266780 -1 Falling back to public interface 2026-02-17T04:37:44.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:44.768 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:44.766+0000 7f36de266780 -1 osd.0 145 log_to_monitors true 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:45.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:45.731 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 149 up_thru 149 down_at 146 last_clean_interval [134,145) [v2:127.0.0.1:6800/1158736310,v1:127.0.0.1:6801/1158736310] [v2:127.0.0.1:6802/1158736310,v1:127.0.0.1:6803/1158736310] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:45.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:45.733 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:45.733 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:45.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:45.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:45.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:45.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:45.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:45.986 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:45.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:45.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:45.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:46.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127106 2026-02-17T04:37:46.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127106 2026-02-17T04:37:46.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127106' 2026-02-17T04:37:46.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:46.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:46.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290628 2026-02-17T04:37:46.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290628 2026-02-17T04:37:46.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127106 1-618475290628' 2026-02-17T04:37:46.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:46.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127106 2026-02-17T04:37:46.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:46.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:46.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127106 2026-02-17T04:37:46.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:46.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127106 2026-02-17T04:37:46.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127106' 2026-02-17T04:37:46.108 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 639950127106 2026-02-17T04:37:46.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:46.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127106 -lt 639950127106 2026-02-17T04:37:46.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:46.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290628 2026-02-17T04:37:46.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:46.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:46.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290628 2026-02-17T04:37:46.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:46.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290628 2026-02-17T04:37:46.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290628' 2026-02-17T04:37:46.276 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 618475290628 2026-02-17T04:37:46.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:46.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290627 -lt 618475290628 2026-02-17T04:37:46.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:47.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:47.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:47.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290627 -lt 618475290628 2026-02-17T04:37:47.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:48.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:37:48.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:48.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290628 -lt 618475290628 2026-02-17T04:37:48.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:48.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:48.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:48.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:48.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:49.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:49.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:49.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:49.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1177: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1178: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:37:49.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:49.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:49.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:49.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:49.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:49.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:37:49.579 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:37:49.579 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:49.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:49.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:49.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:49.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:49.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:49.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:49.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:49.641 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:49.640+0000 7f4c2e20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:49.643 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:49.641+0000 7f4c2e20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:49.644 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:49.642+0000 7f4c2e20c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:49.770 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:49.768+0000 7f4c2e20c780 -1 Falling back to public interface 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:49.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:49.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:49.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:50.066 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:50.064+0000 7f4c2e20c780 -1 osd.1 150 log_to_monitors true 2026-02-17T04:37:50.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:50.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:50.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:50.961 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:50.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:50.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:51.127 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 154 up_thru 154 down_at 151 last_clean_interval [144,150) [v2:127.0.0.1:6810/2482715013,v1:127.0.0.1:6811/2482715013] [v2:127.0.0.1:6812/2482715013,v1:127.0.0.1:6813/2482715013] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:51.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:51.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:51.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:51.129 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:51.129 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:51.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:51.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:51.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:51.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:51.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:51.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:51.384 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:51.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:51.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:51.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:51.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127108 2026-02-17T04:37:51.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127108 2026-02-17T04:37:51.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127108' 2026-02-17T04:37:51.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:51.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:51.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963586 2026-02-17T04:37:51.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963586 2026-02-17T04:37:51.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127108 1-661424963586' 2026-02-17T04:37:51.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:51.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127108 2026-02-17T04:37:51.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:51.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:51.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127108 2026-02-17T04:37:51.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127108 2026-02-17T04:37:51.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127108' 2026-02-17T04:37:51.506 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 639950127108 2026-02-17T04:37:51.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:51.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127107 -lt 639950127108 2026-02-17T04:37:51.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:52.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:52.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:52.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127108 -lt 639950127108 2026-02-17T04:37:52.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:52.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963586 2026-02-17T04:37:52.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:52.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963586 2026-02-17T04:37:52.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963586 2026-02-17T04:37:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963586' 2026-02-17T04:37:52.849 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 661424963586 2026-02-17T04:37:52.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:53.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963586 -lt 661424963586 2026-02-17T04:37:53.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:53.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:53.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:53.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:53.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:53.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:53.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:53.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:53.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:53.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:53.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:53.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:53.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:53.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:53.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:53.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:53.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:53.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:53.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:37:53.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ17 2026-02-17T04:37:53.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 17 % 2 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1183: TEST_corrupt_scrub_replicated: local payload=ROBJ17 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1184: TEST_corrupt_scrub_replicated: echo ROBJ17 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1185: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:53.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:53.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:53.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:53.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:53.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:37:53.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:53.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:53.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:53.814 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:37:53.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:37:53.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:53.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:53.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:53.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:37:53.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:37:53.864 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:37:53.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:53.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:37:53.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:37:53.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:53.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:53.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:53.875 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:53.874+0000 7f1844c2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:53.876 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:53.875+0000 7f1844c2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:53.877 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:53.876+0000 7f1844c2b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:53.998 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:53.997+0000 7f1844c2b780 -1 Falling back to public interface 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:54.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:54.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:54.292 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:54.291+0000 7f1844c2b780 -1 osd.0 156 log_to_monitors true 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:55.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:37:55.351 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 160 up_thru 160 down_at 157 last_clean_interval [149,156) [v2:127.0.0.1:6800/2983335567,v1:127.0.0.1:6801/2983335567] [v2:127.0.0.1:6802/2983335567,v1:127.0.0.1:6803/2983335567] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:37:55.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:55.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:55.353 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:55.353 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:55.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:55.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:55.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:55.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:55.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:55.606 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:55.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:55.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:55.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:55.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767362 2026-02-17T04:37:55.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767362 2026-02-17T04:37:55.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767362' 2026-02-17T04:37:55.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:55.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:55.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963588 2026-02-17T04:37:55.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963588 2026-02-17T04:37:55.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767362 1-661424963588' 2026-02-17T04:37:55.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:55.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767362 2026-02-17T04:37:55.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:55.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:55.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767362 2026-02-17T04:37:55.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:55.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767362 2026-02-17T04:37:55.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767362' 2026-02-17T04:37:55.728 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 687194767362 2026-02-17T04:37:55.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:55.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127108 -lt 687194767362 2026-02-17T04:37:55.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:37:56.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:37:56.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:37:57.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767362 -lt 687194767362 2026-02-17T04:37:57.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:57.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963588 2026-02-17T04:37:57.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:57.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:37:57.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963588 2026-02-17T04:37:57.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:57.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963588 2026-02-17T04:37:57.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963588' 2026-02-17T04:37:57.074 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 661424963588 2026-02-17T04:37:57.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:37:57.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963588 -lt 661424963588 2026-02-17T04:37:57.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:37:57.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:57.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:37:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:37:57.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:37:57.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:37:57.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:37:57.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:37:57.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:37:57.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:37:57.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1186: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:37:57.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:37:57.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:37:57.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:57.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:37:58.045 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:37:58.045 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:37:58.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:37:58.092 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:37:58.092 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:37:58.092 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:37:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:37:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:37:58.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:37:58.094 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:37:58.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:37:58.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:37:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:37:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:37:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:37:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:37:58.108 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:58.107+0000 7f81fa808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:58.109 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:58.108+0000 7f81fa808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:58.110 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:58.109+0000 7f81fa808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:37:58.246 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:58.244+0000 7f81fa808780 -1 Falling back to public interface 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:58.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:37:58.267 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:37:58.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:58.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:58.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:37:58.584 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:37:58.583+0000 7f81fa808780 -1 osd.1 161 log_to_monitors true 2026-02-17T04:37:59.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:37:59.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:37:59.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:37:59.434 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:37:59.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:37:59.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:37:59.601 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 165 up_thru 165 down_at 162 last_clean_interval [154,161) [v2:127.0.0.1:6810/1474595385,v1:127.0.0.1:6811/1474595385] [v2:127.0.0.1:6812/1474595385,v1:127.0.0.1:6813/1474595385] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:37:59.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:37:59.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:37:59.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:37:59.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:37:59.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:37:59.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:37:59.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:37:59.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:37:59.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:37:59.856 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:37:59.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:37:59.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:59.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:37:59.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767364 2026-02-17T04:37:59.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767364 2026-02-17T04:37:59.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767364' 2026-02-17T04:37:59.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:37:59.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:37:59.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603842 2026-02-17T04:37:59.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603842 2026-02-17T04:37:59.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767364 1-708669603842' 2026-02-17T04:37:59.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:37:59.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767364 2026-02-17T04:37:59.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:37:59.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:37:59.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767364 2026-02-17T04:37:59.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:37:59.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767364 2026-02-17T04:37:59.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767364' 2026-02-17T04:37:59.978 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 687194767364 2026-02-17T04:37:59.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:00.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767364 -lt 687194767364 2026-02-17T04:38:00.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:00.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603842 2026-02-17T04:38:00.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:00.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:00.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603842 2026-02-17T04:38:00.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:00.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603842 2026-02-17T04:38:00.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603842' 2026-02-17T04:38:00.147 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 708669603842 2026-02-17T04:38:00.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:00.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603842 -lt 708669603842 2026-02-17T04:38:00.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:00.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:00.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:00.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:00.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:00.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:00.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:00.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:00.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:00.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:38:00.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ18 2026-02-17T04:38:00.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 18 % 2 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1191: TEST_corrupt_scrub_replicated: local payload=ROBJ18 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1192: TEST_corrupt_scrub_replicated: echo ROBJ18 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1193: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:38:00.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:00.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:01.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:01.118 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:01.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:01.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:38:01.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:38:01.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:01.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:01.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:01.172 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:01.172+0000 7fd38dc35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:01.174 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:01.173+0000 7fd38dc35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:01.174 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:01.174+0000 7fd38dc35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:01.349 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:01.349+0000 7fd38dc35780 -1 Falling back to public interface 2026-02-17T04:38:01.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:01.671 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:01.670+0000 7fd38dc35780 -1 osd.0 167 log_to_monitors true 2026-02-17T04:38:02.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:02.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:02.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:02.498 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:02.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:02.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 171 up_thru 171 down_at 168 last_clean_interval [160,167) [v2:127.0.0.1:6800/410288151,v1:127.0.0.1:6801/410288151] [v2:127.0.0.1:6802/410288151,v1:127.0.0.1:6803/410288151] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:02.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:02.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:02.662 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:02.663 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:02.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:02.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:02.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:02.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:02.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:02.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:02.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:02.921 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:02.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:02.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407618 2026-02-17T04:38:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407618 2026-02-17T04:38:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407618' 2026-02-17T04:38:02.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:02.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:03.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603843 2026-02-17T04:38:03.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603843 2026-02-17T04:38:03.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407618 1-708669603843' 2026-02-17T04:38:03.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:03.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407618 2026-02-17T04:38:03.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:03.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:03.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407618 2026-02-17T04:38:03.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407618 2026-02-17T04:38:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407618' 2026-02-17T04:38:03.043 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407618 2026-02-17T04:38:03.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:03.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 734439407618 2026-02-17T04:38:03.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:04.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:04.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:04.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407618 -lt 734439407618 2026-02-17T04:38:04.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:04.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603843 2026-02-17T04:38:04.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:04.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:04.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603843 2026-02-17T04:38:04.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:04.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603843 2026-02-17T04:38:04.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603843' 2026-02-17T04:38:04.378 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 708669603843 2026-02-17T04:38:04.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603844 -lt 708669603843 2026-02-17T04:38:04.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:04.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:04.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:04.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:04.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:04.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:04.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:04.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:04.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:05.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:05.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1194: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:38:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:05.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:38:05.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:05.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:05.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:38:05.550 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:38:05.550 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:38:05.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:38:05.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:05.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:05.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:05.592 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:05.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:05.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:38:05.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:38:05.594 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:38:05.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:05.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:38:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:38:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:05.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:05.603 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:05.602+0000 7f86701f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:05.605 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:05.604+0000 7f86701f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:05.606 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:05.605+0000 7f86701f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:05.735 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:05.734+0000 7f86701f9780 -1 Falling back to public interface 2026-02-17T04:38:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:38:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:38:05.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:05.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:05.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:06.016 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:06.015+0000 7f86701f9780 -1 osd.1 172 log_to_monitors true 2026-02-17T04:38:06.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:06.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:06.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:06.928 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:06.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:06.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 176 up_thru 176 down_at 173 last_clean_interval [165,172) [v2:127.0.0.1:6810/1254103371,v1:127.0.0.1:6811/1254103371] [v2:127.0.0.1:6812/1254103371,v1:127.0.0.1:6813/1254103371] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:07.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:07.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:07.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:07.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:07.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:07.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:07.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:07.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:07.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:07.351 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:07.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:07.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:07.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:07.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407620 2026-02-17T04:38:07.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407620 2026-02-17T04:38:07.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407620' 2026-02-17T04:38:07.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:07.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=755914244098 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 755914244098 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407620 1-755914244098' 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407620 2026-02-17T04:38:07.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:07.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:07.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407620 2026-02-17T04:38:07.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:07.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407620 2026-02-17T04:38:07.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407620' 2026-02-17T04:38:07.474 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407620 2026-02-17T04:38:07.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:07.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407618 -lt 734439407620 2026-02-17T04:38:07.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:08.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:08.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:08.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407620 -lt 734439407620 2026-02-17T04:38:08.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:08.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-755914244098 2026-02-17T04:38:08.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:08.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:08.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-755914244098 2026-02-17T04:38:08.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=755914244098 2026-02-17T04:38:08.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 755914244098' 2026-02-17T04:38:08.813 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 755914244098 2026-02-17T04:38:08.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:08.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244098 -lt 755914244098 2026-02-17T04:38:08.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:08.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:08.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:09.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:09.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:09.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:09.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:09.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:09.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:09.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:09.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:09.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:09.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:09.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:09.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:09.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1196: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:38:09.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:09.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:09.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:09.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 corrupt-info 2026-02-17T04:38:09.790 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:38:09.790 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:38:09.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:38:09.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:38:09.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:09.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:38:09.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:09.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:38:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:38:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:09.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:09.847 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:09.845+0000 7f6ced82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:09.848 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:09.847+0000 7f6ced82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:09.849 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:09.848+0000 7f6ced82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:09.978 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:09.977+0000 7f6ced82d780 -1 Falling back to public interface 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:10.002 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:10.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:10.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:10.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:10.294 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:10.293+0000 7f6ced82d780 -1 osd.1 177 log_to_monitors true 2026-02-17T04:38:11.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:11.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:11.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:11.175 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:11.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:11.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:11.340 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 181 up_thru 181 down_at 178 last_clean_interval [176,177) [v2:127.0.0.1:6810/3888340789,v1:127.0.0.1:6811/3888340789] [v2:127.0.0.1:6812/3888340789,v1:127.0.0.1:6813/3888340789] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:38:11.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:11.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:11.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:11.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:11.341 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:11.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:11.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:11.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:11.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:11.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:11.595 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:11.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:11.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:11.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:11.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407621 2026-02-17T04:38:11.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407621 2026-02-17T04:38:11.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407621' 2026-02-17T04:38:11.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:11.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:11.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080578 2026-02-17T04:38:11.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080578 2026-02-17T04:38:11.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407621 1-777389080578' 2026-02-17T04:38:11.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:11.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407621 2026-02-17T04:38:11.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:11.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:11.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407621 2026-02-17T04:38:11.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:11.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407621 2026-02-17T04:38:11.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407621' 2026-02-17T04:38:11.717 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407621 2026-02-17T04:38:11.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:11.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407620 -lt 734439407621 2026-02-17T04:38:11.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:12.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:12.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:13.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407622 -lt 734439407621 2026-02-17T04:38:13.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:13.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080578 2026-02-17T04:38:13.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:13.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:13.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080578 2026-02-17T04:38:13.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:13.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080578 2026-02-17T04:38:13.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080578' 2026-02-17T04:38:13.053 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 777389080578 2026-02-17T04:38:13.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:13.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080578 -lt 777389080578 2026-02-17T04:38:13.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:13.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:13.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:13.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:13.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:13.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:13.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:13.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:13.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:13.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:13.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:13.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:13.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:13.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:13.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ19 2026-02-17T04:38:13.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 19 % 2 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1205: TEST_corrupt_scrub_replicated: get_pg csr_pool ROBJ0 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:38:13.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:38:13.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1205: TEST_corrupt_scrub_replicated: local pg=3.0 2026-02-17T04:38:13.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1207: TEST_corrupt_scrub_replicated: ceph tell 'osd.*' injectargs -- --osd-max-object-size=1048576 2026-02-17T04:38:14.039 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: {} 2026-02-17T04:38:14.039 INFO:tasks.workunit.client.0.trial090.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_max_object_size = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2026-02-17T04:38:14.048 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: {} 2026-02-17T04:38:14.049 INFO:tasks.workunit.client.0.trial090.stderr:osd.1: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_max_object_size = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2026-02-17T04:38:14.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1209: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-17T04:38:14.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:14.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-17T04:38:14.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:14.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-17T04:38:14.057 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-17T04:38:14.057 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:14.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:14.223 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:14.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:14.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:14.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:14.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:38:14.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:14.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:14.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:14.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:14.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:14.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:14.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:14.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:14.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-17T04:38:14.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1210: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-17T04:38:14.323 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:14.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:38:14.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:14.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:38:14.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:14.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:38:14.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:14.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:14.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:14.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:38:14.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:14.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:14.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:14.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:14.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:14.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:38:14.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:14.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:14.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-17T04:38:14.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1211: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:38:14.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:38:14.595 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:14.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:14.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:14.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.765 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.766 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:14.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:14.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:14.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:14.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1212: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:38:14.867 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:15.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:15.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:38:15.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:15.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:38:15.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:15.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:15.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:15.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:15.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:15.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:15.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:15.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:15.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-17T04:38:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1214: TEST_corrupt_scrub_replicated: pg_scrub 3.0 2026-02-17T04:38:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:38:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:38:15.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:38:15.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:38:15.137 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:15.137 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:15.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:15.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:15.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:15.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:15.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:15.526 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:15.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:15.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:15.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:15.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407623 2026-02-17T04:38:15.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407623 2026-02-17T04:38:15.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407623' 2026-02-17T04:38:15.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:15.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:15.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080580 2026-02-17T04:38:15.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080580 2026-02-17T04:38:15.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407623 1-777389080580' 2026-02-17T04:38:15.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:15.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407623 2026-02-17T04:38:15.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:15.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:15.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407623 2026-02-17T04:38:15.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:15.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407623 2026-02-17T04:38:15.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407623' 2026-02-17T04:38:15.655 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407623 2026-02-17T04:38:15.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:15.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407622 -lt 734439407623 2026-02-17T04:38:15.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:16.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:16.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:16.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407623 -lt 734439407623 2026-02-17T04:38:16.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:16.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080580 2026-02-17T04:38:16.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:16.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:16.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080580 2026-02-17T04:38:16.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:16.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080580 2026-02-17T04:38:16.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080580' 2026-02-17T04:38:16.995 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080580 2026-02-17T04:38:16.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:17.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080580 -lt 777389080580 2026-02-17T04:38:17.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:38:17.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:38:17.164 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:38:17.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:38:17.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:38:17.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:38:17.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:38:17.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:38:17.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:38:17.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:17.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:17.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:17.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:17.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:38:17.547 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:38:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:17.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:17.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:18.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:18.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:18.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:18.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:18.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:18.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:18.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:18.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:19.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:19.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:19.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:19.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:19.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:19.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:19.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:20.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:20.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:21.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:21.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:21.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:21.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:21.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:21.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:21.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:22.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:22.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:22.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:22.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:22.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:22.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:22.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:18.396193+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:22.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:38:22.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1216: TEST_corrupt_scrub_replicated: ERRORS=0 2026-02-17T04:38:22.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1217: TEST_corrupt_scrub_replicated: declare -a s_err_strings 2026-02-17T04:38:22.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1218: TEST_corrupt_scrub_replicated: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1219: TEST_corrupt_scrub_replicated: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : object info inconsistent ' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1220: TEST_corrupt_scrub_replicated: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1221: TEST_corrupt_scrub_replicated: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1222: TEST_corrupt_scrub_replicated: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1223: TEST_corrupt_scrub_replicated: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1224: TEST_corrupt_scrub_replicated: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1225: TEST_corrupt_scrub_replicated: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1226: TEST_corrupt_scrub_replicated: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1227: TEST_corrupt_scrub_replicated: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1228: TEST_corrupt_scrub_replicated: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1229: TEST_corrupt_scrub_replicated: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' 2026-02-17T04:38:22.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1230: TEST_corrupt_scrub_replicated: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1231: TEST_corrupt_scrub_replicated: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1232: TEST_corrupt_scrub_replicated: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : candidate size 1 info size 7 mismatch' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1233: TEST_corrupt_scrub_replicated: err_strings[15]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1234: TEST_corrupt_scrub_replicated: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1235: TEST_corrupt_scrub_replicated: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1236: TEST_corrupt_scrub_replicated: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049713/1049720 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1237: TEST_corrupt_scrub_replicated: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 1 missing, 8 inconsistent objects' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1238: TEST_corrupt_scrub_replicated: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 18 errors' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1239: TEST_corrupt_scrub_replicated: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:123a5f55:::ROBJ19:head : size 1049600 > 1048576 is too large' 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : candidate size 1 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049713/1049720 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 1 missing, 8 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 18 errors' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:22.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:123a5f55:::ROBJ19:head : size 1049600 > 1048576 is too large' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1250: TEST_corrupt_scrub_replicated: rados list-inconsistent-pg csr_pool 2026-02-17T04:38:22.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1252: TEST_corrupt_scrub_replicated: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:38:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1252: TEST_corrupt_scrub_replicated: test 1 = 1 2026-02-17T04:38:22.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1254: TEST_corrupt_scrub_replicated: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:38:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1254: TEST_corrupt_scrub_replicated: test 3.0 = 3.0 2026-02-17T04:38:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1256: TEST_corrupt_scrub_replicated: rados list-inconsistent-obj 3.0 2026-02-17T04:38:22.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1258: TEST_corrupt_scrub_replicated: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1258: TEST_corrupt_scrub_replicated: epoch=181 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:38:22.556 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-17T04:38:22.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:38:22.570 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:38:22.571 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:38:22.571 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:38:22.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-17T04:38:22.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:38:22.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2174: TEST_corrupt_scrub_replicated: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:38:22.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:38:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2175: TEST_corrupt_scrub_replicated: test no = yes 2026-02-17T04:38:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2180: TEST_corrupt_scrub_replicated: test '' = yes 2026-02-17T04:38:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2185: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-17T04:38:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2187: TEST_corrupt_scrub_replicated: echo -n ZZZ 2026-02-17T04:38:22.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2188: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2190: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:38:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:22.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:22.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:38:22.797 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:22.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:22.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:38:22.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:38:22.846 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:38:22.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:22.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:38:22.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:38:22.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:22.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:22.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:22.860 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:22.858+0000 7f51c202d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:22.862 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:22.860+0000 7f51c202d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:22.862 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:22.861+0000 7f51c202d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:22.988 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:22.986+0000 7f51c202d780 -1 Falling back to public interface 2026-02-17T04:38:23.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:38:23.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:23.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:23.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:23.276 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:23.274+0000 7f51c202d780 -1 osd.0 182 log_to_monitors true 2026-02-17T04:38:24.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:24.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:24.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:24.178 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:24.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:24.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:24.345 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 186 up_thru 186 down_at 183 last_clean_interval [171,182) [v2:127.0.0.1:6800/1849225675,v1:127.0.0.1:6801/1849225675] [v2:127.0.0.1:6802/1849225675,v1:127.0.0.1:6803/1849225675] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:38:24.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:24.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:24.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:24.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:24.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:24.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:24.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:24.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:24.346 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:24.347 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:24.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:24.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:24.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:24.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:24.600 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:24.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:24.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:24.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=798863917058 2026-02-17T04:38:24.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 798863917058 2026-02-17T04:38:24.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-798863917058' 2026-02-17T04:38:24.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:24.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:24.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080582 2026-02-17T04:38:24.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080582 2026-02-17T04:38:24.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-798863917058 1-777389080582' 2026-02-17T04:38:24.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:24.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-798863917058 2026-02-17T04:38:24.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:24.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:24.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-798863917058 2026-02-17T04:38:24.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:24.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=798863917058 2026-02-17T04:38:24.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 798863917058' 2026-02-17T04:38:24.721 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 798863917058 2026-02-17T04:38:24.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:24.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 798863917058 2026-02-17T04:38:24.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:25.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:25.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 798863917058 2026-02-17T04:38:26.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:27.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:38:27.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:27.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 798863917058 -lt 798863917058 2026-02-17T04:38:27.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:27.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080582 2026-02-17T04:38:27.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:27.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:27.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080582 2026-02-17T04:38:27.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:27.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080582 2026-02-17T04:38:27.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080582' 2026-02-17T04:38:27.232 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 777389080582 2026-02-17T04:38:27.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:27.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080583 -lt 777389080582 2026-02-17T04:38:27.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:27.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:27.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:27.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:27.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:27.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:27.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:27.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:27.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:27.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:27.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:27.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2191: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-17T04:38:27.996 INFO:tasks.workunit.client.0.trial090.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2193: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2194: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:27.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:28.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:28.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-17T04:38:28.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:28.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:28.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:38:28.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:28.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:28.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ10 get-attr _ 2026-02-17T04:38:28.150 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:38:28.150 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:28.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:28.195 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:38:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:38:28.197 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:38:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:28.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:38:28.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:38:28.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:28.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:28.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:28.208 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:28.206+0000 7f304742f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:28.209 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:28.207+0000 7f304742f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:28.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:28.208+0000 7f304742f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:28.346 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:28.344+0000 7f304742f780 -1 Falling back to public interface 2026-02-17T04:38:28.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:28.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:28.621 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:28.619+0000 7f304742f780 -1 osd.1 188 log_to_monitors true 2026-02-17T04:38:29.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:29.528 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 191 up_thru 191 down_at 188 last_clean_interval [181,188) [v2:127.0.0.1:6810/2844129503,v1:127.0.0.1:6811/2844129503] [v2:127.0.0.1:6812/2844129503,v1:127.0.0.1:6813/2844129503] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:29.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:29.694 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:29.694 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:29.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:29.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:29.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:29.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:29.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:29.953 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:29.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:29.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:29.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:30.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=798863917060 2026-02-17T04:38:30.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 798863917060 2026-02-17T04:38:30.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-798863917060' 2026-02-17T04:38:30.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:30.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:30.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=820338753538 2026-02-17T04:38:30.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 820338753538 2026-02-17T04:38:30.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-798863917060 1-820338753538' 2026-02-17T04:38:30.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:30.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-798863917060 2026-02-17T04:38:30.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:30.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:30.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-798863917060 2026-02-17T04:38:30.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:30.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=798863917060 2026-02-17T04:38:30.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 798863917060' 2026-02-17T04:38:30.072 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 798863917060 2026-02-17T04:38:30.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:30.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 798863917060 -lt 798863917060 2026-02-17T04:38:30.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:30.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-820338753538 2026-02-17T04:38:30.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:30.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:30.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-820338753538 2026-02-17T04:38:30.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:30.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=820338753538 2026-02-17T04:38:30.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 820338753538' 2026-02-17T04:38:30.242 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 820338753538 2026-02-17T04:38:30.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:30.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 820338753538 -lt 820338753538 2026-02-17T04:38:30.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:30.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:30.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:30.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:30.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:30.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:30.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:30.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:30.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:31.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:31.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:31.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:31.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2195: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ10 key2-ROBJ10 val2-ROBJ10 2026-02-17T04:38:31.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2196: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:31.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:31.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:38:31.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:31.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:31.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:31.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:31.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:31.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:31.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:31.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:31.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:31.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:38:31.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:31.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:31.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:31.235 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:31.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:31.276 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:31.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:31.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:38:31.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:38:31.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:31.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:31.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:31.289 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:31.287+0000 7fb72dc2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:31.290 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:31.288+0000 7fb72dc2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:31.291 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:31.289+0000 7fb72dc2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:31.422 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:31.420+0000 7fb72dc2f780 -1 Falling back to public interface 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:31.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:31.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:31.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:31.722 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:31.720+0000 7fb72dc2f780 -1 osd.0 192 log_to_monitors true 2026-02-17T04:38:32.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:32.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:32.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:32.615 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:32.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:32.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:32.780 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 196 up_thru 196 down_at 193 last_clean_interval [186,192) [v2:127.0.0.1:6800/1367968586,v1:127.0.0.1:6801/1367968586] [v2:127.0.0.1:6802/1367968586,v1:127.0.0.1:6803/1367968586] exists,up 76db967e-ef86-4a80-92b6-56f605d53d75 2026-02-17T04:38:32.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:32.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:32.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:32.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:33.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:33.037 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:33.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=841813590018 2026-02-17T04:38:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 841813590018 2026-02-17T04:38:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590018' 2026-02-17T04:38:33.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:33.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:33.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=820338753539 2026-02-17T04:38:33.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 820338753539 2026-02-17T04:38:33.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590018 1-820338753539' 2026-02-17T04:38:33.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:33.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-841813590018 2026-02-17T04:38:33.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:33.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:33.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-841813590018 2026-02-17T04:38:33.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:33.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=841813590018 2026-02-17T04:38:33.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 841813590018' 2026-02-17T04:38:33.159 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 841813590018 2026-02-17T04:38:33.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:33.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 841813590018 2026-02-17T04:38:33.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:34.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:34.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:34.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590018 -lt 841813590018 2026-02-17T04:38:34.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:34.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-820338753539 2026-02-17T04:38:34.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:34.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:34.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-820338753539 2026-02-17T04:38:34.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:34.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=820338753539 2026-02-17T04:38:34.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 820338753539' 2026-02-17T04:38:34.500 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 820338753539 2026-02-17T04:38:34.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:34.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 820338753540 -lt 820338753539 2026-02-17T04:38:34.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:34.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:34.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:34.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:34.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:34.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:34.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:34.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:34.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:34.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:34.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:35.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:35.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:35.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:35.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2197: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:38:35.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:38:35.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:35.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:35.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:35.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:35.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:35.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:35.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-17T04:38:35.475 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:38:35.475 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:38:35.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:35.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:38:35.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:38:35.520 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:38:35.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:35.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:38:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:38:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:38:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:38:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:38:35.531 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:35.529+0000 7fde4c02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:35.532 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:35.531+0000 7fde4c02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:35.533 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:35.532+0000 7fde4c02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:35.681 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:38:35.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:35.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:35.732 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:35.730+0000 7fde4c02d780 -1 Falling back to public interface 2026-02-17T04:38:35.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:35.999 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:35.997+0000 7fde4c02d780 -1 osd.1 197 log_to_monitors true 2026-02-17T04:38:36.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:36.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:36.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:36.847 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:38:36.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:36.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 201 up_thru 201 down_at 198 last_clean_interval [191,197) [v2:127.0.0.1:6810/4266629025,v1:127.0.0.1:6811/4266629025] [v2:127.0.0.1:6812/4266629025,v1:127.0.0.1:6813/4266629025] exists,up 06a3f185-038e-4b6c-94be-0814cac75e6e 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:37.011 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:37.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:37.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:37.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:37.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:37.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:37.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:37.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:37.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:37.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:37.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:37.271 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:37.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:37.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:37.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:37.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=841813590020 2026-02-17T04:38:37.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 841813590020 2026-02-17T04:38:37.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590020' 2026-02-17T04:38:37.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:37.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:37.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=863288426498 2026-02-17T04:38:37.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 863288426498 2026-02-17T04:38:37.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590020 1-863288426498' 2026-02-17T04:38:37.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:37.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-841813590020 2026-02-17T04:38:37.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:37.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:37.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-841813590020 2026-02-17T04:38:37.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:37.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=841813590020 2026-02-17T04:38:37.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 841813590020' 2026-02-17T04:38:37.394 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 841813590020 2026-02-17T04:38:37.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:37.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590018 -lt 841813590020 2026-02-17T04:38:37.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:38.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:38.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:38.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590020 -lt 841813590020 2026-02-17T04:38:38.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:38.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-863288426498 2026-02-17T04:38:38.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:38.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:38.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-863288426498 2026-02-17T04:38:38.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:38.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=863288426498 2026-02-17T04:38:38.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 863288426498' 2026-02-17T04:38:38.731 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 863288426498 2026-02-17T04:38:38.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:38.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 863288426498 -lt 863288426498 2026-02-17T04:38:38.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:38.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:38.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:39.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:39.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:39.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:39.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:39.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:39.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:39.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:39.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:39.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:39.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2198: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2200: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-17T04:38:39.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-17T04:38:39.486 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-17T04:38:39.486 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:39.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:38:39.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:39.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:39.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:39.659 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:38:39.659 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:39.659 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:39.660 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:39.660 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:39.660 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:39.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:39.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:39.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:39.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:39.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-17T04:38:39.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2201: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:39.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-17T04:38:39.760 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-17T04:38:39.760 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:39.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:38:39.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:39.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:39.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:39.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:39.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:39.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:39.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:39.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:38:39.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:39.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:39.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2202: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:40.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:38:40.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:38:40.028 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:40.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:40.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:38:40.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:40.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:40.198 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:40.199 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:40.199 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:40.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:40.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:40.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:40.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:40.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:38:40.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:40.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2203: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:38:40.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:38:40.299 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:38:40.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:38:40.466 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:38:40.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:38:40.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:40.469 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:40.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:40.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:38:40.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:38:40.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:40.520 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:40.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:38:40.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:38:40.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-17T04:38:40.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2206: TEST_corrupt_scrub_replicated: ceph tell 'osd.*' injectargs -- --osd-max-object-size=134217728 2026-02-17T04:38:40.621 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: {} 2026-02-17T04:38:40.621 INFO:tasks.workunit.client.0.trial090.stderr:osd.0: osd_max_object_size = '' 2026-02-17T04:38:40.631 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: {} 2026-02-17T04:38:40.631 INFO:tasks.workunit.client.0.trial090.stderr:osd.1: osd_max_object_size = '' 2026-02-17T04:38:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2208: TEST_corrupt_scrub_replicated: pg_deep_scrub 3.0 2026-02-17T04:38:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:38:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:38:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:38:40.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:38:40.636 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:40.636 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:40.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:40.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:40.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:40.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:38:40.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:38:40.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:38:40.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:38:40.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:40.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:41.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:41.028 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:41.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:41.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:41.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:41.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=841813590021 2026-02-17T04:38:41.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 841813590021 2026-02-17T04:38:41.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590021' 2026-02-17T04:38:41.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:41.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:41.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=863288426500 2026-02-17T04:38:41.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 863288426500 2026-02-17T04:38:41.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590021 1-863288426500' 2026-02-17T04:38:41.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:41.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-841813590021 2026-02-17T04:38:41.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:41.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:41.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-841813590021 2026-02-17T04:38:41.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:41.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=841813590021 2026-02-17T04:38:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 841813590021' 2026-02-17T04:38:41.152 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 841813590021 2026-02-17T04:38:41.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:41.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590020 -lt 841813590021 2026-02-17T04:38:41.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:42.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:42.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:42.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590022 -lt 841813590021 2026-02-17T04:38:42.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:42.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-863288426500 2026-02-17T04:38:42.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:42.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-863288426500 2026-02-17T04:38:42.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=863288426500 2026-02-17T04:38:42.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 863288426500' 2026-02-17T04:38:42.496 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 863288426500 2026-02-17T04:38:42.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:42.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 863288426500 -lt 863288426500 2026-02-17T04:38:42.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:38:42.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:38:42.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:38:42.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:42.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:38:42.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:42.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:38:43.047 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:36:38.022133+0000 last_deep_scrub_stamp 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:38:43.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:43.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:38:43.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:43.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:44.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:44.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:44.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:38:44.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:44.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:38:44.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:44.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:38:44.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:44.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:45.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:45.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:45.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:38:45.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:45.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:38:45.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:45.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:38:45.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:36:38.022133+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:45.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:46.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:46.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:46.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:38:46.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:46.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:38:46.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:46.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:43.948049+0000 '>' 2026-02-17T04:36:38.022133+0000 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2210: TEST_corrupt_scrub_replicated: err_strings=() 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2211: TEST_corrupt_scrub_replicated: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2212: TEST_corrupt_scrub_replicated: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)], object info inconsistent ' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2213: TEST_corrupt_scrub_replicated: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)]' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2214: TEST_corrupt_scrub_replicated: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : failed to pick suitable auth object' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2215: TEST_corrupt_scrub_replicated: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2216: TEST_corrupt_scrub_replicated: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' 2026-02-17T04:38:46.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2217: TEST_corrupt_scrub_replicated: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2218: TEST_corrupt_scrub_replicated: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2219: TEST_corrupt_scrub_replicated: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:87abbf36:::ROBJ11:head : candidate had a read error' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2220: TEST_corrupt_scrub_replicated: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2221: TEST_corrupt_scrub_replicated: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2222: TEST_corrupt_scrub_replicated: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8aa5320e:::ROBJ17:head : failed to pick suitable auth object' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2223: TEST_corrupt_scrub_replicated: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0xefced57a != omap_digest 0x6a73cc07 from shard 1' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2224: TEST_corrupt_scrub_replicated: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0x6a73cc07 != omap_digest 0xefced57a from auth oi 3:8b55fa4b:::ROBJ7:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 21 dd 2ddbf8f5 od efced57a alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2225: TEST_corrupt_scrub_replicated: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:a53c12e8:::ROBJ6:head : omap_digest 0x689ee887 != omap_digest 0x179c919f from shard 1, omap_digest 0x689ee887 != omap_digest 0x179c919f from auth oi 3:a53c12e8:::ROBJ6:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 18 dd 2ddbf8f5 od 179c919f alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2226: TEST_corrupt_scrub_replicated: err_strings[15]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2227: TEST_corrupt_scrub_replicated: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2228: TEST_corrupt_scrub_replicated: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:b1f19cbd:::ROBJ10:head : failed to pick suitable auth object' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2229: TEST_corrupt_scrub_replicated: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' 2026-02-17T04:38:46.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2230: TEST_corrupt_scrub_replicated: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2231: TEST_corrupt_scrub_replicated: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2232: TEST_corrupt_scrub_replicated: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2233: TEST_corrupt_scrub_replicated: err_strings[22]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2234: TEST_corrupt_scrub_replicated: err_strings[23]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from shard 0, data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2235: TEST_corrupt_scrub_replicated: err_strings[24]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:d60617f9:::ROBJ13:head : candidate had a read error' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2236: TEST_corrupt_scrub_replicated: err_strings[25]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2237: TEST_corrupt_scrub_replicated: err_strings[26]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:d60617f9:::ROBJ13:head : failed to pick suitable object info' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2238: TEST_corrupt_scrub_replicated: err_strings[27]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:e97ce31e:::ROBJ2:head : data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from shard 1, data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from auth oi 3:e97ce31e:::ROBJ2:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 6 dd 2ddbf8f5 od f8e11918 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2239: TEST_corrupt_scrub_replicated: err_strings[28]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2240: TEST_corrupt_scrub_replicated: err_strings[29]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:f4981d31:::ROBJ4:head : omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from shard 1, omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from auth oi 3:f4981d31:::ROBJ4:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 12 dd 2ddbf8f5 od e2d46ea4 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2241: TEST_corrupt_scrub_replicated: err_strings[30]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x1a862a41 != omap_digest 0x6cac8f6 from shard 1' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2242: TEST_corrupt_scrub_replicated: err_strings[31]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x6cac8f6 != omap_digest 0x1a862a41 from auth oi 3:f4bfd4d1:::ROBJ5:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 15 dd 2ddbf8f5 od 1a862a41 alloc_hint [[]0 0 0[]][)]' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2243: TEST_corrupt_scrub_replicated: err_strings[32]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : candidate size 3 info size 7 mismatch' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2244: TEST_corrupt_scrub_replicated: err_strings[33]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2245: TEST_corrupt_scrub_replicated: err_strings[34]='log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2246: TEST_corrupt_scrub_replicated: err_strings[35]='log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2247: TEST_corrupt_scrub_replicated: err_strings[36]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049715/1049716 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2248: TEST_corrupt_scrub_replicated: err_strings[37]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 1 missing, 11 inconsistent objects' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2249: TEST_corrupt_scrub_replicated: err_strings[38]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 35 errors' 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)], object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:87abbf36:::ROBJ11:head : candidate had a read error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8aa5320e:::ROBJ17:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0xefced57a != omap_digest 0x6a73cc07 from shard 1' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0x6a73cc07 != omap_digest 0xefced57a from auth oi 3:8b55fa4b:::ROBJ7:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 21 dd 2ddbf8f5 od efced57a alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:a53c12e8:::ROBJ6:head : omap_digest 0x689ee887 != omap_digest 0x179c919f from shard 1, omap_digest 0x689ee887 != omap_digest 0x179c919f from auth oi 3:a53c12e8:::ROBJ6:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 18 dd 2ddbf8f5 od 179c919f alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:b1f19cbd:::ROBJ10:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from shard 0, data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:d60617f9:::ROBJ13:head : candidate had a read error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:d60617f9:::ROBJ13:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:e97ce31e:::ROBJ2:head : data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from shard 1, data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from auth oi 3:e97ce31e:::ROBJ2:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 6 dd 2ddbf8f5 od f8e11918 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:f4981d31:::ROBJ4:head : omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from shard 1, omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from auth oi 3:f4981d31:::ROBJ4:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 12 dd 2ddbf8f5 od e2d46ea4 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x1a862a41 != omap_digest 0x6cac8f6 from shard 1' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x6cac8f6 != omap_digest 0x1a862a41 from auth oi 3:f4bfd4d1:::ROBJ5:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 15 dd 2ddbf8f5 od 1a862a41 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : candidate size 3 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049715/1049716 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 1 missing, 11 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-17T04:38:46.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 35 errors' td/osd-scrub-repair/osd.1.log 2026-02-17T04:38:46.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2260: TEST_corrupt_scrub_replicated: rados list-inconsistent-pg csr_pool 2026-02-17T04:38:46.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2262: TEST_corrupt_scrub_replicated: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:38:46.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2262: TEST_corrupt_scrub_replicated: test 1 = 1 2026-02-17T04:38:46.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2264: TEST_corrupt_scrub_replicated: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:38:46.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2264: TEST_corrupt_scrub_replicated: test 3.0 = 3.0 2026-02-17T04:38:46.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2266: TEST_corrupt_scrub_replicated: rados list-inconsistent-obj 3.0 2026-02-17T04:38:46.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2268: TEST_corrupt_scrub_replicated: jq .epoch td/osd-scrub-repair/json 2026-02-17T04:38:46.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2268: TEST_corrupt_scrub_replicated: epoch=201 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:38:46.992 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-17T04:38:46.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:38:47.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-17T04:38:47.007 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:38:47.008 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:38:47.009 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:38:47.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-17T04:38:47.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:38:47.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3699: TEST_corrupt_scrub_replicated: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:38:47.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:38:47.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3700: TEST_corrupt_scrub_replicated: test no = yes 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3705: TEST_corrupt_scrub_replicated: test '' = yes 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3710: TEST_corrupt_scrub_replicated: repair 3.0 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=3.0 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 3.0 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:47.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:47.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:47.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:47.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 3.0 2026-02-17T04:38:47.337 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to repair 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 3.0 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:47.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:47.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:47.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:47.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:47.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:43.948049+0000 '>' 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:47.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:48.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:43.948049+0000 '>' 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:48.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:49.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:49.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:49.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:49.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:49.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:49.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:49.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:49.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:43.948049+0000 '>' 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:49.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:50.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:50.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:50.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:50.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:50.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:50.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:50.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:51.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:43.948049+0000 '>' 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:51.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:38:52.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:38:52.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:38:52.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:38:52.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:38:52.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:38:52.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:38:52.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:38:52.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:38:48.953960+0000 '>' 2026-02-17T04:38:43.948049+0000 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3711: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:38:52.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:38:52.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:38:52.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:38:52.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:38:52.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:38:52.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:38:52.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:38:52.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:38:52.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:38:52.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:38:52.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:38:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:38:52.446 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:38:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:38:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:52.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:38:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=841813590025 2026-02-17T04:38:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 841813590025 2026-02-17T04:38:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590025' 2026-02-17T04:38:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:38:52.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:38:52.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=863288426503 2026-02-17T04:38:52.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 863288426503 2026-02-17T04:38:52.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-841813590025 1-863288426503' 2026-02-17T04:38:52.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:52.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-841813590025 2026-02-17T04:38:52.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:52.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:38:52.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-841813590025 2026-02-17T04:38:52.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:52.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=841813590025 2026-02-17T04:38:52.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 841813590025' 2026-02-17T04:38:52.571 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 841813590025 2026-02-17T04:38:52.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:52.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590024 -lt 841813590025 2026-02-17T04:38:52.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:53.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:38:53.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:53.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590024 -lt 841813590025 2026-02-17T04:38:53.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:38:54.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:38:54.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:38:55.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 841813590025 -lt 841813590025 2026-02-17T04:38:55.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:38:55.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-863288426503 2026-02-17T04:38:55.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:38:55.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:38:55.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-863288426503 2026-02-17T04:38:55.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:38:55.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=863288426503 2026-02-17T04:38:55.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 863288426503' 2026-02-17T04:38:55.078 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 863288426503 2026-02-17T04:38:55.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:38:55.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 863288426503 -lt 863288426503 2026-02-17T04:38:55.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:38:55.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:55.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:55.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:38:55.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:38:55.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:38:55.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:38:55.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:38:55.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:38:55.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:38:55.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:38:55.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:38:55.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:38:55.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:38:55.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:38:55.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:38:55.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:38:55.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:38:55.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3714: TEST_corrupt_scrub_replicated: timeout 30 rados -p csr_pool get ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-17T04:38:55.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3715: TEST_corrupt_scrub_replicated: timeout 30 rados -p csr_pool get ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-17T04:38:55.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3717: TEST_corrupt_scrub_replicated: diff -q td/osd-scrub-repair/new.ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-17T04:38:55.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3718: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-17T04:38:55.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3719: TEST_corrupt_scrub_replicated: diff -q td/osd-scrub-repair/new.ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-17T04:38:55.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3720: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-17T04:38:55.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3722: TEST_corrupt_scrub_replicated: '[' 0 '!=' 0 ']' 2026-02-17T04:38:55.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3728: TEST_corrupt_scrub_replicated: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-17T04:38:56.088 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' removed 2026-02-17T04:38:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:38:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:38:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:38:56.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:56.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:56.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:56.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:56.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:56.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:56.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:38:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:38:56.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:38:56.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:38:56.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:38:56.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:38:56.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:38:56.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:38:56.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:38:56.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:38:56.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:38:56.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:38:56.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:38:56.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:38:56.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:38:56.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:38:56.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:38:56.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:38:56.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:38:56.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:38:56.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:38:56.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:38:56.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:38:56.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:38:56.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:38:56.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:38:56.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:38:56.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:38:56.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:38:56.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:38:56.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:38:56.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:38:56.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:38:56.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:38:56.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:38:56.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:38:56.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:38:56.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:38:56.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:38:56.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:38:56.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_snapset_scrub_rep td/osd-scrub-repair 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6100: TEST_corrupt_snapset_scrub_rep: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6101: TEST_corrupt_snapset_scrub_rep: local poolname=csr_pool 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6102: TEST_corrupt_snapset_scrub_rep: local total_objs=2 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6104: TEST_corrupt_snapset_scrub_rep: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:38:56.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-17T04:38:56.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:38:56.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:56.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:56.279 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:56.279 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.279 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:56.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:38:56.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:38:56.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:38:56.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:38:56.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:38:56.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.306 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.307 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:38:56.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:38:56.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:38:56.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:38:56.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:38:56.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6105: TEST_corrupt_snapset_scrub_rep: run_mgr td/osd-scrub-repair x 2026-02-17T04:38:56.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:38:56.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:38:56.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:38:56.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:38:56.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:38:56.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:38:56.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:56.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:56.478 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:56.478 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.478 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:56.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:38:56.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:38:56.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6106: TEST_corrupt_snapset_scrub_rep: run_osd td/osd-scrub-repair 0 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:38:56.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:38:56.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:38:56.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:38:56.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:38:56.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dd239c4c-af03-497a-89e4-0f30d9ae82e7 2026-02-17T04:38:56.498 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 dd239c4c-af03-497a-89e4-0f30d9ae82e7 2026-02-17T04:38:56.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 dd239c4c-af03-497a-89e4-0f30d9ae82e7' 2026-02-17T04:38:56.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:38:56.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDg8JNpIhktHhAAUi7As1fp4lCktPh9kovyYw== 2026-02-17T04:38:56.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDg8JNpIhktHhAAUi7As1fp4lCktPh9kovyYw=="}' 2026-02-17T04:38:56.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dd239c4c-af03-497a-89e4-0f30d9ae82e7 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:38:56.588 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:38:56.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:38:56.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDg8JNpIhktHhAAUi7As1fp4lCktPh9kovyYw== --osd-uuid dd239c4c-af03-497a-89e4-0f30d9ae82e7 2026-02-17T04:38:56.613 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:56.611+0000 7fb75cfe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:56.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:56.612+0000 7fb75cfe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:56.615 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:56.613+0000 7fb75cfe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:56.615 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:56.613+0000 7fb75cfe3780 -1 bdev(0x2440c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:38:56.616 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:56.613+0000 7fb75cfe3780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:38:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:38:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:38:57.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:38:57.064 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:38:57.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:38:57.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:38:57.151 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:38:57.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:38:57.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:38:57.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:38:57.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:38:57.166 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:57.164+0000 7f7c3ec0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:57.167 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:57.165+0000 7f7c3ec0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:57.168 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:57.166+0000 7f7c3ec0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:57.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:38:57.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:38:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:38:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:38:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:38:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:57.231 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:38:57.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:38:57.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:57.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:57.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:57.341 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:57.339+0000 7f7c3ec0e780 -1 Falling back to public interface 2026-02-17T04:38:57.724 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:57.723+0000 7f7c3ec0e780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:38:58.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:58.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:58.311 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:38:58.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:38:58.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:58.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:58.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:38:59.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:38:59.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:38:59.391 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:38:59.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T04:38:59.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:38:59.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:38:59.555 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1329388370,v1:127.0.0.1:6801/1329388370] [v2:127.0.0.1:6802/1329388370,v1:127.0.0.1:6803/1329388370] exists,up dd239c4c-af03-497a-89e4-0f30d9ae82e7 2026-02-17T04:38:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:38:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:38:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:38:59.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6107: TEST_corrupt_snapset_scrub_rep: run_osd td/osd-scrub-repair 1 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:38:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:38:59.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e71e4429-cb58-456a-9d72-d800747a5fe0 2026-02-17T04:38:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e71e4429-cb58-456a-9d72-d800747a5fe0' 2026-02-17T04:38:59.564 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e71e4429-cb58-456a-9d72-d800747a5fe0 2026-02-17T04:38:59.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:38:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDj8JNpBbXZIRAA5MkjGYxgbvxAdU0ejrun8g== 2026-02-17T04:38:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDj8JNpBbXZIRAA5MkjGYxgbvxAdU0ejrun8g=="}' 2026-02-17T04:38:59.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e71e4429-cb58-456a-9d72-d800747a5fe0 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:38:59.739 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:38:59.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:38:59.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDj8JNpBbXZIRAA5MkjGYxgbvxAdU0ejrun8g== --osd-uuid e71e4429-cb58-456a-9d72-d800747a5fe0 2026-02-17T04:38:59.763 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:59.762+0000 7f9263c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:59.765 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:59.763+0000 7f9263c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:59.765 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:59.764+0000 7f9263c10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:38:59.766 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:59.764+0000 7f9263c10780 -1 bdev(0x2e6cc00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:38:59.766 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:38:59.764+0000 7f9263c10780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:39:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:39:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:39:00.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:39:00.099 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:39:00.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:39:00.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:39:00.313 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:39:00.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:39:00.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:39:00.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:39:00.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:39:00.327 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:00.325+0000 7fa478869780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:00.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:00.326+0000 7fa478869780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:00.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:00.327+0000 7fa478869780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:00.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:00.466+0000 7fa478869780 -1 Falling back to public interface 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:39:00.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:39:00.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:00.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:00.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:39:00.783 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:00.781+0000 7fa478869780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:39:01.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:39:01.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:01.649 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:39:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:39:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3676683927,v1:127.0.0.1:6811/3676683927] [v2:127.0.0.1:6812/3676683927,v1:127.0.0.1:6813/3676683927] exists,up e71e4429-cb58-456a-9d72-d800747a5fe0 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6108: TEST_corrupt_snapset_scrub_rep: create_rbd_pool 2026-02-17T04:39:01.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:39:01.974 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:39:01.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:39:01.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:39:02.197 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:39:02.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:03.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:39:03.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6109: TEST_corrupt_snapset_scrub_rep: wait_for_clean 2026-02-17T04:39:03.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:03.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:03.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:03.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:03.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:03.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:03.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:03.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:03.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:03.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:04.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:04.014 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:04.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:04.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:04.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:39:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:39:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:39:04.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:04.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:04.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:39:04.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:39:04.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-17T04:39:04.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:04.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:39:04.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:04.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:04.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:39:04.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:04.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:39:04.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:39:04.138 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:39:04.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:04.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:39:04.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:05.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:05.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:05.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:39:05.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:05.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:39:05.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:05.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:05.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:39:05.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:05.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:39:05.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:39:05.475 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:39:05.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:05.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-17T04:39:05.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:05.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:05.640 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:05.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:39:05.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:05.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:06.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:39:06.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:06.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:06.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:06.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:39:06.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:06.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:06.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6111: TEST_corrupt_snapset_scrub_rep: create_pool foo 1 2026-02-17T04:39:06.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-17T04:39:06.475 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T04:39:06.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:07.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6112: TEST_corrupt_snapset_scrub_rep: create_pool csr_pool 1 1 2026-02-17T04:39:07.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-17T04:39:07.706 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' created 2026-02-17T04:39:07.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:08.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6113: TEST_corrupt_snapset_scrub_rep: wait_for_clean 2026-02-17T04:39:08.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:08.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:08.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:08.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:08.720 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:08.720 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:08.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:08.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:08.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:08.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:08.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:08.982 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:08.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:08.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:08.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T04:39:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T04:39:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T04:39:09.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:09.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:09.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:39:09.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:39:09.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-17T04:39:09.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T04:39:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:09.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:09.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T04:39:09.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:09.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T04:39:09.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T04:39:09.105 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836484 2026-02-17T04:39:09.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:09.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836484 2026-02-17T04:39:09.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:10.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:10.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:10.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836484 2026-02-17T04:39:10.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:11.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:39:11.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-17T04:39:11.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:11.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:39:11.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:11.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:11.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:39:11.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:11.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:39:11.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:39:11.609 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672964 2026-02-17T04:39:11.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:11.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T04:39:11.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:11.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:11.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:11.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:39:11.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:11.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:11.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:11.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:11.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:11.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:11.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:12.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:39:12.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:12.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:12.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:12.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:39:12.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:12.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:12.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: seq 1 2 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6116: TEST_corrupt_snapset_scrub_rep: objname=ROBJ1 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6117: TEST_corrupt_snapset_scrub_rep: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:12.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:12.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:12.617 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:12.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:12.820 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:12.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:12.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:12.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:12.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6119: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-17T04:39:12.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6120: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6116: TEST_corrupt_snapset_scrub_rep: objname=ROBJ2 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6117: TEST_corrupt_snapset_scrub_rep: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:12.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:13.091 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:13.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:13.296 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:13.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:13.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:13.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:13.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6119: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-17T04:39:13.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6120: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-17T04:39:13.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6123: TEST_corrupt_snapset_scrub_rep: get_pg csr_pool ROBJ0 2026-02-17T04:39:13.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-17T04:39:13.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-17T04:39:13.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:39:13.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:39:13.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6123: TEST_corrupt_snapset_scrub_rep: local pg=3.0 2026-02-17T04:39:13.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6124: TEST_corrupt_snapset_scrub_rep: get_primary csr_pool ROBJ0 2026-02-17T04:39:13.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-17T04:39:13.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-17T04:39:13.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:39:13.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:39:13.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6124: TEST_corrupt_snapset_scrub_rep: local primary=1 2026-02-17T04:39:13.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6126: TEST_corrupt_snapset_scrub_rep: rados -p csr_pool mksnap snap1 2026-02-17T04:39:13.761 INFO:tasks.workunit.client.0.trial090.stdout:created pool csr_pool snap snap1 2026-02-17T04:39:13.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6127: TEST_corrupt_snapset_scrub_rep: echo -n head_of_snapshot_data 2026-02-17T04:39:13.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: seq 1 2 2026-02-17T04:39:13.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-17T04:39:13.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6130: TEST_corrupt_snapset_scrub_rep: objname=ROBJ1 2026-02-17T04:39:13.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: expr 1 % 2 2026-02-17T04:39:13.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: local osd=1 2026-02-17T04:39:13.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6135: TEST_corrupt_snapset_scrub_rep: case $i in 2026-02-17T04:39:13.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6137: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/change 2026-02-17T04:39:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6138: TEST_corrupt_snapset_scrub_rep: objectstore_tool td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-17T04:39:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:39:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:39:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:39:13.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:39:14.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 --head ROBJ1 clear-snapset corrupt 2026-02-17T04:39:14.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-17T04:39:14.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:39:14.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:14.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:39:14.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:39:14.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:39:14.243 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:39:14.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:39:14.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:39:14.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:39:14.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:39:14.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:39:14.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:39:14.255 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:14.254+0000 7f767bdfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:14.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:14.255+0000 7f767bdfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:14.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:14.256+0000 7f767bdfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:14.398 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:14.398+0000 7f767bdfd780 -1 Falling back to public interface 2026-02-17T04:39:14.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:39:14.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:14.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:14.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:39:14.694 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:14.693+0000 7f767bdfd780 -1 osd.1 28 log_to_monitors true 2026-02-17T04:39:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:39:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:39:15.583 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:39:15.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:15.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 32 up_thru 32 down_at 29 last_clean_interval [10,28) [v2:127.0.0.1:6810/1332698468,v1:127.0.0.1:6811/1332698468] [v2:127.0.0.1:6812/1332698468,v1:127.0.0.1:6813/1332698468] exists,up e71e4429-cb58-456a-9d72-d800747a5fe0 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:15.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:15.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:15.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:15.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:15.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:15.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:15.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:15.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:15.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:15.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:15.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:15.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:15.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:16.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:16.015 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:16.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:16.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:16.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:39:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:39:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:39:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:16.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:16.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953474 2026-02-17T04:39:16.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953474 2026-02-17T04:39:16.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474' 2026-02-17T04:39:16.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:16.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:39:16.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:16.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:16.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:39:16.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:16.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:39:16.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:39:16.139 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T04:39:16.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:16.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T04:39:16.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:17.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:17.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:17.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:39:17.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:17.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953474 2026-02-17T04:39:17.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:17.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:17.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953474 2026-02-17T04:39:17.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:17.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953474 2026-02-17T04:39:17.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953474' 2026-02-17T04:39:17.479 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 137438953474 2026-02-17T04:39:17.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:17.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953474 -lt 137438953474 2026-02-17T04:39:17.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:17.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:17.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:17.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:39:17.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:17.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:18.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:39:18.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:18.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:18.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:18.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:39:18.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:18.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:18.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-17T04:39:18.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6130: TEST_corrupt_snapset_scrub_rep: objname=ROBJ2 2026-02-17T04:39:18.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: expr 2 % 2 2026-02-17T04:39:18.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: local osd=0 2026-02-17T04:39:18.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6135: TEST_corrupt_snapset_scrub_rep: case $i in 2026-02-17T04:39:18.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6142: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/change 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6143: TEST_corrupt_snapset_scrub_rep: objectstore_tool td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-17T04:39:18.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:39:18.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:39:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:39:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-17T04:39:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:39:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:39:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:39:18.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:39:18.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:39:18.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 --head ROBJ2 clear-snapset corrupt 2026-02-17T04:39:18.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:39:18.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:39:18.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:39:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:39:18.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:39:18.500 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:39:18.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:39:18.512 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:18.511+0000 7f0269850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:18.514 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:18.513+0000 7f0269850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:18.514 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:18.514+0000 7f0269850780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:18.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:39:18.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:39:18.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:18.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:39:18.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:18.675+0000 7f0269850780 -1 Falling back to public interface 2026-02-17T04:39:18.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:39:18.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:18.952+0000 7f0269850780 -1 osd.0 34 log_to_monitors true 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [5,34) [v2:127.0.0.1:6800/1530282234,v1:127.0.0.1:6801/1530282234] [v2:127.0.0.1:6802/1530282234,v1:127.0.0.1:6803/1530282234] exists,up dd239c4c-af03-497a-89e4-0f30d9ae82e7 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:39:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:20.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:20.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:20.258 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:20.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757250 2026-02-17T04:39:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757250 2026-02-17T04:39:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757250' 2026-02-17T04:39:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:20.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:20.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953476 2026-02-17T04:39:20.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953476 2026-02-17T04:39:20.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757250 1-137438953476' 2026-02-17T04:39:20.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:20.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-163208757250 2026-02-17T04:39:20.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:20.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:20.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757250 2026-02-17T04:39:20.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:20.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757250 2026-02-17T04:39:20.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 163208757250' 2026-02-17T04:39:20.381 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 163208757250 2026-02-17T04:39:20.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:20.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 163208757250 2026-02-17T04:39:20.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:21.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:21.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:21.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757250 2026-02-17T04:39:21.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:21.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953476 2026-02-17T04:39:21.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:21.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:21.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953476 2026-02-17T04:39:21.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:21.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953476 2026-02-17T04:39:21.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953476' 2026-02-17T04:39:21.724 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 137438953476 2026-02-17T04:39:21.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:21.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953476 2026-02-17T04:39:21.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:21.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:21.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:22.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:39:22.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:22.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:22.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:22.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:22.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:22.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:22.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:22.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:39:22.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:22.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:22.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:22.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:39:22.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:22.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:22.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6148: TEST_corrupt_snapset_scrub_rep: rm td/osd-scrub-repair/change 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6150: TEST_corrupt_snapset_scrub_rep: pg_scrub 3.0 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:22.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:22.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:39:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:39:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:39:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:39:22.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:22.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:22.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:22.878 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:22.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:22.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:22.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:22.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T04:39:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T04:39:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251' 2026-02-17T04:39:22.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:22.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:22.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953477 2026-02-17T04:39:22.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953477 2026-02-17T04:39:22.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251 1-137438953477' 2026-02-17T04:39:22.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:22.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-163208757251 2026-02-17T04:39:22.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:22.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:22.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757251 2026-02-17T04:39:22.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:23.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T04:39:23.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 163208757251' 2026-02-17T04:39:23.001 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 163208757251 2026-02-17T04:39:23.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:23.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757251 2026-02-17T04:39:23.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:24.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:24.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:24.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757251 2026-02-17T04:39:24.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:25.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:39:25.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:25.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-17T04:39:25.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:25.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953477 2026-02-17T04:39:25.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:25.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:25.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953477 2026-02-17T04:39:25.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:25.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953477 2026-02-17T04:39:25.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953477' 2026-02-17T04:39:25.515 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 137438953477 2026-02-17T04:39:25.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:25.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953477 2026-02-17T04:39:25.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:39:25.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:39:25.683 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:39:25.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:39:25.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:39:25.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:39:25.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:39:25.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:39:25.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:39:25.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:25.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:25.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:25.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:25.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:39:26.066 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:39:26.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:26.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:39:26.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:26.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:39:26.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:39:26.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:39:26.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:39:26.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:26.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:26.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:26.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:26.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:07.705061+0000 '>' 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:26.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:39:27.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:39:27.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:39:27.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:39:27.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:27.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:27.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:27.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:27.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:07.705061+0000 '>' 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:27.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:39:28.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:39:28.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:39:28.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:39:28.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:28.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:28.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:28.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:28.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:07.705061+0000 '>' 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:28.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:39:29.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:39:29.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:39:29.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:39:29.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:29.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:29.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:29.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:29.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:07.705061+0000 '>' 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:29.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:39:30.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:39:30.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:39:30.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:39:30.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:39:30.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:39:30.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:39:30.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:39:30.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:26.721632+0000 '>' 2026-02-17T04:39:07.705061+0000 2026-02-17T04:39:30.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:39:30.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6152: TEST_corrupt_snapset_scrub_rep: rados list-inconsistent-pg csr_pool 2026-02-17T04:39:30.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6154: TEST_corrupt_snapset_scrub_rep: jq '. | length' td/osd-scrub-repair/json 2026-02-17T04:39:30.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6154: TEST_corrupt_snapset_scrub_rep: test 1 = 1 2026-02-17T04:39:30.945 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6156: TEST_corrupt_snapset_scrub_rep: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-17T04:39:30.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6156: TEST_corrupt_snapset_scrub_rep: test 3.0 = 3.0 2026-02-17T04:39:30.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6158: TEST_corrupt_snapset_scrub_rep: rados list-inconsistent-obj 3.0 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: jq 'def walk(f): 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: jq .inconsistents 2026-02-17T04:39:30.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: jq 'def walk(f): 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: jq .inconsistents 2026-02-17T04:39:30.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:39:30.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6330: TEST_corrupt_snapset_scrub_rep: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:39:30.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6331: TEST_corrupt_snapset_scrub_rep: test no = yes 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6336: TEST_corrupt_snapset_scrub_rep: test '' = yes 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6341: TEST_corrupt_snapset_scrub_rep: ERRORS=0 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6342: TEST_corrupt_snapset_scrub_rep: declare -a err_strings 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6343: TEST_corrupt_snapset_scrub_rep: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ1:head : snapset inconsistent' 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6344: TEST_corrupt_snapset_scrub_rep: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ2:head : snapset inconsistent' 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6345: TEST_corrupt_snapset_scrub_rep: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 [0-9]*:.*:::ROBJ1:1 : is an unexpected clone' 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6346: TEST_corrupt_snapset_scrub_rep: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 3/4 objects, 1/2 clones, 3/4 dirty, 3/4 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 49/56 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6347: TEST_corrupt_snapset_scrub_rep: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 0 missing, 2 inconsistent objects' 2026-02-17T04:39:30.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6348: TEST_corrupt_snapset_scrub_rep: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 4 errors' 2026-02-17T04:39:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:30.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ1:head : snapset inconsistent' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:30.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ2:head : snapset inconsistent' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:30.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:30.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 [0-9]*:.*:::ROBJ1:1 : is an unexpected clone' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:30.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:30.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 3/4 objects, 1/2 clones, 3/4 dirty, 3/4 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 49/56 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:31.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:31.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 0 missing, 2 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:31.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-17T04:39:31.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 4 errors' td/osd-scrub-repair/osd.1.log 2026-02-17T04:39:31.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6359: TEST_corrupt_snapset_scrub_rep: '[' 0 '!=' 0 ']' 2026-02-17T04:39:31.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6365: TEST_corrupt_snapset_scrub_rep: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-17T04:39:31.216 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' removed 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:39:31.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:39:31.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:39:31.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:39:31.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:39:31.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:39:31.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:39:31.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:39:31.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:39:31.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:39:31.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:39:31.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:39:31.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:39:31.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:39:31.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:39:31.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:39:31.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:39:31.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:39:31.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:39:31.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:39:31.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:39:31.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:39:31.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:39:31.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:39:31.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:39:31.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:39:31.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:39:31.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:39:31.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:39:31.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:39:31.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:39:31.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:39:31.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:39:31.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:39:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:39:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:39:31.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:39:31.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:39:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:39:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:39:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:39:31.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:39:31.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:39:31.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:39:31.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_dual_store_replicated_cluster td/osd-scrub-repair 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6432: TEST_dual_store_replicated_cluster: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6433: TEST_dual_store_replicated_cluster: local poolname=csr_pool 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6434: TEST_dual_store_replicated_cluster: local total_objs=19 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6435: TEST_dual_store_replicated_cluster: local extr_dbg=1 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6437: TEST_dual_store_replicated_cluster: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:39:31.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:39:31.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:39:31.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:39:31.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-17T04:39:31.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:39:31.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:31.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:31.387 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:31.387 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.387 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:31.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:39:31.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:39:31.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:39:31.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:39:31.413 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:39:31.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:39:31.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:39:31.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:39:31.459 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:39:31.460 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:39:31.460 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.460 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.460 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:39:31.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:39:31.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:39:31.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6438: TEST_dual_store_replicated_cluster: run_mgr td/osd-scrub-repair x --mgr_stats_period=1 2026-02-17T04:39:31.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:39:31.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:39:31.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:39:31.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:39:31.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:31.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:39:31.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T04:39:31.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6439: TEST_dual_store_replicated_cluster: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-17T04:39:31.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6440: TEST_dual_store_replicated_cluster: ceph_osd_args+='--osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 ' 2026-02-17T04:39:31.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6441: TEST_dual_store_replicated_cluster: ceph_osd_args+='--osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 ' 2026-02-17T04:39:31.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: seq 0 1 2026-02-17T04:39:31.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: for osd in $(seq 0 1) 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6444: TEST_dual_store_replicated_cluster: run_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:31.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:39:31.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:39:31.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:39:31.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:39:31.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e1e4796c-8a74-4b3c-97bd-3be9d6430807' 2026-02-17T04:39:31.606 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:39:31.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:39:31.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAD8ZNpqJGvJBAAaniRmen/KiWjQ0Vb9dfrPA== 2026-02-17T04:39:31.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAD8ZNpqJGvJBAAaniRmen/KiWjQ0Vb9dfrPA=="}' 2026-02-17T04:39:31.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e1e4796c-8a74-4b3c-97bd-3be9d6430807 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:39:31.696 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:39:31.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:39:31.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 --mkfs --key AQAD8ZNpqJGvJBAAaniRmen/KiWjQ0Vb9dfrPA== --osd-uuid e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:39:31.721 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:31.719+0000 7fabed82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:31.722 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:31.720+0000 7fabed82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:31.723 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:31.721+0000 7fabed82d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:31.723 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:31.721+0000 7fabed82d780 -1 bdev(0x3be8c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:39:31.723 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:31.721+0000 7fabed82d780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:39:32.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:39:32.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:39:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:39:32.167 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:39:32.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:39:32.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:39:32.252 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:39:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:39:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:39:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:39:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:39:32.270 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:32.268+0000 7f77e95d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:32.271 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:32.269+0000 7f77e95d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:32.272 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:32.270+0000 7f77e95d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:32.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:39:32.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:39:32.476 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:32.474+0000 7f77e95d6780 -1 Falling back to public interface 2026-02-17T04:39:32.857 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:32.855+0000 7f77e95d6780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:39:33.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:39:33.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:33.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:39:33.412 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:39:33.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:33.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:39:33.491 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1237649612,v1:127.0.0.1:6801/1237649612] [v2:127.0.0.1:6802/1237649612,v1:127.0.0.1:6803/1237649612] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: for osd in $(seq 0 1) 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6444: TEST_dual_store_replicated_cluster: run_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:39:33.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:39:33.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:39:33.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:39:33.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:39:33.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7' 2026-02-17T04:39:33.495 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:39:33.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:39:33.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAF8ZNpFHURHhAAXsNUq0nUMIJCkkjG3TLkEg== 2026-02-17T04:39:33.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAF8ZNpFHURHhAAXsNUq0nUMIJCkkjG3TLkEg=="}' 2026-02-17T04:39:33.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:39:33.586 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:39:33.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:39:33.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 --mkfs --key AQAF8ZNpFHURHhAAXsNUq0nUMIJCkkjG3TLkEg== --osd-uuid 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:39:33.613 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:33.611+0000 7f09521fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:33.614 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:33.612+0000 7f09521fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:33.615 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:33.613+0000 7f09521fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:33.616 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:33.614+0000 7f09521fd780 -1 bdev(0x370ec00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:39:33.616 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:33.614+0000 7f09521fd780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:39:33.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:39:33.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:39:33.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:39:33.971 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:39:33.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:39:34.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:39:34.192 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:39:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:39:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:39:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:39:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:39:34.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:34.208+0000 7f3027653780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:34.211 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:34.209+0000 7f3027653780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:34.212 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:34.210+0000 7f3027653780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:39:34.341 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:34.338+0000 7f3027653780 -1 Falling back to public interface 2026-02-17T04:39:34.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:34.356 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:39:34.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:39:34.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:34.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:34.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:39:34.623 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:39:34.620+0000 7f3027653780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:39:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:39:35.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:39:35.522 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:39:35.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:39:35.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:39:35.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:39:35.692 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2296446219,v1:127.0.0.1:6811/2296446219] [v2:127.0.0.1:6812/2296446219,v1:127.0.0.1:6813/2296446219] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:39:35.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:39:35.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:39:35.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:39:35.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6447: TEST_dual_store_replicated_cluster: create_rbd_pool 2026-02-17T04:39:35.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:39:35.853 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:39:35.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:39:35.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:39:36.078 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:39:36.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:37.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:39:37.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6448: TEST_dual_store_replicated_cluster: wait_for_clean 2026-02-17T04:39:37.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:37.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:37.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:37.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:37.370 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:37.371 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:37.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:37.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:37.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:37.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:37.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:37.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:37.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:37.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:37.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:37.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:37.626 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:37.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:37.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:37.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:39:37.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:39:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:39:37.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:37.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:37.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:39:37.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:39:37.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705667' 2026-02-17T04:39:37.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:37.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:39:37.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:37.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:37.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:39:37.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:37.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:39:37.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:39:37.748 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:39:37.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:37.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:39:37.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:38.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:38.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:39.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:39:39.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:40.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:39:40.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:40.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836485 2026-02-17T04:39:40.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:40.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:39:40.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:40.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:40.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:39:40.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:39:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:39:40.257 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:39:40.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:40.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705667 2026-02-17T04:39:40.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:40.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:40.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:40.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:39:40.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:40.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:40.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:40.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:40.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:40.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:40.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:40.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:39:40.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:40.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:40.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:41.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:39:41.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:41.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:41.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6450: TEST_dual_store_replicated_cluster: create_pool foo 1 2026-02-17T04:39:41.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-17T04:39:41.236 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T04:39:41.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:42.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6451: TEST_dual_store_replicated_cluster: create_pool csr_pool 1 1 2026-02-17T04:39:42.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-17T04:39:42.464 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' created 2026-02-17T04:39:42.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:39:43.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6452: TEST_dual_store_replicated_cluster: wait_for_clean 2026-02-17T04:39:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:39:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:39:43.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:39:43.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:39:43.477 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:43.477 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:43.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:43.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:43.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:43.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:43.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:43.738 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:43.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:43.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:43.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:43.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-17T04:39:43.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-17T04:39:43.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T04:39:43.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:43.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:43.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705675 2026-02-17T04:39:43.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705675 2026-02-17T04:39:43.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705675' 2026-02-17T04:39:43.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:43.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-17T04:39:43.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:43.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:43.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-17T04:39:43.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:43.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-17T04:39:43.860 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836493 2026-02-17T04:39:43.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T04:39:43.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:44.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-17T04:39:44.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:45.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:45.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:45.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-17T04:39:45.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:46.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:39:46.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:46.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836493 2026-02-17T04:39:46.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:46.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705675 2026-02-17T04:39:46.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:46.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:39:46.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705675 2026-02-17T04:39:46.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:46.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705675 2026-02-17T04:39:46.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-17T04:39:46.370 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705675 2026-02-17T04:39:46.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:39:46.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705675 2026-02-17T04:39:46.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:39:46.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:46.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:46.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:39:46.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:39:46.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:39:46.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:39:46.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:39:46.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:39:46.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:39:47.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:39:47.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:39:47.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:39:47.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6454: TEST_dual_store_replicated_cluster: ceph osd pool set csr_pool noscrub 1 2026-02-17T04:39:47.347 INFO:tasks.workunit.client.0.trial090.stderr:set pool 3 noscrub to 1 2026-02-17T04:39:47.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6455: TEST_dual_store_replicated_cluster: ceph osd pool set csr_pool nodeep-scrub 1 2026-02-17T04:39:47.552 INFO:tasks.workunit.client.0.trial090.stderr:set pool 3 nodeep-scrub to 1 2026-02-17T04:39:47.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: seq 1 19 2026-02-17T04:39:47.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:47.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ1 2026-02-17T04:39:47.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:47.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:47.805 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:47.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:48.006 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:48.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:48.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:48.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:48.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-17T04:39:48.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-17T04:39:48.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:48.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ2 2026-02-17T04:39:48.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-17T04:39:48.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:48.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:48.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-17T04:39:48.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:48.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:48.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:48.277 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:48.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:48.481 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:48.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:48.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:48.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-17T04:39:48.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-17T04:39:48.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:48.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ3 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ3 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ3 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:48.784 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:48.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:48.987 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:48.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:48.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:48.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:49.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ3 hdr-ROBJ3 2026-02-17T04:39:49.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ3 key-ROBJ3 val-ROBJ3 2026-02-17T04:39:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ4 2026-02-17T04:39:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ4 2026-02-17T04:39:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ4 2026-02-17T04:39:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:49.263 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:49.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:49.467 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:49.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:49.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:49.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:49.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ4 hdr-ROBJ4 2026-02-17T04:39:49.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ4 key-ROBJ4 val-ROBJ4 2026-02-17T04:39:49.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:49.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ5 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ5 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ5 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:49.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:49.770 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:49.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:49.973 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:49.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:49.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:49.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ5 hdr-ROBJ5 2026-02-17T04:39:50.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ5 key-ROBJ5 val-ROBJ5 2026-02-17T04:39:50.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:50.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ6 2026-02-17T04:39:50.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ6 2026-02-17T04:39:50.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:50.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ6 2026-02-17T04:39:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:50.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:50.244 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:50.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:50.448 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:50.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:50.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:50.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:50.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ6 hdr-ROBJ6 2026-02-17T04:39:50.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ6 key-ROBJ6 val-ROBJ6 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ7 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ7 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:50.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ7 2026-02-17T04:39:50.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:50.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:50.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:50.751 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:50.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:50.954 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:50.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:50.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:50.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:50.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ7 hdr-ROBJ7 2026-02-17T04:39:50.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ7 key-ROBJ7 val-ROBJ7 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ8 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ8 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ8 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:51.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:51.226 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:51.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:51.430 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:51.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:51.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:51.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:51.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ8 hdr-ROBJ8 2026-02-17T04:39:51.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ8 key-ROBJ8 val-ROBJ8 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ9 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ9 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ9 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:51.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:51.703 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:51.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:51.907 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:51.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:51.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:51.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ9 hdr-ROBJ9 2026-02-17T04:39:51.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ9 key-ROBJ9 val-ROBJ9 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ10 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ10 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ10 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:51.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:52.181 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:52.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:52.384 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:52.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:52.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:52.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:52.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ10 hdr-ROBJ10 2026-02-17T04:39:52.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ10 key-ROBJ10 val-ROBJ10 2026-02-17T04:39:52.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:52.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ11 2026-02-17T04:39:52.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ11 2026-02-17T04:39:52.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ11 2026-02-17T04:39:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:52.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:52.655 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:52.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:52.857 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:52.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:52.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:52.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ11 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:52.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ11 hdr-ROBJ11 2026-02-17T04:39:52.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ11 key-ROBJ11 val-ROBJ11 2026-02-17T04:39:52.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ12 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ12 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ12 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:52.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:53.134 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:53.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:53.338 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:53.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:53.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:53.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ12 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:53.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ12 hdr-ROBJ12 2026-02-17T04:39:53.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ12 key-ROBJ12 val-ROBJ12 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ13 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ13 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ13 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:53.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:53.613 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:53.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:53.819 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:53.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:53.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:53.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ13 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:53.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ13 hdr-ROBJ13 2026-02-17T04:39:53.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ13 key-ROBJ13 val-ROBJ13 2026-02-17T04:39:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ14 2026-02-17T04:39:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ14 2026-02-17T04:39:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:53.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:53.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ14 2026-02-17T04:39:53.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:53.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:53.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:54.095 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:54.300 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:54.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:54.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:54.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ14 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:54.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ14 hdr-ROBJ14 2026-02-17T04:39:54.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ14 key-ROBJ14 val-ROBJ14 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ15 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ15 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ15 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:54.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:54.579 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:54.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:54.784 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:54.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:54.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:54.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ15 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:54.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ15 hdr-ROBJ15 2026-02-17T04:39:54.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ15 key-ROBJ15 val-ROBJ15 2026-02-17T04:39:54.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ16 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ16 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ16 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:54.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:55.056 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:55.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:55.260 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:55.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:55.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:55.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ16 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:55.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ16 hdr-ROBJ16 2026-02-17T04:39:55.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ16 key-ROBJ16 val-ROBJ16 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ17 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ17 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ17 2026-02-17T04:39:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:55.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:55.540 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:55.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:55.744 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:55.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:55.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:55.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ17 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:55.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ17 hdr-ROBJ17 2026-02-17T04:39:55.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ17 key-ROBJ17 val-ROBJ17 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ18 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ18 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ18 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:55.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:56.017 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:56.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:56.221 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:56.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:56.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:56.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ18 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:56.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ18 hdr-ROBJ18 2026-02-17T04:39:56.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ18 key-ROBJ18 val-ROBJ18 2026-02-17T04:39:56.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:39:56.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ19 2026-02-17T04:39:56.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ19 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ19 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:39:56.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:39:56.525 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:39:56.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:39:56.727 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:39:56.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:39:56.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:39:56.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:39:56.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ19 hdr-ROBJ19 2026-02-17T04:39:56.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ19 key-ROBJ19 val-ROBJ19 2026-02-17T04:39:56.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6466: TEST_dual_store_replicated_cluster: dd if=/dev/zero of=td/osd-scrub-repair/new.ROBJ19 bs=1024 count=1025 2026-02-17T04:39:56.788 INFO:tasks.workunit.client.0.trial090.stderr:1025+0 records in 2026-02-17T04:39:56.788 INFO:tasks.workunit.client.0.trial090.stderr:1025+0 records out 2026-02-17T04:39:56.788 INFO:tasks.workunit.client.0.trial090.stderr:1049600 bytes (1.0 MB, 1.0 MiB) copied, 0.00171625 s, 612 MB/s 2026-02-17T04:39:56.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6467: TEST_dual_store_replicated_cluster: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/new.ROBJ19 2026-02-17T04:39:56.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6468: TEST_dual_store_replicated_cluster: rm -f td/osd-scrub-repair/new.ROBJ19 2026-02-17T04:39:56.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6470: TEST_dual_store_replicated_cluster: get_pg csr_pool ROBJ0 2026-02-17T04:39:56.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-17T04:39:56.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-17T04:39:56.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:39:56.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:39:56.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6470: TEST_dual_store_replicated_cluster: local pg=3.0 2026-02-17T04:39:56.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6471: TEST_dual_store_replicated_cluster: get_primary csr_pool ROBJ0 2026-02-17T04:39:56.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-17T04:39:56.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-17T04:39:56.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:39:56.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:39:57.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6471: TEST_dual_store_replicated_cluster: local primary=1 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: get_asok_path osd.0 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:39:57.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: CEPH_ARGS= 2026-02-17T04:39:57.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: ceph daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-17T04:39:57.193 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:39:57.193 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-17T04:39:57.193 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:39:57.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: get_asok_path osd.1 2026-02-17T04:39:57.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:39:57.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: CEPH_ARGS= 2026-02-17T04:39:57.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: ceph daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-17T04:39:57.243 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:39:57.244 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-17T04:39:57.244 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:39:57.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6478: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-17T04:39:57.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:39:57.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:39:57.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:39:57.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:39:57.249 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:39:57.249 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:39:57.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:39:57.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:39:57.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:39:57.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:39:57.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:39:57.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:39:57.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:39:57.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:39:57.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:39:57.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:39:57.643 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:39:57.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:39:57.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:57.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:39:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-17T04:39:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-17T04:39:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-17T04:39:57.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:39:57.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:39:57.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705689 2026-02-17T04:39:57.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705689 2026-02-17T04:39:57.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705689' 2026-02-17T04:39:57.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:39:57.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-17T04:39:57.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:39:57.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:39:57.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-17T04:39:57.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:39:57.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-17T04:39:57.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-17T04:39:57.766 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836507 2026-02-17T04:39:57.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:57.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836507 2026-02-17T04:39:57.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:39:58.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:39:58.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:39:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836507 2026-02-17T04:39:59.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:00.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:40:00.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:00.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836507 2026-02-17T04:40:00.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:00.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705689 2026-02-17T04:40:00.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:00.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:00.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705689 2026-02-17T04:40:00.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:00.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705689 2026-02-17T04:40:00.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705689' 2026-02-17T04:40:00.276 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705689 2026-02-17T04:40:00.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:00.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705689 2026-02-17T04:40:00.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:40:00.440 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:40:00.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:40:00.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:40:00.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:40:00.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:40:00.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:40:00.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:40:00.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:40:00.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:40:00.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:40:00.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:40:00.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:00.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:40:00.822 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:39:42.463491+0000 last_deep_scrub_stamp 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:40:00.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:40:00.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:40:00.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:40:00.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:40:00.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:42.463491+0000 '>' 2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:00.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:40:01.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:40:01.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:40:01.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:40:01.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:40:01.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:40:01.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:40:01.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:40:02.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:42.463491+0000 '>' 2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:02.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:40:03.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:40:03.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:40:03.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:40:03.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:40:03.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:40:03.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:40:03.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:40:03.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:39:42.463491+0000 '>' 2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:03.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:40:04.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:40:04.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:40:04.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:40:04.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:40:04.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:40:04.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:40:04.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:40:04.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:40:01.767978+0000 '>' 2026-02-17T04:39:42.463491+0000 2026-02-17T04:40:04.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:40:04.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: seq 1 19 2026-02-17T04:40:04.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:04.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ1 2026-02-17T04:40:04.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 1 % 2 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6489: TEST_dual_store_replicated_cluster: local payload=UVWXYZZZ 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6490: TEST_dual_store_replicated_cluster: echo UVWXYZZZ 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6491: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:04.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:04.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:04.712 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#-5:00000000:::deep_scrub_3.0:head#, (61) No data available 2026-02-17T04:40:04.712 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#-5:00000000:::scrub_3.0:head#, (61) No data available 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:04.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:04.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:04.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:04.750 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:04.750 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:04.750 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:04.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:04.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:04.767 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:04.765+0000 7fecfb42e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:04.768 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:04.766+0000 7fecfb42e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:04.769 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:04.767+0000 7fecfb42e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:04.908 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:04.906+0000 7fecfb42e780 -1 Falling back to public interface 2026-02-17T04:40:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:05.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:05.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:05.183+0000 7fecfb42e780 -1 osd.1 64 log_to_monitors true 2026-02-17T04:40:06.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:06.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:06.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:06.085 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:06.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:06.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 68 up_thru 68 down_at 65 last_clean_interval [9,64) [v2:127.0.0.1:6810/385452437,v1:127.0.0.1:6811/385452437] [v2:127.0.0.1:6812/385452437,v1:127.0.0.1:6813/385452437] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:06.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:06.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:06.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:06.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:06.252 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:06.252 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:06.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:06.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:06.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:06.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:06.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:06.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:06.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:06.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:06.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:06.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:06.509 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:06.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:06.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:06.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-17T04:40:06.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-17T04:40:06.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517' 2026-02-17T04:40:06.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:06.570 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:06.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776131 2026-02-17T04:40:06.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776131 2026-02-17T04:40:06.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-292057776131' 2026-02-17T04:40:06.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:06.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836517 2026-02-17T04:40:06.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:06.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:06.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-17T04:40:06.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:06.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836517 2026-02-17T04:40:06.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-17T04:40:06.632 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836517 2026-02-17T04:40:06.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:06.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836517 2026-02-17T04:40:06.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:07.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:07.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:07.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836518 -lt 21474836517 2026-02-17T04:40:07.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:07.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-292057776131 2026-02-17T04:40:07.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:07.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:07.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776131 2026-02-17T04:40:07.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:07.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776131 2026-02-17T04:40:07.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 292057776131' 2026-02-17T04:40:07.974 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 292057776131 2026-02-17T04:40:07.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:08.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776132 -lt 292057776131 2026-02-17T04:40:08.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:08.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:08.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:08.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:08.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:08.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:08.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:08.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:08.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ2 2026-02-17T04:40:08.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 2 % 2 2026-02-17T04:40:08.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:08.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6496: TEST_dual_store_replicated_cluster: local payload=UVWXYZ 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6497: TEST_dual_store_replicated_cluster: echo UVWXYZ 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6498: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:08.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:40:08.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:08.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:08.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:08.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:08.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:08.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:08.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:40:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:40:08.980 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:40:08.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:08.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:40:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:40:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:08.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:08.997 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:08.995+0000 7f4b93c38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:08.998 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:08.996+0000 7f4b93c38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:08.999 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:08.997+0000 7f4b93c38780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:09.143 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:09.141+0000 7f4b93c38780 -1 Falling back to public interface 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:09.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:09.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:09.445 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:09.443+0000 7f4b93c38780 -1 osd.0 70 log_to_monitors true 2026-02-17T04:40:10.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:10.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:10.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:10.316 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:10.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:10.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 73 up_thru 73 down_at 70 last_clean_interval [5,70) [v2:127.0.0.1:6800/1388310130,v1:127.0.0.1:6801/1388310130] [v2:127.0.0.1:6802/1388310130,v1:127.0.0.1:6803/1388310130] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:10.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:10.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:10.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:10.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:10.485 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:10.485 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:10.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:10.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:10.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:10.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:10.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:10.747 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:10.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:10.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:10.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:10.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612611 2026-02-17T04:40:10.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612611 2026-02-17T04:40:10.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612611' 2026-02-17T04:40:10.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:10.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776136 2026-02-17T04:40:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776136 2026-02-17T04:40:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612611 1-292057776136' 2026-02-17T04:40:10.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:10.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612611 2026-02-17T04:40:10.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:10.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:10.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612611 2026-02-17T04:40:10.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:10.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612611 2026-02-17T04:40:10.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612611' 2026-02-17T04:40:10.871 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 313532612611 2026-02-17T04:40:10.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:11.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 313532612611 2026-02-17T04:40:11.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:12.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:12.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:12.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612612 -lt 313532612611 2026-02-17T04:40:12.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:12.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-292057776136 2026-02-17T04:40:12.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:12.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:12.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-292057776136 2026-02-17T04:40:12.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:12.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776136 2026-02-17T04:40:12.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 292057776136' 2026-02-17T04:40:12.207 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 292057776136 2026-02-17T04:40:12.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:12.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776137 -lt 292057776136 2026-02-17T04:40:12.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:12.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:12.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:12.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:12.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:12.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:12.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:12.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:12.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:12.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:12.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:12.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ3 2026-02-17T04:40:12.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 3 % 2 2026-02-17T04:40:12.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:12.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6503: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:12.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:12.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:12.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:12.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:13.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ3 remove 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:13.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ3 remove 2026-02-17T04:40:13.163 INFO:tasks.workunit.client.0.trial090.stdout:remove #3:f2a5b2a4:::ROBJ3:head# 2026-02-17T04:40:13.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:13.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:13.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:13.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:13.202 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:13.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:13.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:13.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:13.220 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:13.218+0000 7f104f633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:13.221 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:13.219+0000 7f104f633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:13.222 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:13.220+0000 7f104f633780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:13.348 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:13.346+0000 7f104f633780 -1 Falling back to public interface 2026-02-17T04:40:13.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:13.367 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:13.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:13.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:13.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:13.623 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:13.621+0000 7f104f633780 -1 osd.1 75 log_to_monitors true 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:14.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:14.701 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 79 up_thru 79 down_at 76 last_clean_interval [68,75) [v2:127.0.0.1:6810/1243311984,v1:127.0.0.1:6811/1243311984] [v2:127.0.0.1:6812/1243311984,v1:127.0.0.1:6813/1243311984] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:14.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:14.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:14.703 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:14.703 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:14.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:14.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:14.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:14.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:14.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:14.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:14.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:14.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:14.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:14.960 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:14.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:15.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612616 2026-02-17T04:40:15.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612616 2026-02-17T04:40:15.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612616' 2026-02-17T04:40:15.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:15.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=339302416387 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 339302416387 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612616 1-339302416387' 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612616 2026-02-17T04:40:15.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:15.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:15.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612616 2026-02-17T04:40:15.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:15.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612616 2026-02-17T04:40:15.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612616' 2026-02-17T04:40:15.083 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 313532612616 2026-02-17T04:40:15.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612614 -lt 313532612616 2026-02-17T04:40:15.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:16.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:16.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:16.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612617 -lt 313532612616 2026-02-17T04:40:16.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:16.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-339302416387 2026-02-17T04:40:16.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:16.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:16.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-339302416387 2026-02-17T04:40:16.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:16.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=339302416387 2026-02-17T04:40:16.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 339302416387' 2026-02-17T04:40:16.425 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 339302416387 2026-02-17T04:40:16.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:16.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 339302416387 -lt 339302416387 2026-02-17T04:40:16.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:16.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:16.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:16.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:16.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:16.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:16.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:16.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:16.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:16.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ4 2026-02-17T04:40:17.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 4 % 2 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6508: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:17.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:17.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:17.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:17.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:17.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:40:17.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:40:17.426 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:40:17.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:17.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:40:17.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:40:17.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:17.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:17.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:17.443 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:17.443+0000 7fea8ae1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:17.445 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:17.444+0000 7fea8ae1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:17.445 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:17.445+0000 7fea8ae1e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:17.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:17.580+0000 7fea8ae1e780 -1 Falling back to public interface 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:17.595 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:17.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:17.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:17.867 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:17.866+0000 7fea8ae1e780 -1 osd.0 80 log_to_monitors true 2026-02-17T04:40:18.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:18.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:18.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:18.761 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:18.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:18.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [73,80) [v2:127.0.0.1:6800/3211272754,v1:127.0.0.1:6801/3211272754] [v2:127.0.0.1:6802/3211272754,v1:127.0.0.1:6803/3211272754] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:18.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:18.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:18.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:18.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:18.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:18.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:19.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:19.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:19.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:19.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:19.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:19.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:19.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:19.187 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:19.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:19.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:19.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-17T04:40:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-17T04:40:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867' 2026-02-17T04:40:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:19.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=339302416392 2026-02-17T04:40:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 339302416392 2026-02-17T04:40:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-339302416392' 2026-02-17T04:40:19.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:19.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252867 2026-02-17T04:40:19.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:19.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252867 2026-02-17T04:40:19.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:19.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-17T04:40:19.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252867' 2026-02-17T04:40:19.311 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252867 2026-02-17T04:40:19.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:19.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612618 -lt 360777252867 2026-02-17T04:40:19.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:20.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:20.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:20.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252867 2026-02-17T04:40:20.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:20.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-339302416392 2026-02-17T04:40:20.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:20.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:20.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-339302416392 2026-02-17T04:40:20.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:20.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=339302416392 2026-02-17T04:40:20.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 339302416392' 2026-02-17T04:40:20.648 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 339302416392 2026-02-17T04:40:20.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:20.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 339302416392 -lt 339302416392 2026-02-17T04:40:20.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:20.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:20.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:21.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:21.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:21.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:21.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:21.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:21.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:21.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ5 2026-02-17T04:40:21.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 5 % 2 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6513: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:21.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:21.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:21.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:21.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:21.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:21.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:21.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ5 rm-omap key-ROBJ5 2026-02-17T04:40:21.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:21.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:21.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:21.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:21.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:21.648 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:21.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:21.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:21.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:21.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:21.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:21.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:21.664 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:21.663+0000 7f129c835780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:21.666 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:21.665+0000 7f129c835780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:21.666 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:21.665+0000 7f129c835780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:21.800 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:21.799+0000 7f129c835780 -1 Falling back to public interface 2026-02-17T04:40:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:21.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:21.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:21.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:21.817 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:21.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:21.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:22.111 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:22.110+0000 7f129c835780 -1 osd.1 86 log_to_monitors true 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:22.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:23.151 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 90 up_thru 90 down_at 87 last_clean_interval [79,86) [v2:127.0.0.1:6810/2748219435,v1:127.0.0.1:6811/2748219435] [v2:127.0.0.1:6812/2748219435,v1:127.0.0.1:6813/2748219435] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:23.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:23.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:23.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:23.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:23.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:23.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:23.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:23.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:23.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:23.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:23.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:23.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:23.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:23.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:23.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:23.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:23.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:23.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:23.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:23.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:23.406 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:23.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:23.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:23.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:23.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252872 2026-02-17T04:40:23.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252872 2026-02-17T04:40:23.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252872' 2026-02-17T04:40:23.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:23.467 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:23.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-17T04:40:23.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-17T04:40:23.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252872 1-386547056643' 2026-02-17T04:40:23.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:23.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252872 2026-02-17T04:40:23.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:23.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:23.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252872 2026-02-17T04:40:23.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:23.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252872 2026-02-17T04:40:23.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252872' 2026-02-17T04:40:23.529 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 360777252872 2026-02-17T04:40:23.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:23.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252869 -lt 360777252872 2026-02-17T04:40:23.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:24.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:24.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:24.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252872 -lt 360777252872 2026-02-17T04:40:24.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:24.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056643 2026-02-17T04:40:24.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:24.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:24.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056643 2026-02-17T04:40:24.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:24.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056643 2026-02-17T04:40:24.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056643' 2026-02-17T04:40:24.867 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 386547056643 2026-02-17T04:40:24.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:25.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-17T04:40:25.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:25.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:25.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:25.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:25.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:25.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:25.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:25.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ6 2026-02-17T04:40:25.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 6 % 2 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6518: TEST_dual_store_replicated_cluster: echo extra 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6519: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:40:25.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:25.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:25.892 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:25.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:25.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:40:25.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:40:25.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:25.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:25.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:25.908 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:25.907+0000 7f63da041780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:25.909 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:25.908+0000 7f63da041780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:25.910 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:25.909+0000 7f63da041780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:26.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:26.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:26.086 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:26.084+0000 7f63da041780 -1 Falling back to public interface 2026-02-17T04:40:26.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:26.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:26.409+0000 7f63da041780 -1 osd.0 91 log_to_monitors true 2026-02-17T04:40:27.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:27.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:27.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:27.224 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:27.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:27.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 95 up_thru 95 down_at 92 last_clean_interval [84,91) [v2:127.0.0.1:6800/1011892530,v1:127.0.0.1:6801/1011892530] [v2:127.0.0.1:6802/1011892530,v1:127.0.0.1:6803/1011892530] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:27.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:27.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:27.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:27.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:27.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:27.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:27.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:27.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:27.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:27.653 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:27.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:27.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:27.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:27.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893123 2026-02-17T04:40:27.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893123 2026-02-17T04:40:27.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893123' 2026-02-17T04:40:27.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:27.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:27.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056648 2026-02-17T04:40:27.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056648 2026-02-17T04:40:27.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893123 1-386547056648' 2026-02-17T04:40:27.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:27.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893123 2026-02-17T04:40:27.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:27.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:27.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893123 2026-02-17T04:40:27.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:27.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893123 2026-02-17T04:40:27.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893123' 2026-02-17T04:40:27.775 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 408021893123 2026-02-17T04:40:27.776 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:27.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893122 -lt 408021893123 2026-02-17T04:40:27.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:28.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:28.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:29.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893122 -lt 408021893123 2026-02-17T04:40:29.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:40:30.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:30.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893125 -lt 408021893123 2026-02-17T04:40:30.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:30.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056648 2026-02-17T04:40:30.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:30.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:30.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056648 2026-02-17T04:40:30.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:30.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056648 2026-02-17T04:40:30.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056648' 2026-02-17T04:40:30.281 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 386547056648 2026-02-17T04:40:30.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:30.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056650 -lt 386547056648 2026-02-17T04:40:30.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:30.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:30.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:30.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:30.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:30.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:30.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:30.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:30.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:30.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:30.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:30.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:30.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:30.831 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:31.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:31.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:31.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:31.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6520: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/extra-val 2026-02-17T04:40:31.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:31.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ7 2026-02-17T04:40:31.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 7 % 2 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6525: TEST_dual_store_replicated_cluster: echo -n newheader 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6526: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:31.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:31.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:31.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:31.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:31.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:31.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:31.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:31.494 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:31.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:31.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:31.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:31.496 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:31.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:31.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:31.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:31.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:31.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:31.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:31.509 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:31.508+0000 7f6d80c57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:31.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:31.510+0000 7f6d80c57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:31.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:31.511+0000 7f6d80c57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:31.647 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:31.645+0000 7f6d80c57780 -1 Falling back to public interface 2026-02-17T04:40:31.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:31.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:31.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:31.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:31.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:31.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:31.933 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:31.932+0000 7f6d80c57780 -1 osd.1 97 log_to_monitors true 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:32.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:32.993 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 101 up_thru 101 down_at 98 last_clean_interval [90,97) [v2:127.0.0.1:6810/297183656,v1:127.0.0.1:6811/297183656] [v2:127.0.0.1:6812/297183656,v1:127.0.0.1:6813/297183656] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:32.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:32.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:32.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:32.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:32.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:32.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:32.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:32.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:32.994 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:32.995 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:32.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:32.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:32.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:33.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:33.253 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:33.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893129 2026-02-17T04:40:33.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893129 2026-02-17T04:40:33.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893129' 2026-02-17T04:40:33.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:33.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696899 2026-02-17T04:40:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696899 2026-02-17T04:40:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893129 1-433791696899' 2026-02-17T04:40:33.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:33.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893129 2026-02-17T04:40:33.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:33.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:33.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893129 2026-02-17T04:40:33.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:33.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893129 2026-02-17T04:40:33.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893129' 2026-02-17T04:40:33.373 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 408021893129 2026-02-17T04:40:33.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893127 -lt 408021893129 2026-02-17T04:40:33.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:34.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:34.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:34.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893130 -lt 408021893129 2026-02-17T04:40:34.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:34.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-433791696899 2026-02-17T04:40:34.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:34.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:34.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-433791696899 2026-02-17T04:40:34.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:34.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696899 2026-02-17T04:40:34.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 433791696899' 2026-02-17T04:40:34.717 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 433791696899 2026-02-17T04:40:34.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:34.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696899 -lt 433791696899 2026-02-17T04:40:34.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:34.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:34.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:35.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:35.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:35.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:35.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:35.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:35.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:35.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6527: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/hdr 2026-02-17T04:40:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:35.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ8 2026-02-17T04:40:35.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 8 % 2 2026-02-17T04:40:35.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:35.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:35.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6531: TEST_dual_store_replicated_cluster: rados --pool csr_pool setxattr ROBJ8 key1-ROBJ8 val1-ROBJ8 2026-02-17T04:40:35.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6532: TEST_dual_store_replicated_cluster: rados --pool csr_pool setxattr ROBJ8 key2-ROBJ8 val2-ROBJ8 2026-02-17T04:40:35.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6535: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-17T04:40:35.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6536: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:40:35.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:35.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:35.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:35.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:40:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:35.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:35.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:40:35.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:35.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:35.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-17T04:40:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:35.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:35.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:40:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:35.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:40:35.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:40:35.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:35.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:35.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:35.768 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:35.767+0000 7fb7cee39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:35.769 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:35.769+0000 7fb7cee39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:35.770 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:35.769+0000 7fb7cee39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:35.916 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:35.914+0000 7fb7cee39780 -1 Falling back to public interface 2026-02-17T04:40:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:40:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:40:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:35.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:35.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:35.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:35.919 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:35.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:35.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:36.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:36.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:36.183+0000 7fb7cee39780 -1 osd.0 102 log_to_monitors true 2026-02-17T04:40:37.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:37.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:37.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:37.084 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:37.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:37.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:37.251 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 106 up_thru 106 down_at 103 last_clean_interval [95,102) [v2:127.0.0.1:6800/3601461766,v1:127.0.0.1:6801/3601461766] [v2:127.0.0.1:6802/3601461766,v1:127.0.0.1:6803/3601461766] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:40:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:37.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:37.253 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:37.253 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:37.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:37.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:37.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:37.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:37.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:37.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:37.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:37.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:37.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:37.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:37.511 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:37.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:37.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:37.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:37.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533379 2026-02-17T04:40:37.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533379 2026-02-17T04:40:37.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533379' 2026-02-17T04:40:37.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:37.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696904 2026-02-17T04:40:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696904 2026-02-17T04:40:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533379 1-433791696904' 2026-02-17T04:40:37.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:37.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533379 2026-02-17T04:40:37.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:37.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:37.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533379 2026-02-17T04:40:37.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:37.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533379 2026-02-17T04:40:37.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533379' 2026-02-17T04:40:37.633 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533379 2026-02-17T04:40:37.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:37.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533379 -lt 455266533379 2026-02-17T04:40:37.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:37.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-433791696904 2026-02-17T04:40:37.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:37.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:37.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-433791696904 2026-02-17T04:40:37.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:37.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696904 2026-02-17T04:40:37.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 433791696904' 2026-02-17T04:40:37.803 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 433791696904 2026-02-17T04:40:37.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696904 -lt 433791696904 2026-02-17T04:40:37.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:37.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:37.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:38.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:38.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:38.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:38.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:38.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:38.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:38.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:38.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:38.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:38.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:38.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:38.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:38.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6537: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:40:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:38.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:38.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:38.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:38.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:38.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-17T04:40:38.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:38.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:38.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:38.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:38.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:38.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:38.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:38.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:38.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:38.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:38.857 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:38.855+0000 7f277e05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:38.858 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:38.857+0000 7f277e05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:38.859 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:38.858+0000 7f277e05d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:38.991 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:38.989+0000 7f277e05d780 -1 Falling back to public interface 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:39.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:39.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:39.258 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:39.256+0000 7f277e05d780 -1 osd.1 108 log_to_monitors true 2026-02-17T04:40:40.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:40.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:40.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:40.172 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:40.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:40.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:40.338 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 112 up_thru 112 down_at 109 last_clean_interval [101,108) [v2:127.0.0.1:6810/1621901544,v1:127.0.0.1:6811/1621901544] [v2:127.0.0.1:6812/1621901544,v1:127.0.0.1:6813/1621901544] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:40.339 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:40.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:40.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:40.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:40.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:40.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:40.598 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:40.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:40.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:40.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533383 2026-02-17T04:40:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533383 2026-02-17T04:40:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533383' 2026-02-17T04:40:40.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:40.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:40.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=481036337155 2026-02-17T04:40:40.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 481036337155 2026-02-17T04:40:40.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533383 1-481036337155' 2026-02-17T04:40:40.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:40.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533383 2026-02-17T04:40:40.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:40.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533383 2026-02-17T04:40:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:40.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533383 2026-02-17T04:40:40.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533383' 2026-02-17T04:40:40.723 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533383 2026-02-17T04:40:40.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533381 -lt 455266533383 2026-02-17T04:40:40.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:41.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:41.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:42.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533384 -lt 455266533383 2026-02-17T04:40:42.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:42.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-481036337155 2026-02-17T04:40:42.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:42.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:42.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-481036337155 2026-02-17T04:40:42.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:42.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=481036337155 2026-02-17T04:40:42.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 481036337155' 2026-02-17T04:40:42.063 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 481036337155 2026-02-17T04:40:42.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:42.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 481036337156 -lt 481036337155 2026-02-17T04:40:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:42.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:42.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:42.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:42.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:42.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:42.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:42.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:42.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:42.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6538: TEST_dual_store_replicated_cluster: echo -n val3-ROBJ8 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6539: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:42.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:42.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:42.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-17T04:40:43.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:43.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:43.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:43.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:43.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:43.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:43.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:43.104 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:43.102+0000 7f37fee33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:43.105 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:43.103+0000 7f37fee33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:43.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:43.104+0000 7f37fee33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:43.235 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:43.232+0000 7f37fee33780 -1 Falling back to public interface 2026-02-17T04:40:43.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:43.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:43.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:43.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:43.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:43.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:43.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:43.256 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:43.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:43.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:43.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:43.528 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:43.527+0000 7f37fee33780 -1 osd.1 113 log_to_monitors true 2026-02-17T04:40:44.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:44.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:44.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:44.427 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:44.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:44.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:44.593 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 117 up_thru 117 down_at 114 last_clean_interval [112,113) [v2:127.0.0.1:6810/1041159923,v1:127.0.0.1:6811/1041159923] [v2:127.0.0.1:6812/1041159923,v1:127.0.0.1:6813/1041159923] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:44.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:44.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:44.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:44.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:44.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:44.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:44.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:44.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:44.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:44.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:44.849 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:44.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:44.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:44.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:44.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533388 2026-02-17T04:40:44.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533388 2026-02-17T04:40:44.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533388' 2026-02-17T04:40:44.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:44.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:44.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=502511173635 2026-02-17T04:40:44.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 502511173635 2026-02-17T04:40:44.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533388 1-502511173635' 2026-02-17T04:40:44.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:44.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533388 2026-02-17T04:40:44.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:44.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:44.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533388 2026-02-17T04:40:44.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:44.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533388 2026-02-17T04:40:44.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533388' 2026-02-17T04:40:44.971 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533388 2026-02-17T04:40:44.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:45.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533386 -lt 455266533388 2026-02-17T04:40:45.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:46.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:46.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:46.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533389 -lt 455266533388 2026-02-17T04:40:46.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:46.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-502511173635 2026-02-17T04:40:46.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:46.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:46.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-502511173635 2026-02-17T04:40:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:46.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=502511173635 2026-02-17T04:40:46.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 502511173635' 2026-02-17T04:40:46.313 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 502511173635 2026-02-17T04:40:46.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:46.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 502511173636 -lt 502511173635 2026-02-17T04:40:46.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:46.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:46.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:46.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:46.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:46.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:46.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:46.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:46.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:47.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:47.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:47.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:47.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6540: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-17T04:40:47.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:47.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ9 2026-02-17T04:40:47.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 9 % 2 2026-02-17T04:40:47.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:47.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:47.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6544: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:40:47.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:47.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:47.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 get-attr _ 2026-02-17T04:40:47.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:47.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:47.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:47.267 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:47.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:47.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:47.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:47.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:47.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:47.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:47.281 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:47.279+0000 7facd8dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:47.282 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:47.280+0000 7facd8dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:47.283 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:47.281+0000 7facd8dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:47.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:47.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:47.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:47.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:47.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:47.454 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:47.453+0000 7facd8dc6780 -1 Falling back to public interface 2026-02-17T04:40:47.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:47.739 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:47.737+0000 7facd8dc6780 -1 osd.1 119 log_to_monitors true 2026-02-17T04:40:48.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:48.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:48.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:48.596 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:48.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:48.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:48.761 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 123 up_thru 123 down_at 120 last_clean_interval [117,119) [v2:127.0.0.1:6810/713743236,v1:127.0.0.1:6811/713743236] [v2:127.0.0.1:6812/713743236,v1:127.0.0.1:6813/713743236] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:48.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:48.762 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:48.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:48.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:48.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:48.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:48.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:48.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:49.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:49.017 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:49.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:49.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:49.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:49.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533393 2026-02-17T04:40:49.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533393 2026-02-17T04:40:49.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533393' 2026-02-17T04:40:49.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:49.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:49.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=528280977411 2026-02-17T04:40:49.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 528280977411 2026-02-17T04:40:49.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533393 1-528280977411' 2026-02-17T04:40:49.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:49.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533393 2026-02-17T04:40:49.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:49.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:49.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533393 2026-02-17T04:40:49.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:49.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533393 2026-02-17T04:40:49.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533393' 2026-02-17T04:40:49.140 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533393 2026-02-17T04:40:49.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:49.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533391 -lt 455266533393 2026-02-17T04:40:49.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:50.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:50.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:50.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533394 -lt 455266533393 2026-02-17T04:40:50.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:50.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-528280977411 2026-02-17T04:40:50.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:50.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:50.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-528280977411 2026-02-17T04:40:50.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:50.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=528280977411 2026-02-17T04:40:50.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 528280977411' 2026-02-17T04:40:50.488 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 528280977411 2026-02-17T04:40:50.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:50.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 528280977411 -lt 528280977411 2026-02-17T04:40:50.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:50.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:50.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:50.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:50.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:51.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:51.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:51.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:51.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:51.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:51.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:51.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:51.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6545: TEST_dual_store_replicated_cluster: echo -n D 2026-02-17T04:40:51.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6546: TEST_dual_store_replicated_cluster: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6547: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:51.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:51.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:51.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:51.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-17T04:40:51.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:51.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:51.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:51.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:51.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:51.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:51.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:51.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:51.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:51.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:51.513 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:51.511+0000 7f7e3c40b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:51.514 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:51.513+0000 7f7e3c40b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:51.515 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:51.513+0000 7f7e3c40b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:51.644 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:51.641+0000 7f7e3c40b780 -1 Falling back to public interface 2026-02-17T04:40:51.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:51.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:51.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:51.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:51.904+0000 7f7e3c40b780 -1 osd.1 124 log_to_monitors true 2026-02-17T04:40:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:52.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:52.838 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:52.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 128 up_thru 128 down_at 125 last_clean_interval [123,124) [v2:127.0.0.1:6810/3651106745,v1:127.0.0.1:6811/3651106745] [v2:127.0.0.1:6812/3651106745,v1:127.0.0.1:6813/3651106745] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:53.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:53.002 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:53.002 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:53.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:53.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:53.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:53.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:53.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:53.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:53.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:53.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:53.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:53.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:53.260 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:53.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:53.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:53.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:53.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533399 2026-02-17T04:40:53.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533399 2026-02-17T04:40:53.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533399' 2026-02-17T04:40:53.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:53.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=549755813891 2026-02-17T04:40:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 549755813891 2026-02-17T04:40:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-455266533399 1-549755813891' 2026-02-17T04:40:53.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:53.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-455266533399 2026-02-17T04:40:53.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:53.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:53.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-455266533399 2026-02-17T04:40:53.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:53.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533399 2026-02-17T04:40:53.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 455266533399' 2026-02-17T04:40:53.382 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 455266533399 2026-02-17T04:40:53.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:53.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533396 -lt 455266533399 2026-02-17T04:40:53.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:40:54.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:40:54.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:54.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533399 -lt 455266533399 2026-02-17T04:40:54.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-549755813891 2026-02-17T04:40:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:54.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:54.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-549755813891 2026-02-17T04:40:54.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:54.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=549755813891 2026-02-17T04:40:54.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 549755813891' 2026-02-17T04:40:54.721 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 549755813891 2026-02-17T04:40:54.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:54.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 549755813891 -lt 549755813891 2026-02-17T04:40:54.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:54.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:54.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:55.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:55.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:55.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:55.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:55.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:55.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:55.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:55.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:55.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:55.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6548: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-17T04:40:55.472 INFO:tasks.workunit.client.0.trial090.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-17T04:40:55.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:55.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ10 2026-02-17T04:40:55.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 10 % 2 2026-02-17T04:40:55.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:55.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:55.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:55.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ11 2026-02-17T04:40:55.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 11 % 2 2026-02-17T04:40:55.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:55.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ12 2026-02-17T04:40:55.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 12 % 2 2026-02-17T04:40:55.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:55.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:55.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:55.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ13 2026-02-17T04:40:55.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 13 % 2 2026-02-17T04:40:55.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:40:55.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:55.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:40:55.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ14 2026-02-17T04:40:55.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 14 % 2 2026-02-17T04:40:55.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:40:55.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:40:55.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6557: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-17T04:40:55.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6558: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:40:55.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:55.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:55.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:55.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:55.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:55.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:55.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:40:55.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:55.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:55.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:40:55.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:55.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:55.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-17T04:40:55.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:55.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:55.732 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:55.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:40:55.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:40:55.734 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:40:55.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:55.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:40:55.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:40:55.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:55.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:55.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:55.751 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:55.750+0000 7fd67cc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:55.753 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:55.751+0000 7fd67cc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:55.754 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:55.752+0000 7fd67cc40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:55.880 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:55.878+0000 7fd67cc40780 -1 Falling back to public interface 2026-02-17T04:40:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:40:55.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:55.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:56.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:56.166 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:56.164+0000 7fd67cc40780 -1 osd.0 130 log_to_monitors true 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 134 up_thru 134 down_at 131 last_clean_interval [106,130) [v2:127.0.0.1:6800/602534727,v1:127.0.0.1:6801/602534727] [v2:127.0.0.1:6802/602534727,v1:127.0.0.1:6803/602534727] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:40:57.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:40:57.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:40:57.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:40:57.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:40:57.229 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:40:57.229 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:40:57.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:40:57.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:40:57.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:40:57.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:40:57.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:40:57.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:40:57.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:40:57.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:40:57.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:40:57.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:40:57.488 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:40:57.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:40:57.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:57.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:40:57.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617667 2026-02-17T04:40:57.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617667 2026-02-17T04:40:57.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617667' 2026-02-17T04:40:57.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:40:57.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:40:57.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=549755813896 2026-02-17T04:40:57.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 549755813896 2026-02-17T04:40:57.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617667 1-549755813896' 2026-02-17T04:40:57.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:57.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617667 2026-02-17T04:40:57.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:57.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:40:57.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617667 2026-02-17T04:40:57.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:57.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617667 2026-02-17T04:40:57.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617667' 2026-02-17T04:40:57.609 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617667 2026-02-17T04:40:57.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:40:57.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617667 -lt 575525617667 2026-02-17T04:40:57.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:40:57.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-549755813896 2026-02-17T04:40:57.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:40:57.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:40:57.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-549755813896 2026-02-17T04:40:57.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:40:57.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=549755813896 2026-02-17T04:40:57.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 549755813896' 2026-02-17T04:40:57.787 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 549755813896 2026-02-17T04:40:57.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:40:57.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 549755813896 -lt 549755813896 2026-02-17T04:40:57.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:40:57.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:57.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:58.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:40:58.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:40:58.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:40:58.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:40:58.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:40:58.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:40:58.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:40:58.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:40:58.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:40:58.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6559: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:40:58.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:40:58.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:40:58.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:40:58.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:40:58.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:58.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ14 rm-attr _ 2026-02-17T04:40:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:40:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:40:58.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:40:58.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:40:58.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:40:58.810 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:40:58.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:40:58.824 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:58.822+0000 7f6ecd669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:58.825 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:58.823+0000 7f6ecd669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:58.826 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:58.824+0000 7f6ecd669780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:40:58.957 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:58.956+0000 7f6ecd669780 -1 Falling back to public interface 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:40:58.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:40:58.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:40:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:40:59.251 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:40:59.248+0000 7f6ecd669780 -1 osd.1 135 log_to_monitors true 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:00.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:00.308 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 139 up_thru 139 down_at 136 last_clean_interval [128,135) [v2:127.0.0.1:6810/3818161176,v1:127.0.0.1:6811/3818161176] [v2:127.0.0.1:6812/3818161176,v1:127.0.0.1:6813/3818161176] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:00.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:00.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:00.310 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:00.310 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:00.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:00.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:00.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:00.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:00.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:00.567 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:00.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:00.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:00.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:00.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617671 2026-02-17T04:41:00.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617671 2026-02-17T04:41:00.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617671' 2026-02-17T04:41:00.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:00.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:00.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=597000454147 2026-02-17T04:41:00.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 597000454147 2026-02-17T04:41:00.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617671 1-597000454147' 2026-02-17T04:41:00.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:00.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617671 2026-02-17T04:41:00.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:00.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:00.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617671 2026-02-17T04:41:00.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:00.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617671 2026-02-17T04:41:00.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617671' 2026-02-17T04:41:00.689 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617671 2026-02-17T04:41:00.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:00.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617669 -lt 575525617671 2026-02-17T04:41:00.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:01.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:01.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:02.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617672 -lt 575525617671 2026-02-17T04:41:02.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:02.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-597000454147 2026-02-17T04:41:02.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:02.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:02.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-597000454147 2026-02-17T04:41:02.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:02.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=597000454147 2026-02-17T04:41:02.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 597000454147' 2026-02-17T04:41:02.038 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 597000454147 2026-02-17T04:41:02.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 597000454148 -lt 597000454147 2026-02-17T04:41:02.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:02.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:02.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:02.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:02.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:02.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:02.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:02.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:02.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:02.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:02.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:02.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:02.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:02.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:02.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:02.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:02.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:02.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:02.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6560: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/bad-val 2026-02-17T04:41:02.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:41:02.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ15 2026-02-17T04:41:02.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 15 % 2 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6564: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:02.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:02.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:41:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:02.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:02.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ15 rm-attr _ 2026-02-17T04:41:03.001 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:03.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:03.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:03.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:03.045 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:03.045 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:03.045 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:03.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:03.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:41:03.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:03.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:41:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:41:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:03.062 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:03.060+0000 7f634e044780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:03.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:03.061+0000 7f634e044780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:03.064 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:03.062+0000 7f634e044780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:03.201 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:03.199+0000 7f634e044780 -1 Falling back to public interface 2026-02-17T04:41:03.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:41:03.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:03.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:03.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:03.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:03.472 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:03.470+0000 7f634e044780 -1 osd.1 140 log_to_monitors true 2026-02-17T04:41:04.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:04.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:04.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:04.379 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:04.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:04.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 144 up_thru 144 down_at 141 last_clean_interval [139,140) [v2:127.0.0.1:6810/2505153983,v1:127.0.0.1:6811/2505153983] [v2:127.0.0.1:6812/2505153983,v1:127.0.0.1:6813/2505153983] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:04.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:04.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:04.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:04.546 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:04.547 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:04.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:04.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:04.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:04.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:04.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:04.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:04.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:04.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:04.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:04.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:04.802 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:04.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:04.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:04.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:04.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=575525617676 2026-02-17T04:41:04.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 575525617676 2026-02-17T04:41:04.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617676' 2026-02-17T04:41:04.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:04.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290627 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290627 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-575525617676 1-618475290627' 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-575525617676 2026-02-17T04:41:04.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:04.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:04.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-575525617676 2026-02-17T04:41:04.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:04.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=575525617676 2026-02-17T04:41:04.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 575525617676' 2026-02-17T04:41:04.922 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 575525617676 2026-02-17T04:41:04.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:05.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617674 -lt 575525617676 2026-02-17T04:41:05.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:06.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:06.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:06.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617677 -lt 575525617676 2026-02-17T04:41:06.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:06.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290627 2026-02-17T04:41:06.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:06.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:06.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290627 2026-02-17T04:41:06.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:06.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290627 2026-02-17T04:41:06.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290627' 2026-02-17T04:41:06.266 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 618475290627 2026-02-17T04:41:06.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:06.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290628 -lt 618475290627 2026-02-17T04:41:06.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:06.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:06.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:06.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:06.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:06.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:06.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:06.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:06.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:06.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ16 2026-02-17T04:41:07.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 16 % 2 2026-02-17T04:41:07.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6568: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:07.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:07.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:07.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:07.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ16 rm-attr snapset 2026-02-17T04:41:07.227 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:07.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:41:07.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:41:07.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:07.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:07.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:07.289 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:07.287+0000 7fea36d3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:07.290 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:07.289+0000 7fea36d3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:07.291 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:07.289+0000 7fea36d3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:07.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:07.409+0000 7fea36d3d780 -1 Falling back to public interface 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:07.438 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:07.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:07.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:07.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:07.750 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:07.748+0000 7fea36d3d780 -1 osd.0 145 log_to_monitors true 2026-02-17T04:41:08.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:08.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:08.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:08.610 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:08.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:08.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:08.778 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 149 up_thru 149 down_at 146 last_clean_interval [134,145) [v2:127.0.0.1:6800/406903625,v1:127.0.0.1:6801/406903625] [v2:127.0.0.1:6802/406903625,v1:127.0.0.1:6803/406903625] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:41:08.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:08.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:08.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:08.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:08.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:08.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:08.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:08.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:08.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:08.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:09.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:09.035 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:09.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:09.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:09.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:09.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127107 2026-02-17T04:41:09.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127107 2026-02-17T04:41:09.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127107' 2026-02-17T04:41:09.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:09.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:09.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290632 2026-02-17T04:41:09.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290632 2026-02-17T04:41:09.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127107 1-618475290632' 2026-02-17T04:41:09.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:09.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127107 2026-02-17T04:41:09.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:09.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:09.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127107 2026-02-17T04:41:09.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:09.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127107 2026-02-17T04:41:09.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127107' 2026-02-17T04:41:09.160 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 639950127107 2026-02-17T04:41:09.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:09.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 575525617678 -lt 639950127107 2026-02-17T04:41:09.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:10.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:10.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:10.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127107 -lt 639950127107 2026-02-17T04:41:10.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:10.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290632 2026-02-17T04:41:10.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:10.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:10.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290632 2026-02-17T04:41:10.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:10.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290632 2026-02-17T04:41:10.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290632' 2026-02-17T04:41:10.502 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 618475290632 2026-02-17T04:41:10.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:10.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290633 -lt 618475290632 2026-02-17T04:41:10.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:10.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:10.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:10.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:11.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:11.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:11.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:11.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:11.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:11.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:11.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:11.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6569: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-17T04:41:11.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6570: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:11.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:41:11.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:11.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:11.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:11.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:11.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:11.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:11.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-17T04:41:11.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:41:11.473 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:41:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:41:11.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:11.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:11.522 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:11.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:11.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:41:11.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:41:11.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:11.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:11.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:11.537 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:11.535+0000 7fcfe1837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:11.538 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:11.536+0000 7fcfe1837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:11.539 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:11.537+0000 7fcfe1837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:11.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:11.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:11.688 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:11.684+0000 7fcfe1837780 -1 Falling back to public interface 2026-02-17T04:41:11.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:11.965 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:11.963+0000 7fcfe1837780 -1 osd.1 150 log_to_monitors true 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:12.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 154 up_thru 154 down_at 151 last_clean_interval [144,150) [v2:127.0.0.1:6810/3519863537,v1:127.0.0.1:6811/3519863537] [v2:127.0.0.1:6812/3519863537,v1:127.0.0.1:6813/3519863537] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:13.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:13.018 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:13.018 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:13.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:13.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:13.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:13.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:13.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:13.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:13.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:13.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:13.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:13.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:13.280 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:13.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:13.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:13.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:13.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127112 2026-02-17T04:41:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127112 2026-02-17T04:41:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127112' 2026-02-17T04:41:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:13.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963587 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963587 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127112 1-661424963587' 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127112 2026-02-17T04:41:13.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:13.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:13.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127112 2026-02-17T04:41:13.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:13.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127112 2026-02-17T04:41:13.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127112' 2026-02-17T04:41:13.400 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 639950127112 2026-02-17T04:41:13.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:13.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127109 -lt 639950127112 2026-02-17T04:41:13.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:14.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:14.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:14.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127112 -lt 639950127112 2026-02-17T04:41:14.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:14.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963587 2026-02-17T04:41:14.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:14.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:14.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963587 2026-02-17T04:41:14.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:14.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963587 2026-02-17T04:41:14.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963587' 2026-02-17T04:41:14.740 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 661424963587 2026-02-17T04:41:14.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:14.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963587 -lt 661424963587 2026-02-17T04:41:14.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:14.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:14.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:15.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:15.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:15.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:15.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:15.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:15.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ17 2026-02-17T04:41:15.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 17 % 2 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6575: TEST_dual_store_replicated_cluster: local payload=ROBJ17 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6576: TEST_dual_store_replicated_cluster: echo ROBJ17 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6577: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:15.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:15.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:15.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:15.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:15.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:15.701 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:15.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:15.744 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:15.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:15.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:41:15.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:41:15.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:15.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:15.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:15.759 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:15.757+0000 7f640c837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:15.760 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:15.758+0000 7f640c837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:15.761 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:15.759+0000 7f640c837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:15.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:15.890+0000 7f640c837780 -1 Falling back to public interface 2026-02-17T04:41:15.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:41:15.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:15.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:16.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:16.179 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:16.177+0000 7f640c837780 -1 osd.0 156 log_to_monitors true 2026-02-17T04:41:17.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:17.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:17.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:17.076 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:17.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:17.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:17.246 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 160 up_thru 160 down_at 157 last_clean_interval [149,156) [v2:127.0.0.1:6800/682357304,v1:127.0.0.1:6801/682357304] [v2:127.0.0.1:6802/682357304,v1:127.0.0.1:6803/682357304] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:17.247 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:17.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:17.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:17.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:17.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:17.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:17.502 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:17.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:17.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:17.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:17.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767363 2026-02-17T04:41:17.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767363 2026-02-17T04:41:17.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767363' 2026-02-17T04:41:17.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:17.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963592 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963592 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767363 1-661424963592' 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767363 2026-02-17T04:41:17.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:17.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:17.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767363 2026-02-17T04:41:17.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:17.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767363 2026-02-17T04:41:17.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767363' 2026-02-17T04:41:17.627 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 687194767363 2026-02-17T04:41:17.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:17.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767363 -lt 687194767363 2026-02-17T04:41:17.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:17.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963592 2026-02-17T04:41:17.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:17.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:17.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963592 2026-02-17T04:41:17.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:17.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963592 2026-02-17T04:41:17.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963592' 2026-02-17T04:41:17.800 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 661424963592 2026-02-17T04:41:17.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:17.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963592 -lt 661424963592 2026-02-17T04:41:17.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:17.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:17.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:18.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:18.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:18.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:18.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:18.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:18.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:18.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:18.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:18.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:18.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:18.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:18.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6578: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:18.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:18.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:18.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:18.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-17T04:41:18.780 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:41:18.780 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:41:18.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:18.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:18.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:41:18.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:41:18.823 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:41:18.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:18.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:41:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:41:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:18.836 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:18.834+0000 7f2e52855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:18.837 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:18.835+0000 7f2e52855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:18.838 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:18.836+0000 7f2e52855780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:18.958 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:18.956+0000 7f2e52855780 -1 Falling back to public interface 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:18.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:19.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:19.238 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:19.236+0000 7f2e52855780 -1 osd.1 161 log_to_monitors true 2026-02-17T04:41:20.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:20.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:20.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:20.163 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:20.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:20.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 165 up_thru 165 down_at 162 last_clean_interval [154,161) [v2:127.0.0.1:6810/3987328438,v1:127.0.0.1:6811/3987328438] [v2:127.0.0.1:6812/3987328438,v1:127.0.0.1:6813/3987328438] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:20.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:20.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:20.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:20.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:20.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:20.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:20.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:20.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:20.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:20.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:20.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:20.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:20.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:20.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:20.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:20.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:20.589 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:20.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:20.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:20.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:20.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767367 2026-02-17T04:41:20.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767367 2026-02-17T04:41:20.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767367' 2026-02-17T04:41:20.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:20.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:20.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603843 2026-02-17T04:41:20.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603843 2026-02-17T04:41:20.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767367 1-708669603843' 2026-02-17T04:41:20.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:20.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767367 2026-02-17T04:41:20.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:20.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:20.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767367 2026-02-17T04:41:20.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767367 2026-02-17T04:41:20.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767367' 2026-02-17T04:41:20.714 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 687194767367 2026-02-17T04:41:20.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:20.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767365 -lt 687194767367 2026-02-17T04:41:20.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:21.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:21.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:22.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767368 -lt 687194767367 2026-02-17T04:41:22.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:22.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603843 2026-02-17T04:41:22.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:22.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:22.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603843 2026-02-17T04:41:22.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:22.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603843 2026-02-17T04:41:22.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603843' 2026-02-17T04:41:22.056 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 708669603843 2026-02-17T04:41:22.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:22.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603844 -lt 708669603843 2026-02-17T04:41:22.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:22.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:22.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:22.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:22.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:22.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:22.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:22.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:22.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:22.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ18 2026-02-17T04:41:22.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 18 % 2 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6583: TEST_dual_store_replicated_cluster: local payload=ROBJ18 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6584: TEST_dual_store_replicated_cluster: echo ROBJ18 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6585: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:23.030 INFO:tasks.workunit.client.0.trial090.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-17T04:41:23.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:23.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:23.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:23.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:41:23.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:23.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:23.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:41:23.080 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:41:23.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:23.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:41:23.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:41:23.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:23.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:23.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:23.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:23.091+0000 7f23e37f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:23.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:23.092+0000 7f23e37f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:23.095 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:23.093+0000 7f23e37f9780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:23.218 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:23.217+0000 7f23e37f9780 -1 Falling back to public interface 2026-02-17T04:41:23.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:23.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:23.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:23.516 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:23.514+0000 7f23e37f9780 -1 osd.0 167 log_to_monitors true 2026-02-17T04:41:24.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:24.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:24.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:24.410 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:24.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:24.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 171 up_thru 171 down_at 168 last_clean_interval [160,167) [v2:127.0.0.1:6800/3413196314,v1:127.0.0.1:6801/3413196314] [v2:127.0.0.1:6802/3413196314,v1:127.0.0.1:6803/3413196314] exists,up e1e4796c-8a74-4b3c-97bd-3be9d6430807 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:24.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:24.576 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:24.576 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:24.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:24.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:24.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:24.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:24.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:24.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:24.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:24.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:24.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:24.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:24.832 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:24.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:24.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:24.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:24.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407619 2026-02-17T04:41:24.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407619 2026-02-17T04:41:24.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407619' 2026-02-17T04:41:24.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603848 2026-02-17T04:41:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603848 2026-02-17T04:41:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407619 1-708669603848' 2026-02-17T04:41:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:24.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407619 2026-02-17T04:41:24.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:24.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:24.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407619 2026-02-17T04:41:24.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:24.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407619 2026-02-17T04:41:24.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407619' 2026-02-17T04:41:24.953 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407619 2026-02-17T04:41:24.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:25.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 734439407619 2026-02-17T04:41:25.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:26.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:26.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:26.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407620 -lt 734439407619 2026-02-17T04:41:26.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:26.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603848 2026-02-17T04:41:26.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:26.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:26.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603848 2026-02-17T04:41:26.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:26.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603848 2026-02-17T04:41:26.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603848' 2026-02-17T04:41:26.291 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 708669603848 2026-02-17T04:41:26.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:26.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603849 -lt 708669603848 2026-02-17T04:41:26.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:26.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:26.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:26.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:26.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:26.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:26.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:26.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:26.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:26.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:26.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:26.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:26.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:26.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:26.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:27.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6586: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:27.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:27.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-17T04:41:27.263 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:41:27.264 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:41:27.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:27.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:27.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:27.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:41:27.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:27.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:27.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:27.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:41:27.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:41:27.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:27.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:27.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:27.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:27.325+0000 7f817780f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:27.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:27.327+0000 7f817780f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:27.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:27.328+0000 7f817780f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:27.465 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:27.464+0000 7f817780f780 -1 Falling back to public interface 2026-02-17T04:41:27.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:27.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:27.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:27.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:27.762 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:27.761+0000 7f817780f780 -1 osd.1 172 log_to_monitors true 2026-02-17T04:41:28.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:28.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:28.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:28.649 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:28.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:28.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:28.815 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 176 up_thru 176 down_at 173 last_clean_interval [165,172) [v2:127.0.0.1:6810/4204770585,v1:127.0.0.1:6811/4204770585] [v2:127.0.0.1:6812/4204770585,v1:127.0.0.1:6813/4204770585] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:28.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:28.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:28.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:28.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:28.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:28.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:28.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:28.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:28.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:29.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:29.073 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:29.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:29.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:29.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:29.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407624 2026-02-17T04:41:29.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407624 2026-02-17T04:41:29.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407624' 2026-02-17T04:41:29.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:29.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=755914244099 2026-02-17T04:41:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 755914244099 2026-02-17T04:41:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407624 1-755914244099' 2026-02-17T04:41:29.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:29.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407624 2026-02-17T04:41:29.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:29.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:29.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407624 2026-02-17T04:41:29.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:29.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407624 2026-02-17T04:41:29.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407624' 2026-02-17T04:41:29.199 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407624 2026-02-17T04:41:29.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407622 -lt 734439407624 2026-02-17T04:41:29.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:30.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:30.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:30.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407625 -lt 734439407624 2026-02-17T04:41:30.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:30.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-755914244099 2026-02-17T04:41:30.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:30.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:30.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-755914244099 2026-02-17T04:41:30.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:30.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=755914244099 2026-02-17T04:41:30.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 755914244099' 2026-02-17T04:41:30.535 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 755914244099 2026-02-17T04:41:30.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:30.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244099 -lt 755914244099 2026-02-17T04:41:30.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:30.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:30.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:30.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:30.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:30.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:30.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:30.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:30.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:30.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:30.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:31.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:31.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:31.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:31.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6588: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:41:31.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:41:31.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:41:31.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:41:31.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:41:31.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:41:31.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-17T04:41:31.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:41:31.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:41:31.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:41:31.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:41:31.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:31.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 corrupt-info 2026-02-17T04:41:31.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-17T04:41:31.490 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-17T04:41:31.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:41:31.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:41:31.543 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:41:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-17T04:41:31.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:41:31.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:41:31.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:41:31.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:41:31.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:41:31.558 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:31.557+0000 7f97491d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:31.560 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:31.559+0000 7f97491d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:31.561 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:31.560+0000 7f97491d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:41:31.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:31.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:31.773 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:31.772+0000 7f97491d8780 -1 Falling back to public interface 2026-02-17T04:41:31.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:41:32.073 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:41:32.071+0000 7f97491d8780 -1 osd.1 177 log_to_monitors true 2026-02-17T04:41:32.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:41:32.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:41:32.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:41:32.875 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:41:32.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:41:32.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:41:33.040 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 181 up_thru 181 down_at 178 last_clean_interval [176,177) [v2:127.0.0.1:6810/3340787722,v1:127.0.0.1:6811/3340787722] [v2:127.0.0.1:6812/3340787722,v1:127.0.0.1:6813/3340787722] exists,up 1993cf2a-89a9-45ee-bf0b-4adef7c9e1c7 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:33.041 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:33.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:33.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:33.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:41:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:41:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:41:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:41:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:33.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:33.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:33.299 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:33.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:33.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:33.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:33.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407629 2026-02-17T04:41:33.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407629 2026-02-17T04:41:33.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407629' 2026-02-17T04:41:33.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:33.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:33.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080579 2026-02-17T04:41:33.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080579 2026-02-17T04:41:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407629 1-777389080579' 2026-02-17T04:41:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:33.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407629 2026-02-17T04:41:33.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:33.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407629 2026-02-17T04:41:33.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:33.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407629 2026-02-17T04:41:33.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407629' 2026-02-17T04:41:33.420 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 734439407629 2026-02-17T04:41:33.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:33.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407627 -lt 734439407629 2026-02-17T04:41:33.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:34.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:34.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:34.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407630 -lt 734439407629 2026-02-17T04:41:34.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:34.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080579 2026-02-17T04:41:34.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:34.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:34.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080579 2026-02-17T04:41:34.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:34.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080579 2026-02-17T04:41:34.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080579' 2026-02-17T04:41:34.755 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 777389080579 2026-02-17T04:41:34.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:34.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080579 -lt 777389080579 2026-02-17T04:41:34.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:41:34.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:34.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:35.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:41:35.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:41:35.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:41:35.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:41:35.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:41:35.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:41:35.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ19 2026-02-17T04:41:35.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 19 % 2 2026-02-17T04:41:35.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6597: TEST_dual_store_replicated_cluster: get_pg csr_pool ROBJ0 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-17T04:41:35.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:41:35.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6597: TEST_dual_store_replicated_cluster: local pg=3.0 2026-02-17T04:41:35.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6599: TEST_dual_store_replicated_cluster: ceph tell 'osd.*' injectargs -- --osd-max-object-size=1048576 2026-02-17T04:41:35.737 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: {} 2026-02-17T04:41:35.738 INFO:tasks.workunit.client.0.trial090.stderr:osd.0: osd_max_object_size = '' 2026-02-17T04:41:35.747 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: {} 2026-02-17T04:41:35.748 INFO:tasks.workunit.client.0.trial090.stderr:osd.1: osd_max_object_size = '' 2026-02-17T04:41:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6601: TEST_dual_store_replicated_cluster: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-17T04:41:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:41:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:41:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:41:35.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:41:35.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-17T04:41:35.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-17T04:41:35.755 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:41:35.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:41:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:41:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:41:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:41:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:41:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:41:35.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:41:35.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:41:35.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:41:35.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:41:35.928 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:41:35.929 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:35.929 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:35.929 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:35.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:41:35.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:41:35.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:41:35.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:41:35.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:35.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:41:35.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:41:35.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6602: TEST_dual_store_replicated_cluster: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-17T04:41:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-17T04:41:36.031 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:41:36.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:41:36.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:41:36.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:41:36.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:36.201 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:36.202 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:41:36.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:41:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:41:36.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:41:36.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:41:36.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:41:36.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:41:36.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:41:36.248 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:36.249 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:36.249 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:36.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:41:36.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:41:36.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-17T04:41:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6603: TEST_dual_store_replicated_cluster: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-17T04:41:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:41:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:41:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T04:41:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:41:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:41:36.301 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:41:36.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:41:36.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-17T04:41:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:41:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T04:41:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:41:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:36.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:41:36.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:41:36.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:41:36.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:41:36.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:41:36.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T04:41:36.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:41:36.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:41:36.531 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:36.531 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:36.532 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:36.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.1.asok 2026-02-17T04:41:36.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:41:36.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-17T04:41:36.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6606: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-17T04:41:36.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:41:36.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:36.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:36.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:36.579 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:36.579 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:36.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:36.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:36.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:36.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:36.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:36.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:36.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:36.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:36.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:36.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:36.970 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:36.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:36.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:36.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:37.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407634 2026-02-17T04:41:37.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407634 2026-02-17T04:41:37.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407634' 2026-02-17T04:41:37.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:37.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:37.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080583 2026-02-17T04:41:37.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080583 2026-02-17T04:41:37.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407634 1-777389080583' 2026-02-17T04:41:37.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:37.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407634 2026-02-17T04:41:37.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:37.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:37.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407634 2026-02-17T04:41:37.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:37.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407634 2026-02-17T04:41:37.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407634' 2026-02-17T04:41:37.093 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407634 2026-02-17T04:41:37.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:37.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407632 -lt 734439407634 2026-02-17T04:41:37.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:38.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:38.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:38.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407635 -lt 734439407634 2026-02-17T04:41:38.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:38.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080583 2026-02-17T04:41:38.427 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:38.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:38.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080583 2026-02-17T04:41:38.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080583 2026-02-17T04:41:38.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080583' 2026-02-17T04:41:38.431 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080583 2026-02-17T04:41:38.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:38.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080584 -lt 777389080583 2026-02-17T04:41:38.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:38.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:38.602 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:38.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:38.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:38.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:38.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:38.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:38.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:41:38.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:38.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:38.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:38.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:38.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:41:38.984 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:38.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:38.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:38.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:38.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:38.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:38.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:40:01.767978+0000 '>' 2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:40.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:40.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:40.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:40.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:40.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:40.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:40.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:40.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:39.028641+0000 '>' 2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:40.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:41:40.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6607: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6608: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:40.332 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:40.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:40.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:40.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:40.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:40.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:40.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:40.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:40.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:40.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:40.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:40.730 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:40.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:40.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:40.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407639 2026-02-17T04:41:40.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407639 2026-02-17T04:41:40.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407639' 2026-02-17T04:41:40.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:40.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:40.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080588 2026-02-17T04:41:40.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080588 2026-02-17T04:41:40.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407639 1-777389080588' 2026-02-17T04:41:40.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:40.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407639 2026-02-17T04:41:40.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:40.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:40.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407639 2026-02-17T04:41:40.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:40.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407639 2026-02-17T04:41:40.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407639' 2026-02-17T04:41:40.854 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407639 2026-02-17T04:41:40.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407637 -lt 734439407639 2026-02-17T04:41:41.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:42.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:42.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:42.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407640 -lt 734439407639 2026-02-17T04:41:42.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:42.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080588 2026-02-17T04:41:42.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:42.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:42.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080588 2026-02-17T04:41:42.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:42.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080588 2026-02-17T04:41:42.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080588' 2026-02-17T04:41:42.196 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080588 2026-02-17T04:41:42.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080589 -lt 777389080588 2026-02-17T04:41:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:42.363 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:42.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:42.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:42.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:42.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:42.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:42.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:42.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:41:39.028641+0000 2026-02-17T04:41:42.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:41:42.748 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:41:39.028641+0000 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:41:39.028641+0000 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:42.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:42.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:42.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:39.028641+0000 '>' 2026-02-17T04:41:39.028641+0000 2026-02-17T04:41:42.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:43.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:43.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:43.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:43.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:43.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:43.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:43.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:44.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:43.000605+0000 '>' 2026-02-17T04:41:39.028641+0000 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6609: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:41:44.091 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:41:44.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:41:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6611: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6614: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-17T04:41:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:41:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:44.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:44.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:44.114 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:44.115 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:44.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:44.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:44.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:44.505 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:44.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:44.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:44.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:44.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407643 2026-02-17T04:41:44.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407643 2026-02-17T04:41:44.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407643' 2026-02-17T04:41:44.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:44.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:44.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080593 2026-02-17T04:41:44.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080593 2026-02-17T04:41:44.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407643 1-777389080593' 2026-02-17T04:41:44.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:44.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407643 2026-02-17T04:41:44.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:44.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:44.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407643 2026-02-17T04:41:44.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:44.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407643 2026-02-17T04:41:44.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407643' 2026-02-17T04:41:44.630 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407643 2026-02-17T04:41:44.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:44.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407642 -lt 734439407643 2026-02-17T04:41:44.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:45.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:45.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:45.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407645 -lt 734439407643 2026-02-17T04:41:45.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:45.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080593 2026-02-17T04:41:45.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:45.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:45.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080593 2026-02-17T04:41:45.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080593 2026-02-17T04:41:45.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080593' 2026-02-17T04:41:45.970 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080593 2026-02-17T04:41:45.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:46.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080594 -lt 777389080593 2026-02-17T04:41:46.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:46.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:46.138 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:46.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:46.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:46.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:46.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:46.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:46.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:46.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:46.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:46.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:46.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:41:46.523 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-17T04:41:46.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:40:01.767978+0000 last_deep_scrub_stamp 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:46.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:46.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:46.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:46.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:40:01.767978+0000 '>' 2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:46.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:47.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:47.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:47.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:47.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:47.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:47.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:47.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:47.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:47.034504+0000 '>' 2026-02-17T04:40:01.767978+0000 2026-02-17T04:41:47.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:41:47.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6615: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:47.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:41:47.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:41:47.864 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:41:47.865 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:41:47.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:41:47.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6617: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:47.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6620: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-17T04:41:47.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:41:47.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:47.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:47.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:47.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:47.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:47.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:47.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:47.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:48.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:48.286 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:48.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:48.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:48.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407648 2026-02-17T04:41:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407648 2026-02-17T04:41:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407648' 2026-02-17T04:41:48.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:48.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:48.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080598 2026-02-17T04:41:48.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080598 2026-02-17T04:41:48.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407648 1-777389080598' 2026-02-17T04:41:48.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:48.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407648 2026-02-17T04:41:48.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:48.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:48.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407648 2026-02-17T04:41:48.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:48.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407648 2026-02-17T04:41:48.409 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407648 2026-02-17T04:41:48.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407648' 2026-02-17T04:41:48.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:48.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407647 -lt 734439407648 2026-02-17T04:41:48.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:49.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:49.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407650 -lt 734439407648 2026-02-17T04:41:49.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:49.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080598 2026-02-17T04:41:49.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:49.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:49.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080598 2026-02-17T04:41:49.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:49.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080598 2026-02-17T04:41:49.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080598' 2026-02-17T04:41:49.749 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080598 2026-02-17T04:41:49.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:49.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080599 -lt 777389080598 2026-02-17T04:41:49.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:49.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:49.923 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:49.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:49.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:49.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:49.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:50.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:50.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:41:50.310 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:41:50.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:50.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:50.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:50.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:47.034504+0000 '>' 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:50.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:51.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:51.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:51.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:51.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:51.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:51.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:51.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:51.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:47.034504+0000 '>' 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:51.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:52.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:52.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:52.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:52.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:52.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:52.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:52.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:50.944948+0000 '>' 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6621: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:41:52.819 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:41:52.820 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:41:52.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:41:52.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6623: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:52.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6626: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dp_results.json td/osd-scrub-repair/sh2_results.json 2026-02-17T04:41:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6630: TEST_dual_store_replicated_cluster: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-17T04:41:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T04:41:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T04:41:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-17T04:41:52.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-17T04:41:52.848 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T04:41:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T04:41:53.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-17T04:41:53.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T04:41:53.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-17T04:41:53.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T04:41:53.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-17T04:41:53.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:41:53.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.430464/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-17T04:41:53.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T04:41:53.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T04:41:53.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-osd.0.asok 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T04:41:53.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.430464/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6632: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:53.116 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:53.117 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:53.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:53.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:53.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:53.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:53.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:53.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:53.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:53.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:53.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:53.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:53.508 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:53.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:53.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:53.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:53.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407654 2026-02-17T04:41:53.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407654 2026-02-17T04:41:53.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407654' 2026-02-17T04:41:53.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:53.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:53.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080604 2026-02-17T04:41:53.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080604 2026-02-17T04:41:53.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407654 1-777389080604' 2026-02-17T04:41:53.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:53.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407654 2026-02-17T04:41:53.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:53.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:53.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407654 2026-02-17T04:41:53.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:53.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407654 2026-02-17T04:41:53.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407654' 2026-02-17T04:41:53.631 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407654 2026-02-17T04:41:53.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:53.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407655 -lt 734439407654 2026-02-17T04:41:53.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080604 2026-02-17T04:41:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:53.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:53.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080604 2026-02-17T04:41:53.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:53.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080604 2026-02-17T04:41:53.801 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080604 2026-02-17T04:41:53.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080604' 2026-02-17T04:41:53.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:53.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080604 -lt 777389080604 2026-02-17T04:41:53.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:53.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:53.968 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:53.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:53.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:53.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:53.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:53.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:54.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:54.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:54.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:54.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:54.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-17T04:41:54.348 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-17T04:41:54.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-17T04:41:47.034504+0000 last_deep_scrub_stamp 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:54.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:54.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:54.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:54.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:47.034504+0000 '>' 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:54.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:41:55.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:41:55.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:55.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-17T04:41:55.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:55.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T04:41:55.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:55.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-17T04:41:55.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:55.029818+0000 '>' 2026-02-17T04:41:47.034504+0000 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6634: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6635: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6637: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:41:55.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:41:55.691 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:41:55.692 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:41:55.692 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:41:55.692 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:41:55.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6642: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:41:55.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:41:55.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:41:55.716 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:41:55.717 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:41:55.718 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:41:55.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: jq 'del(.inconsistents[] | select(.object.name == "ROBJ13"))' 2026-02-17T04:41:55.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6645: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:41:55.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6645: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:41:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6646: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:41:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6649: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-17T04:41:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-17T04:41:55.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-17T04:41:55.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-17T04:41:55.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:41:55.744 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:41:55.745 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:41:55.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:41:55.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:41:55.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:41:55.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:41:56.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:41:56.132 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:41:56.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:41:56.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:56.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:41:56.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407658 2026-02-17T04:41:56.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407658 2026-02-17T04:41:56.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407658' 2026-02-17T04:41:56.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:41:56.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:41:56.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080608 2026-02-17T04:41:56.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080608 2026-02-17T04:41:56.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407658 1-777389080608' 2026-02-17T04:41:56.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:56.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407658 2026-02-17T04:41:56.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:56.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:41:56.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407658 2026-02-17T04:41:56.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:56.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407658 2026-02-17T04:41:56.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407658' 2026-02-17T04:41:56.252 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 734439407658 2026-02-17T04:41:56.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:56.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407657 -lt 734439407658 2026-02-17T04:41:56.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:41:57.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:57.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407657 -lt 734439407658 2026-02-17T04:41:57.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:41:58.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:41:58.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:41:58.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407660 -lt 734439407658 2026-02-17T04:41:58.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:41:58.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080608 2026-02-17T04:41:58.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:41:58.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:41:58.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080608 2026-02-17T04:41:58.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:41:58.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080608 2026-02-17T04:41:58.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080608' 2026-02-17T04:41:58.763 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 777389080608 2026-02-17T04:41:58.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:41:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080609 -lt 777389080608 2026-02-17T04:41:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:41:58.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-17T04:41:58.929 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 3.0 loop 0 2026-02-17T04:41:58.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-17T04:41:58.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-17T04:41:58.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:41:58.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-17T04:41:58.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:41:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:58.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:59.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:41:55.029818+0000 2026-02-17T04:41:59.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-17T04:41:59.312 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-17T04:41:55.029818+0000 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:41:55.029818+0000 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:41:59.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:41:59.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:41:59.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:41:59.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:55.029818+0000 '>' 2026-02-17T04:41:55.029818+0000 2026-02-17T04:41:59.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:00.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:00.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:00.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:42:00.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:42:00.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:00.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:00.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:42:00.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:55.029818+0000 '>' 2026-02-17T04:41:55.029818+0000 2026-02-17T04:42:00.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:01.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:01.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:01.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-17T04:42:01.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-17T04:42:01.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:01.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:01.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:41:59.927117+0000 '>' 2026-02-17T04:41:55.029818+0000 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6651: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6652: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6654: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-17T04:42:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:42:01.823 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:42:01.824 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:42:01.824 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:42:01.824 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:42:01.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:42:01.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: . as $in 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: | if type == "object" then 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: reduce keys[] as $key 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: else f 2026-02-17T04:42:01.849 INFO:tasks.workunit.client.0.trial090.stderr: end; 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: jq 'del(.inconsistents[] | select(.object.name == "ROBJ13"))' 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6661: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-17T04:42:01.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6661: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-17T04:42:01.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6665: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dpPart2_w13_results.json td/osd-scrub-repair/sh2Part2_w13_results.json 2026-02-17T04:42:01.874 INFO:tasks.workunit.client.0.trial090.stdout:--- td/osd-scrub-repair/dpPart2_w13_results.json 2026-02-17 04:41:55.711902101 +0000 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+++ td/osd-scrub-repair/sh2Part2_w13_results.json 2026-02-17 04:42:01.844815066 +0000 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:@@ -233,6 +233,38 @@ 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head" 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+ "selected_object_info": { 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+ "alloc_hint_flags": 0, 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+ "data_digest": "0x2ddbf8f5", 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+ "expected_object_size": 0, 2026-02-17T04:42:01.875 INFO:tasks.workunit.client.0.trial090.stdout:+ "expected_write_size": 0, 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "flags": [ 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "dirty", 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "omap", 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "data_digest", 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "omap_digest" 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ ], 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "lost": 0, 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "manifest": { 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "type": 0 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ }, 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "oid": { 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "hash": 2682806379, 2026-02-17T04:42:01.876 INFO:tasks.workunit.client.0.trial090.stdout:+ "key": "", 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "max": 0, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "namespace": "", 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "oid": "ROBJ13", 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "pool": 3, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "snapid": -2 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ }, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "omap_digest": "0x6441854d", 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "shard_versions": [], 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "size": 7, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "truncate_seq": 0, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "truncate_size": 0, 2026-02-17T04:42:01.877 INFO:tasks.workunit.client.0.trial090.stdout:+ "user_version": 39, 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:+ "watchers": {} 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:+ }, 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:@@ -242,17 +274,14 @@ 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:- "errors": [ 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:- "read_error" 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:- ], 2026-02-17T04:42:01.878 INFO:tasks.workunit.client.0.trial090.stdout:+ "errors": [], 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: "size": 7 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout:- "stat_error", 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout:- "read_error" 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout:+ "stat_error" 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:42:01.879 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:42:01.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6666: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dpPart2_wo13_results.json td/osd-scrub-repair/shPart2_wo13_results.json 2026-02-17T04:42:01.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6668: TEST_dual_store_replicated_cluster: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-17T04:42:02.082 INFO:tasks.workunit.client.0.trial090.stderr:pool 'csr_pool' removed 2026-02-17T04:42:02.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6669: TEST_dual_store_replicated_cluster: return 0 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:02.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:02.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:02.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:42:02.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:42:02.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:42:02.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:42:02.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:42:02.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:42:02.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:02.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:42:02.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:42:02.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:02.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:42:02.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:42:02.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:42:02.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:42:02.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:42:02.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:02.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:02.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:02.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:02.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:02.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:02.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:42:02.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:42:02.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:42:02.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:42:02.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:42:02.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:42:02.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:02.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:42:02.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:42:02.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:02.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:42:02.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:42:02.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:42:02.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:42:02.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:42:02.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:42:02.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:42:02.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:42:02.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:42:02.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:42:02.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_list_missing_erasure_coded_appends td/osd-scrub-repair 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1037: TEST_list_missing_erasure_coded_appends: list_missing_erasure_coded td/osd-scrub-repair false 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:975: list_missing_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:976: list_missing_erasure_coded: local allow_overwrites=false 2026-02-17T04:42:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:977: list_missing_erasure_coded: local poolname=ecpool 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:979: list_missing_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:42:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:02.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:42:02.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:42:02.298 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:42:02.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:42:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:42:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:42:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:42:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:42:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:42:02.344 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:42:02.344 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:42:02.344 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:42:02.345 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:42:02.345 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.345 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.345 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:42:02.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:42:02.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:980: list_missing_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:42:02.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:02.471 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:42:02.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:42:02.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:02.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:02.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:02.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:02.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:02.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:02.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:02.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:02.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:02.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:02.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:02.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:02.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:02.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6' 2026-02-17T04:42:02.493 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 2026-02-17T04:42:02.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:02.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCa8ZNpv8LjHRAAsUvrM4Rpotyc1VDwsUpmrQ== 2026-02-17T04:42:02.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCa8ZNpv8LjHRAAsUvrM4Rpotyc1VDwsUpmrQ=="}' 2026-02-17T04:42:02.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:42:02.582 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:02.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:42:02.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCa8ZNpv8LjHRAAsUvrM4Rpotyc1VDwsUpmrQ== --osd-uuid 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 2026-02-17T04:42:02.605 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:02.603+0000 7f94aa62e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:02.607 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:02.605+0000 7f94aa62e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:02.608 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:02.606+0000 7f94aa62e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:02.608 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:02.606+0000 7f94aa62e780 -1 bdev(0x29bac00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:02.608 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:02.606+0000 7f94aa62e780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:42:03.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:42:03.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:03.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:42:03.078 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:42:03.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:03.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:42:03.161 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:42:03.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:03.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:03.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:03.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:03.175 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:03.173+0000 7ff3fde0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:03.177 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:03.175+0000 7ff3fde0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:03.177 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:03.176+0000 7ff3fde0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:03.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:03.241 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:03.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:03.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:03.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:03.376 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:03.373+0000 7ff3fde0b780 -1 Falling back to public interface 2026-02-17T04:42:03.693 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:03.690+0000 7ff3fde0b780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:42:04.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:04.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:04.322 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:04.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:04.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:04.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:04.402 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/20687417,v1:127.0.0.1:6801/20687417] [v2:127.0.0.1:6802/20687417,v1:127.0.0.1:6803/20687417] exists,up 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:04.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=720d9720-8f81-4df9-b668-e4263f7b5b5f 2026-02-17T04:42:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 720d9720-8f81-4df9-b668-e4263f7b5b5f' 2026-02-17T04:42:04.406 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 720d9720-8f81-4df9-b668-e4263f7b5b5f 2026-02-17T04:42:04.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:04.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCc8ZNpUZ3AGBAATuwnKujtKi9nokZqjv4EKw== 2026-02-17T04:42:04.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCc8ZNpUZ3AGBAATuwnKujtKi9nokZqjv4EKw=="}' 2026-02-17T04:42:04.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 720d9720-8f81-4df9-b668-e4263f7b5b5f -i td/osd-scrub-repair/1/new.json 2026-02-17T04:42:04.495 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:04.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:42:04.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCc8ZNpUZ3AGBAATuwnKujtKi9nokZqjv4EKw== --osd-uuid 720d9720-8f81-4df9-b668-e4263f7b5b5f 2026-02-17T04:42:04.517 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:04.516+0000 7fe78a608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:04.519 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:04.517+0000 7fe78a608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:04.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:04.518+0000 7fe78a608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:04.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:04.518+0000 7fe78a608780 -1 bdev(0x408ac00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:04.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:04.518+0000 7fe78a608780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:42:04.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:42:04.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:04.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:42:04.868 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:42:04.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:05.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:42:05.081 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:42:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:05.095 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:05.093+0000 7fb63e265780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:05.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:05.095+0000 7fb63e265780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:05.097 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:05.095+0000 7fb63e265780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:05.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:42:05.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:05.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:42:05.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:05.257 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:05.256+0000 7fb63e265780 -1 Falling back to public interface 2026-02-17T04:42:05.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:05.556 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:05.554+0000 7fb63e265780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:06.577 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2751432237,v1:127.0.0.1:6811/2751432237] [v2:127.0.0.1:6812/2751432237,v1:127.0.0.1:6813/2751432237] exists,up 720d9720-8f81-4df9-b668-e4263f7b5b5f 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:42:06.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:42:06.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:06.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c9205e86-e6a3-4015-b829-98d14d4b9c53 2026-02-17T04:42:06.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c9205e86-e6a3-4015-b829-98d14d4b9c53' 2026-02-17T04:42:06.581 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 c9205e86-e6a3-4015-b829-98d14d4b9c53 2026-02-17T04:42:06.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:06.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCe8ZNpwKFAIxAAEz0Jnm7+NQ/5G0Oghb44Nw== 2026-02-17T04:42:06.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCe8ZNpwKFAIxAAEz0Jnm7+NQ/5G0Oghb44Nw=="}' 2026-02-17T04:42:06.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c9205e86-e6a3-4015-b829-98d14d4b9c53 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:42:06.754 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:42:06.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:42:06.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCe8ZNpwKFAIxAAEz0Jnm7+NQ/5G0Oghb44Nw== --osd-uuid c9205e86-e6a3-4015-b829-98d14d4b9c53 2026-02-17T04:42:06.778 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:06.776+0000 7f1943250780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:06.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:06.778+0000 7f1943250780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:06.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:06.779+0000 7f1943250780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:06.781 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:06.779+0000 7f1943250780 -1 bdev(0x3612c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:06.781 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:06.779+0000 7f1943250780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:42:07.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:42:07.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:07.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:42:07.100 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:42:07.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:07.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:42:07.311 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:42:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:07.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:07.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:07.324+0000 7f8cfd652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:07.327 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:07.325+0000 7f8cfd652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:07.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:07.326+0000 7f8cfd652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:07.459 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:07.457+0000 7f8cfd652780 -1 Falling back to public interface 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:07.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:07.482 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:07.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:07.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:07.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:07.789 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:07.787+0000 7f8cfd652780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:42:08.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:08.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:08.653 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:08.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:08.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:08.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:08.819 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3938504385,v1:127.0.0.1:6819/3938504385] [v2:127.0.0.1:6820/3938504385,v1:127.0.0.1:6821/3938504385] exists,up c9205e86-e6a3-4015-b829-98d14d4b9c53 2026-02-17T04:42:08.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:08.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:08.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:08.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:984: list_missing_erasure_coded: create_rbd_pool 2026-02-17T04:42:08.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:42:08.983 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:42:08.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:42:08.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:42:09.203 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:42:09.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:42:10.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:42:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:985: list_missing_erasure_coded: wait_for_clean 2026-02-17T04:42:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:42:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:42:10.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:42:10.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:42:10.500 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:42:10.500 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:42:10.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:42:10.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:42:10.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:42:10.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:42:10.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:42:10.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:42:10.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:42:10.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:42:10.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:42:10.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:42:10.762 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:10.762 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:42:10.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:42:10.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:10.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:42:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:42:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:42:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:42:10.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:10.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:42:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:42:10.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:42:10.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:42:10.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:10.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:42:10.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T04:42:10.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T04:42:10.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542147' 2026-02-17T04:42:10.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:10.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:42:10.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:10.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:42:10.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:42:10.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:10.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:42:10.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:42:10.949 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:42:10.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:11.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:42:11.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:12.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:42:12.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:12.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:42:12.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:13.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:42:13.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:13.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:42:13.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:13.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:42:13.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:13.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:42:13.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:42:13.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:13.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:42:13.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:42:13.459 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:42:13.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:13.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-17T04:42:13.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:13.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T04:42:13.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:13.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:42:13.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T04:42:13.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:13.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T04:42:13.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T04:42:13.632 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T04:42:13.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:42:13.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T04:42:13.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:42:13.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:13.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:14.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:42:14.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:42:14.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:42:14.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:42:14.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:42:14.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:14.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:987: list_missing_erasure_coded: create_ec_pool ecpool false k=2 m=1 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:42:14.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:42:14.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T04:42:14.628 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:42:14.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:42:14.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:42:14.934 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:42:14.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:42:15.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:42:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:42:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:42:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:42:15.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:42:15.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:42:15.948 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:42:15.948 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:42:15.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:42:15.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:42:15.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:42:16.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:42:16.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:42:16.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:42:16.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:42:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:42:16.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:42:16.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:42:16.205 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:16.206 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:42:16.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:42:16.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:16.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:42:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:42:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:42:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:42:16.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:16.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:42:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:42:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:42:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T04:42:16.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:16.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:42:16.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-17T04:42:16.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-17T04:42:16.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542149' 2026-02-17T04:42:16.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:16.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:42:16.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:16.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:42:16.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:42:16.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:16.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:42:16.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:42:16.388 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:42:16.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:16.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T04:42:16.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:17.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:42:17.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:17.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:42:17.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:17.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:42:17.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:17.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:42:17.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:42:17.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:17.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:42:17.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:42:17.728 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672964 2026-02-17T04:42:17.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:17.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T04:42:17.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:17.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-17T04:42:17.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:17.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:42:17.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-17T04:42:17.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:17.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-17T04:42:17.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-17T04:42:17.904 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542149 2026-02-17T04:42:17.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:42:18.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542149 2026-02-17T04:42:18.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:42:18.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:18.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:18.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:42:18.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:42:18.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:42:18.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:42:18.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:42:18.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:42:18.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:42:18.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:42:18.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:42:18.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:42:18.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:18.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:990: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ0 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ0 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:42:18.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:42:18.872 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:42:18.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:42:19.075 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:42:19.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:42:19.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:42:19.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ0 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:42:19.103 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: get_osds ecpool MOBJ0 2026-02-17T04:42:19.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:42:19.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ0 2026-02-17T04:42:19.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ0 2026-02-17T04:42:19.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:42:19.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-17T04:42:19.274 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: osds0=('2' '1' '0') 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: local -a osds0 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:994: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ1 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ1 2026-02-17T04:42:19.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:42:19.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:42:19.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:42:19.489 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:42:19.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:42:19.694 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:42:19.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:42:19.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:42:19.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:42:19.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: get_osds ecpool MOBJ1 2026-02-17T04:42:19.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:42:19.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ1 2026-02-17T04:42:19.722 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ1 2026-02-17T04:42:19.722 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:42:19.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-17T04:42:19.891 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:19.891 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:42:19.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-17T04:42:19.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: osds1=('2' '1' '0') 2026-02-17T04:42:19.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: local -a osds1 2026-02-17T04:42:19.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:19.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:19.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:42:19.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:19.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:19.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:19.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:19.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:20.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:20.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:20.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:42:20.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:20.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:20.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:20.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:20.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:20.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:20.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:20.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:42:20.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:20.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:20.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:20.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:20.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:20.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:20.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1002: list_missing_erasure_coded: id=2 2026-02-17T04:42:20.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1003: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 MOBJ0 remove 2026-02-17T04:42:20.920 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:a9030505:::MOBJ0:head# 2026-02-17T04:42:20.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1005: list_missing_erasure_coded: id=1 2026-02-17T04:42:20.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1006: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ0 remove 2026-02-17T04:42:21.068 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:a9030505:::MOBJ0:head# 2026-02-17T04:42:21.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1009: list_missing_erasure_coded: id=1 2026-02-17T04:42:21.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1010: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ1 remove 2026-02-17T04:42:21.197 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:8dd16d55:::MOBJ1:head# 2026-02-17T04:42:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1012: list_missing_erasure_coded: id=0 2026-02-17T04:42:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1013: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 MOBJ1 remove 2026-02-17T04:42:21.335 INFO:tasks.workunit.client.0.trial090.stdout:remove 2#2:8dd16d55:::MOBJ1:head# 2026-02-17T04:42:21.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 0 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:42:21.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:21.382 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:21.383 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:21.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:21.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:21.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:42:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:42:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:42:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:42:21.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:42:21.398 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:21.396+0000 7f72c760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:21.399 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:21.397+0000 7f72c760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:21.400 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:21.398+0000 7f72c760d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:21.530 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:21.528+0000 7f72c760d780 -1 Falling back to public interface 2026-02-17T04:42:21.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:21.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:21.551 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:42:21.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:21.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:21.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:21.875 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:21.873+0000 7f72c760d780 -1 osd.0 30 log_to_monitors true 2026-02-17T04:42:22.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:22.717 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:22.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:22.890 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 37 up_thru 37 down_at 31 last_clean_interval [5,30) [v2:127.0.0.1:6800/2745090639,v1:127.0.0.1:6801/2745090639] [v2:127.0.0.1:6802/2745090639,v1:127.0.0.1:6803/2745090639] exists,up 214c87e5-cf3f-4bdc-a210-0c5a1936e1f6 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 1 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:42:22.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:42:22.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:22.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:22.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:22.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:42:22.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:42:22.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:42:22.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:42:22.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:42:22.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:42:22.905 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:22.903+0000 7feecc3e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:22.906 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:22.904+0000 7feecc3e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:22.907 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:22.905+0000 7feecc3e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:23.040 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:23.037+0000 7feecc3e3780 -1 Falling back to public interface 2026-02-17T04:42:23.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:42:23.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:23.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:23.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:23.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:23.331 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:23.329+0000 7feecc3e3780 -1 osd.1 32 log_to_monitors true 2026-02-17T04:42:24.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:24.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:24.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:24.226 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:24.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:24.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:24.398 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 40 up_thru 40 down_at 33 last_clean_interval [10,32) [v2:127.0.0.1:6810/1440071199,v1:127.0.0.1:6811/1440071199] [v2:127.0.0.1:6812/1440071199,v1:127.0.0.1:6813/1440071199] exists,up 720d9720-8f81-4df9-b668-e4263f7b5b5f 2026-02-17T04:42:24.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:24.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 2 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:24.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:24.400 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:42:24.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:42:24.402 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:42:24.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:24.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:42:24.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:42:24.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:42:24.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:42:24.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:42:24.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:24.411+0000 7f4e55487780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:24.414 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:24.412+0000 7f4e55487780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:24.415 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:24.413+0000 7f4e55487780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:24.538 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:24.536+0000 7f4e55487780 -1 Falling back to public interface 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:24.565 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:42:24.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:24.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:24.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:24.837 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:24.835+0000 7f4e55487780 -1 osd.2 34 log_to_monitors true 2026-02-17T04:42:25.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:25.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:25.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:25.733 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:25.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:25.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:25.898 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 44 up_thru 44 down_at 35 last_clean_interval [14,34) [v2:127.0.0.1:6818/3171137580,v1:127.0.0.1:6819/3171137580] [v2:127.0.0.1:6820/3171137580,v1:127.0.0.1:6821/3171137580] exists,up c9205e86-e6a3-4015-b829-98d14d4b9c53 2026-02-17T04:42:25.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:25.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:25.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:25.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1019: list_missing_erasure_coded: create_rbd_pool 2026-02-17T04:42:25.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:42:26.104 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' removed 2026-02-17T04:42:26.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:42:26.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:42:26.310 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:42:26.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:42:27.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:42:27.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1020: list_missing_erasure_coded: wait_for_clean 2026-02-17T04:42:27.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:42:27.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:42:27.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:42:27.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:42:27.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:42:27.603 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:42:27.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:42:27.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:42:27.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:42:27.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:42:27.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:42:27.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:42:27.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:42:27.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:42:27.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:27.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:42:27.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T04:42:27.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T04:42:27.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789955' 2026-02-17T04:42:27.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:27.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:42:27.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691842 2026-02-17T04:42:27.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691842 2026-02-17T04:42:27.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789955 1-171798691842' 2026-02-17T04:42:27.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:27.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:42:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-17T04:42:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-17T04:42:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789955 1-171798691842 2-188978561026' 2026-02-17T04:42:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:28.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-158913789955 2026-02-17T04:42:28.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:28.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:42:28.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789955 2026-02-17T04:42:28.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:28.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T04:42:28.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 158913789955' 2026-02-17T04:42:28.046 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 158913789955 2026-02-17T04:42:28.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:28.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 158913789955 2026-02-17T04:42:28.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:29.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:42:29.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:29.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-17T04:42:29.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:29.384 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-171798691842 2026-02-17T04:42:29.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:29.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:42:29.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-171798691842 2026-02-17T04:42:29.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691842 2026-02-17T04:42:29.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 171798691842' 2026-02-17T04:42:29.388 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 171798691842 2026-02-17T04:42:29.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:29.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691843 -lt 171798691842 2026-02-17T04:42:29.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:29.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-188978561026 2026-02-17T04:42:29.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:29.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:42:29.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-188978561026 2026-02-17T04:42:29.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:29.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-17T04:42:29.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 188978561026' 2026-02-17T04:42:29.557 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 188978561026 2026-02-17T04:42:29.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:42:29.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-17T04:42:29.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:42:29.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:29.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:29.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:42:29.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:42:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:42:30.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:42:30.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:42:30.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:30.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:30.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:42:30.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:42:30.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:42:30.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: get_pg ecpool MOBJ0 2026-02-17T04:42:30.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:42:30.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=MOBJ0 2026-02-17T04:42:30.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool MOBJ0 2026-02-17T04:42:30.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:42:30.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: local pg=2.0 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1027: list_missing_erasure_coded: repair 2.0 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:30.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:30.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:30.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:42:30.797 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.2 to repair 2026-02-17T04:42:30.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:30.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:42:30.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:30.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:14.931204+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:30.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:31.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:31.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:31.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:31.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:31.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:31.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:31.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:32.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:14.931204+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:32.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:33.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:33.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:33.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:33.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:33.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:33.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:33.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:33.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:14.931204+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:33.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:34.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:34.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:34.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:34.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:34.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:34.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:34.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:34.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:14.931204+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:34.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:35.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:35.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:35.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:35.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:35.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:35.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:35.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:35.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:14.931204+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:35.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:42:36.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:42:36.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:42:36.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:42:36.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:42:36.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:42:36.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:42:36.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:42:36.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:30.853926+0000 '>' 2026-02-17T04:42:14.931204+0000 2026-02-17T04:42:36.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:42:36.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: seq 0 120 2026-02-17T04:42:36.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: for i in $(seq 0 120) 2026-02-17T04:42:36.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1030: list_missing_erasure_coded: '[' 0 -lt 60 ']' 2026-02-17T04:42:36.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: ceph pg 2.0 list_unfound 2026-02-17T04:42:36.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: egrep 'MOBJ0|MOBJ1' 2026-02-17T04:42:36.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: wc -l 2026-02-17T04:42:36.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: matches=2 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: '[' 2 -eq 2 ']' 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: break 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:42:36.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:42:36.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:36.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:36.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:36.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:36.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:36.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:36.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:42:36.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:42:36.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:42:36.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:42:36.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:42:36.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:42:36.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:36.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:42:36.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:42:36.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:36.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:42:36.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:42:36.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:42:36.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:42:36.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:36.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:36.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:42:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:42:37.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:42:37.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:42:37.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:42:37.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:42:37.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:42:37.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:37.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:42:37.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:42:37.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:42:37.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:42:37.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:42:37.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:42:37.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:42:37.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:42:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:42:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:42:37.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:42:37.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:42:37.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:42:37.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_list_missing_erasure_coded_overwrites td/osd-scrub-repair 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1041: TEST_list_missing_erasure_coded_overwrites: '[' true = true ']' 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1042: TEST_list_missing_erasure_coded_overwrites: list_missing_erasure_coded td/osd-scrub-repair true 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:975: list_missing_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:976: list_missing_erasure_coded: local allow_overwrites=true 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:977: list_missing_erasure_coded: local poolname=ecpool 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:979: list_missing_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:42:37.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:37.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:42:37.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:42:37.061 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:42:37.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:42:37.104 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:42:37.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:42:37.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:980: list_missing_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:42:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:42:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:42:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:42:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:42:37.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:42:37.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:42:37.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:42:37.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:37.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:37.231 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:37.231 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.231 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:37.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:42:37.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:42:37.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:37.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:37.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:37.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:42:37.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:37.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a8f8377e-47fe-4b21-8461-7138faeeb0c3 2026-02-17T04:42:37.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a8f8377e-47fe-4b21-8461-7138faeeb0c3' 2026-02-17T04:42:37.254 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a8f8377e-47fe-4b21-8461-7138faeeb0c3 2026-02-17T04:42:37.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:37.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC98ZNpp95wDxAATBYsiMYHZC0kMkXBdd23NA== 2026-02-17T04:42:37.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC98ZNpp95wDxAATBYsiMYHZC0kMkXBdd23NA=="}' 2026-02-17T04:42:37.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a8f8377e-47fe-4b21-8461-7138faeeb0c3 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:42:37.340 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:37.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:42:37.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC98ZNpp95wDxAATBYsiMYHZC0kMkXBdd23NA== --osd-uuid a8f8377e-47fe-4b21-8461-7138faeeb0c3 2026-02-17T04:42:37.365 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.364+0000 7efee6e69780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.366 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.365+0000 7efee6e69780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.367 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.366+0000 7efee6e69780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.367 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.367+0000 7efee6e69780 -1 bdev(0x38c4c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:37.367 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.367+0000 7efee6e69780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:42:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:42:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:37.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:42:37.832 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:42:37.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:37.915 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:42:37.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:42:37.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:37.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:37.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:37.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:37.929 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.928+0000 7fa93a263780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.931 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.930+0000 7fa93a263780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.931 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:37.931+0000 7fa93a263780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:37.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:37.996 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:37.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:37.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:38.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:38.140 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:38.139+0000 7fa93a263780 -1 Falling back to public interface 2026-02-17T04:42:38.470 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:38.469+0000 7fa93a263780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:42:39.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:39.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:39.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:39.074 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:39.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:39.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:39.155 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3766497383,v1:127.0.0.1:6801/3766497383] [v2:127.0.0.1:6802/3766497383,v1:127.0.0.1:6803/3766497383] exists,up a8f8377e-47fe-4b21-8461-7138faeeb0c3 2026-02-17T04:42:39.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:39.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:42:39.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:39.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=174ab8cf-5609-4790-bb96-95d6d69fe708 2026-02-17T04:42:39.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 174ab8cf-5609-4790-bb96-95d6d69fe708' 2026-02-17T04:42:39.162 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 174ab8cf-5609-4790-bb96-95d6d69fe708 2026-02-17T04:42:39.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:39.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC/8ZNpz30IChAAy6JkXVBxlw4hz9o0KsTTgw== 2026-02-17T04:42:39.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC/8ZNpz30IChAAy6JkXVBxlw4hz9o0KsTTgw=="}' 2026-02-17T04:42:39.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 174ab8cf-5609-4790-bb96-95d6d69fe708 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:42:39.248 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:39.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:42:39.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/8ZNpz30IChAAy6JkXVBxlw4hz9o0KsTTgw== --osd-uuid 174ab8cf-5609-4790-bb96-95d6d69fe708 2026-02-17T04:42:39.272 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.271+0000 7f684e60b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.273 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.273+0000 7f684e60b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.274 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.273+0000 7f684e60b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.275 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.274+0000 7f684e60b780 -1 bdev(0x280cc00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:39.275 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.274+0000 7f684e60b780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:42:39.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:42:39.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:39.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:42:39.597 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:42:39.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:39.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:42:39.808 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:42:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:39.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:39.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:39.822 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.821+0000 7fe05184e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.823 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.823+0000 7fe05184e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.824 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.824+0000 7fe05184e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:39.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:39.974 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:39.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:39.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:39.990 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:39.988+0000 7fe05184e780 -1 Falling back to public interface 2026-02-17T04:42:40.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:40.319 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:40.317+0000 7fe05184e780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:42:41.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:41.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:41.138 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:41.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:41.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:41.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:41.300 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1089112651,v1:127.0.0.1:6811/1089112651] [v2:127.0.0.1:6812/1089112651,v1:127.0.0.1:6813/1089112651] exists,up 174ab8cf-5609-4790-bb96-95d6d69fe708 2026-02-17T04:42:41.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:41.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:42:41.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:42:41.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:42:41.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=85051760-39c4-4bcd-9a4b-1866e93c67d8 2026-02-17T04:42:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 85051760-39c4-4bcd-9a4b-1866e93c67d8' 2026-02-17T04:42:41.310 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 85051760-39c4-4bcd-9a4b-1866e93c67d8 2026-02-17T04:42:41.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:42:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDB8ZNpFAG2EhAA7PAZwWi+YXMa/dcRBJdfEA== 2026-02-17T04:42:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDB8ZNpFAG2EhAA7PAZwWi+YXMa/dcRBJdfEA=="}' 2026-02-17T04:42:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 85051760-39c4-4bcd-9a4b-1866e93c67d8 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:42:41.476 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:42:41.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:42:41.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDB8ZNpFAG2EhAA7PAZwWi+YXMa/dcRBJdfEA== --osd-uuid 85051760-39c4-4bcd-9a4b-1866e93c67d8 2026-02-17T04:42:41.499 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:41.498+0000 7f3a6083a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:41.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:41.500+0000 7f3a6083a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:41.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:41.501+0000 7f3a6083a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:41.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:41.501+0000 7f3a6083a780 -1 bdev(0x3a80c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:42:41.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:41.501+0000 7f3a6083a780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:42:41.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:42:41.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:42:41.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:42:41.825 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:42:41.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:42:42.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:42:42.050 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:42:42.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:42.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:42:42.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:42:42.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:42:42.068 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:42.067+0000 7fc404873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:42.069 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:42.069+0000 7fc404873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:42.070 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:42.070+0000 7fc404873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:42.198 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:42.197+0000 7fc404873780 -1 Falling back to public interface 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:42.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:42.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:42.513 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:42.512+0000 7fc404873780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:42:43.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:43.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:43.385 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:42:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:42:43.553 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1090219839,v1:127.0.0.1:6819/1090219839] [v2:127.0.0.1:6820/1090219839,v1:127.0.0.1:6821/1090219839] exists,up 85051760-39c4-4bcd-9a4b-1866e93c67d8 2026-02-17T04:42:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:984: list_missing_erasure_coded: create_rbd_pool 2026-02-17T04:42:43.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:42:43.712 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:42:43.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:42:43.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:42:43.933 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:42:43.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:42:44.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:42:45.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:985: list_missing_erasure_coded: wait_for_clean 2026-02-17T04:42:45.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:42:45.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:42:45.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:42:45.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:42:45.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:42:45.228 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:42:45.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:42:45.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:42:45.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:42:45.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:42:45.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:42:45.488 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:45.489 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:42:45.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:42:45.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:45.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:42:45.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:42:45.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:42:45.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:42:45.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:45.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:42:45.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:42:45.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:42:45.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:42:45.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:45.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:42:45.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-17T04:42:45.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-17T04:42:45.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542146' 2026-02-17T04:42:45.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:45.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:42:45.669 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:45.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:42:45.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:42:45.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:45.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:42:45.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:42:45.672 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:42:45.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:45.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:42:45.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:46.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:42:46.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:47.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:42:47.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:48.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:42:48.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:48.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:42:48.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:48.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:42:48.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:48.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:42:48.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:42:48.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:48.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:42:48.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:42:48.183 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:42:48.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:48.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-17T04:42:48.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:48.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-17T04:42:48.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:48.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:42:48.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-17T04:42:48.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:48.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-17T04:42:48.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-17T04:42:48.352 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542146 2026-02-17T04:42:48.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:42:48.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-17T04:42:48.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:42:48.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:48.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:48.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:42:48.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:42:48.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:42:48.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:42:48.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:42:48.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:42:48.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:42:48.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:42:48.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:42:48.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:42:48.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:48.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:987: list_missing_erasure_coded: create_ec_pool ecpool true k=2 m=1 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:42:49.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:42:49.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T04:42:49.362 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:42:49.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:42:49.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:42:49.666 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:42:49.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:42:50.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:42:50.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:42:50.890 INFO:tasks.workunit.client.0.trial090.stderr:set pool 2 allow_ec_overwrites to true 2026-02-17T04:42:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:42:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:42:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:42:50.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:42:50.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:42:50.901 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:42:50.901 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:42:50.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:42:50.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:42:50.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:42:50.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:42:51.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:42:51.165 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:51.165 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:42:51.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:42:51.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:51.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:42:51.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:42:51.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:42:51.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:42:51.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:51.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:42:51.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:42:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:42:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T04:42:51.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:42:51.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:42:51.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-17T04:42:51.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-17T04:42:51.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542148' 2026-02-17T04:42:51.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:51.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:42:51.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:51.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:42:51.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:42:51.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:51.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:42:51.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:42:51.346 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:42:51.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:42:51.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:42:51.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:51.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:42:51.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:51.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:42:51.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:42:51.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:51.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:42:51.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:42:51.516 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672964 2026-02-17T04:42:51.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:51.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672964 2026-02-17T04:42:51.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:52.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:42:52.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672964 2026-02-17T04:42:52.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:42:53.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:42:53.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:42:54.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672964 2026-02-17T04:42:54.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:42:54.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-17T04:42:54.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:42:54.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:42:54.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-17T04:42:54.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:42:54.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-17T04:42:54.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-17T04:42:54.020 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542148 2026-02-17T04:42:54.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:42:54.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-17T04:42:54.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:42:54.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:54.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:54.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:42:54.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:42:54.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:42:54.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:42:54.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:42:54.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:42:54.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:42:54.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:42:54.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:42:54.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:42:54.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:42:54.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:42:54.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:42:54.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:990: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ0 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ0 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:42:54.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:42:54.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:42:54.988 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:42:54.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:42:55.192 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:42:55.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:42:55.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:42:55.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ0 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:42:55.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: get_osds ecpool MOBJ0 2026-02-17T04:42:55.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:42:55.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ0 2026-02-17T04:42:55.220 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ0 2026-02-17T04:42:55.220 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: osds0=('2' '1' '0') 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: local -a osds0 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:994: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ1 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ1 2026-02-17T04:42:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:42:55.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:42:55.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:42:55.607 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:42:55.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:42:55.812 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:42:55.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:42:55.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:42:55.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:42:55.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: get_osds ecpool MOBJ1 2026-02-17T04:42:55.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:42:55.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ1 2026-02-17T04:42:55.841 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:42:55.841 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ1 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr:0' 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: osds1=('2' '1' '0') 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: local -a osds1 2026-02-17T04:42:56.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:56.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:56.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:42:56.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:56.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:56.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:56.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:56.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:56.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:56.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:56.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:42:56.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:56.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:56.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:56.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:56.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:42:56.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:42:56.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:42:56.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1002: list_missing_erasure_coded: id=2 2026-02-17T04:42:56.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1003: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 MOBJ0 remove 2026-02-17T04:42:57.041 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#2:a9030505:::MOBJ0:head# 2026-02-17T04:42:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1005: list_missing_erasure_coded: id=1 2026-02-17T04:42:57.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1006: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ0 remove 2026-02-17T04:42:57.184 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:a9030505:::MOBJ0:head# 2026-02-17T04:42:57.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1009: list_missing_erasure_coded: id=1 2026-02-17T04:42:57.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1010: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ1 remove 2026-02-17T04:42:57.315 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#2:8dd16d55:::MOBJ1:head# 2026-02-17T04:42:57.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1012: list_missing_erasure_coded: id=0 2026-02-17T04:42:57.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1013: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 MOBJ1 remove 2026-02-17T04:42:57.453 INFO:tasks.workunit.client.0.trial090.stdout:remove 2#2:8dd16d55:::MOBJ1:head# 2026-02-17T04:42:57.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: seq 0 2 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 0 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:42:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:57.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:42:57.493 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:42:57.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:57.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:42:57.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:42:57.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:42:57.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:42:57.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:42:57.508 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:57.507+0000 7feb99040780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:57.510 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:57.509+0000 7feb99040780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:57.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:57.510+0000 7feb99040780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:57.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:42:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:57.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:57.679 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:57.678+0000 7feb99040780 -1 Falling back to public interface 2026-02-17T04:42:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:57.954 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:57.953+0000 7feb99040780 -1 osd.0 31 log_to_monitors true 2026-02-17T04:42:58.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:42:58.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:58.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:42:58.824 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:42:58.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:58.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:42:58.991 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 38 up_thru 38 down_at 32 last_clean_interval [5,31) [v2:127.0.0.1:6800/2860744214,v1:127.0.0.1:6801/2860744214] [v2:127.0.0.1:6802/2860744214,v1:127.0.0.1:6803/2860744214] exists,up a8f8377e-47fe-4b21-8461-7138faeeb0c3 2026-02-17T04:42:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:42:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:42:58.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 1 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:42:58.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:42:58.994 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T04:42:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:42:58.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:42:58.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:42:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:42:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:42:58.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:42:59.004 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:59.003+0000 7f69d5662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:59.006 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:59.005+0000 7f69d5662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:59.007 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:59.006+0000 7f69d5662780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:42:59.151 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:59.150+0000 7f69d5662780 -1 Falling back to public interface 2026-02-17T04:42:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:42:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:42:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:42:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:42:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:42:59.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:42:59.426 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:42:59.424+0000 7f69d5662780 -1 osd.1 33 log_to_monitors true 2026-02-17T04:43:00.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:00.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:00.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:00.327 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:43:00.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:00.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 41 up_thru 41 down_at 34 last_clean_interval [10,33) [v2:127.0.0.1:6810/407730861,v1:127.0.0.1:6811/407730861] [v2:127.0.0.1:6812/407730861,v1:127.0.0.1:6813/407730861] exists,up 174ab8cf-5609-4790-bb96-95d6d69fe708 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-17T04:43:00.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 2 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:00.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:00.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:43:00.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:43:00.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:43:00.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:43:00.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:43:00.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:43:00.511 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:00.509+0000 7f21c422d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:00.512 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:00.510+0000 7f21c422d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:00.513 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:00.511+0000 7f21c422d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:00.650 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:00.649+0000 7f21c422d780 -1 Falling back to public interface 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:43:00.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:00.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:43:00.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:00.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:00.968+0000 7f21c422d780 -1 osd.2 35 log_to_monitors true 2026-02-17T04:43:01.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:01.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:01.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:01.830 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:43:01.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:01.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 46 up_thru 46 down_at 36 last_clean_interval [14,35) [v2:127.0.0.1:6818/2649186070,v1:127.0.0.1:6819/2649186070] [v2:127.0.0.1:6820/2649186070,v1:127.0.0.1:6821/2649186070] exists,up 85051760-39c4-4bcd-9a4b-1866e93c67d8 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1019: list_missing_erasure_coded: create_rbd_pool 2026-02-17T04:43:01.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:43:02.182 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' removed 2026-02-17T04:43:02.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:43:02.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:43:02.385 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:43:02.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:43:03.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:43:03.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1020: list_missing_erasure_coded: wait_for_clean 2026-02-17T04:43:03.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:43:03.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:43:03.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:43:03.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:43:03.635 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:43:03.635 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:43:03.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:43:03.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:43:03.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:03.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:03.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:03.893 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:43:03.894 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:43:03.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:03.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:03.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:03.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T04:43:03.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T04:43:03.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251' 2026-02-17T04:43:03.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:03.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:04.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659138 2026-02-17T04:43:04.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659138 2026-02-17T04:43:04.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251 1-176093659138' 2026-02-17T04:43:04.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:04.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:43:04.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495618 2026-02-17T04:43:04.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495618 2026-02-17T04:43:04.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251 1-176093659138 2-197568495618' 2026-02-17T04:43:04.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:04.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-163208757251 2026-02-17T04:43:04.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:04.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:04.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757251 2026-02-17T04:43:04.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T04:43:04.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 163208757251' 2026-02-17T04:43:04.076 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 163208757251 2026-02-17T04:43:04.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:04.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757251 2026-02-17T04:43:04.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:05.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:05.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:05.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T04:43:05.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:05.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-176093659138 2026-02-17T04:43:05.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:05.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:05.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-176093659138 2026-02-17T04:43:05.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:05.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659138 2026-02-17T04:43:05.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 176093659138' 2026-02-17T04:43:05.416 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 176093659138 2026-02-17T04:43:05.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:05.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659139 -lt 176093659138 2026-02-17T04:43:05.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:05.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-197568495618 2026-02-17T04:43:05.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:05.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:43:05.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-197568495618 2026-02-17T04:43:05.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:05.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495618 2026-02-17T04:43:05.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 197568495618' 2026-02-17T04:43:05.587 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 197568495618 2026-02-17T04:43:05.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:43:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495618 -lt 197568495618 2026-02-17T04:43:05.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:43:05.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:05.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:05.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:43:05.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:43:05.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:43:05.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:43:05.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:43:05.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:43:05.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:43:05.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:43:06.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:43:06.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:43:06.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:06.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:06.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: get_pg ecpool MOBJ0 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=MOBJ0 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool MOBJ0 2026-02-17T04:43:06.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:43:06.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: local pg=2.0 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1027: list_missing_erasure_coded: repair 2.0 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:06.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:06.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:06.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-17T04:43:06.834 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 2.0s0 on osd.2 to repair 2026-02-17T04:43:06.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:06.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-17T04:43:06.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:06.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:06.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:06.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:07.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:49.664109+0000 '>' 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:07.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:08.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:08.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:08.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:43:08.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:08.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:08.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:08.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:08.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:49.664109+0000 '>' 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:08.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:09.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:43:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:09.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:49.664109+0000 '>' 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:09.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:10.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:10.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:10.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:43:10.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:10.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:10.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:10.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:10.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:42:49.664109+0000 '>' 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:10.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:11.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:11.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:11.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-17T04:43:11.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-17T04:43:11.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:11.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:11.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-17T04:43:11.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:06.865698+0000 '>' 2026-02-17T04:42:49.664109+0000 2026-02-17T04:43:11.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:43:11.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: seq 0 120 2026-02-17T04:43:11.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: for i in $(seq 0 120) 2026-02-17T04:43:11.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1030: list_missing_erasure_coded: '[' 0 -lt 60 ']' 2026-02-17T04:43:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: ceph pg 2.0 list_unfound 2026-02-17T04:43:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: egrep 'MOBJ0|MOBJ1' 2026-02-17T04:43:11.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: wc -l 2026-02-17T04:43:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: matches=2 2026-02-17T04:43:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: '[' 2 -eq 2 ']' 2026-02-17T04:43:11.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: break 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:11.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:11.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:11.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:11.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:11.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:11.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:11.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:11.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:11.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:11.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:11.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:11.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:11.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:11.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:11.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:11.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:11.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:11.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:11.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:11.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:11.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:11.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:11.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:11.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:11.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:11.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:11.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:11.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:11.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:11.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:11.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:11.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:11.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:11.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:11.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:43:11.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:43:11.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:43:11.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:43:11.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:43:11.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_periodic_scrub_replicated td/osd-scrub-repair 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5926: TEST_periodic_scrub_replicated: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5927: TEST_periodic_scrub_replicated: local poolname=psr_pool 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5928: TEST_periodic_scrub_replicated: local objname=POBJ 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5929: TEST_periodic_scrub_replicated: return 0 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:11.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:11.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:11.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:11.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:11.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:11.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:11.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:11.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:11.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:11.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:11.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:11.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:11.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:11.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:11.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:11.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:11.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:11.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:11.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:11.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:11.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:11.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:11.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:11.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:11.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:11.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:11.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:11.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:11.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:11.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:11.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:11.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:11.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:11.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:11.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:11.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:11.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:11.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:11.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:43:11.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:43:11.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:43:11.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_repair_stats td/osd-scrub-repair 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:713: TEST_repair_stats: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:714: TEST_repair_stats: local poolname=testpool 2026-02-17T04:43:11.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:715: TEST_repair_stats: local OSDS=2 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:716: TEST_repair_stats: local OBJS=30 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:718: TEST_repair_stats: local REPAIRS=20 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:721: TEST_repair_stats: run_mon td/osd-scrub-repair a 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:43:11.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:43:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:43:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:11.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:11.933 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:11.933 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.933 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:11.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:43:11.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:43:11.957 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:43:11.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:43:11.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:43:12.003 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:43:12.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:722: TEST_repair_stats: run_mgr td/osd-scrub-repair x 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:43:12.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:43:12.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:12.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:12.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:43:12.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:43:12.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:724: TEST_repair_stats: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:12.150 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: expr 2 - 1 2026-02-17T04:43:12.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: seq 0 1 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:726: TEST_repair_stats: run_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:43:12.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:12.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:43:12.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a117f9e0-c167-4cbd-8d8c-21f06f20a79b 2026-02-17T04:43:12.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a117f9e0-c167-4cbd-8d8c-21f06f20a79b' 2026-02-17T04:43:12.161 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a117f9e0-c167-4cbd-8d8c-21f06f20a79b 2026-02-17T04:43:12.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:43:12.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDg8ZNpxSvNCRAAI5Yxs5e5pvvddrdKaznELg== 2026-02-17T04:43:12.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDg8ZNpxSvNCRAAI5Yxs5e5pvvddrdKaznELg=="}' 2026-02-17T04:43:12.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a117f9e0-c167-4cbd-8d8c-21f06f20a79b -i td/osd-scrub-repair/0/new.json 2026-02-17T04:43:12.245 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:12.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:43:12.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDg8ZNpxSvNCRAAI5Yxs5e5pvvddrdKaznELg== --osd-uuid a117f9e0-c167-4cbd-8d8c-21f06f20a79b 2026-02-17T04:43:12.270 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.268+0000 7fb27ea5b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.271 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.269+0000 7fb27ea5b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.272 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.270+0000 7fb27ea5b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.272 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.270+0000 7fb27ea5b780 -1 bdev(0x2f00c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:43:12.272 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.271+0000 7fb27ea5b780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:43:12.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:43:12.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:43:12.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:43:12.714 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:43:12.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:43:12.797 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:43:12.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:43:12.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:12.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:43:12.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:43:12.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:43:12.814 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.812+0000 7f5d94c32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.815 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.813+0000 7f5d94c32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.816 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:12.814+0000 7f5d94c32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:12.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:12.880 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:12.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:12.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:12.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:13.005 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:13.004+0000 7f5d94c32780 -1 Falling back to public interface 2026-02-17T04:43:13.396 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:13.394+0000 7f5d94c32780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:43:13.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:13.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:13.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:13.961 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:13.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:13.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:14.039 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3100695362,v1:127.0.0.1:6801/3100695362] [v2:127.0.0.1:6802/3100695362,v1:127.0.0.1:6803/3100695362] exists,up a117f9e0-c167-4cbd-8d8c-21f06f20a79b 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:726: TEST_repair_stats: run_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:14.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:14.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:43:14.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:43:14.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d5e7dd8d-6228-404c-88d8-cb4a7357caf8 2026-02-17T04:43:14.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d5e7dd8d-6228-404c-88d8-cb4a7357caf8' 2026-02-17T04:43:14.043 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 d5e7dd8d-6228-404c-88d8-cb4a7357caf8 2026-02-17T04:43:14.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:43:14.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDi8ZNpGPwkAxAAUjJ4X34hfb/62Kdcq9rHpQ== 2026-02-17T04:43:14.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDi8ZNpGPwkAxAAUjJ4X34hfb/62Kdcq9rHpQ=="}' 2026-02-17T04:43:14.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d5e7dd8d-6228-404c-88d8-cb4a7357caf8 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:43:14.135 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:14.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:43:14.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDi8ZNpGPwkAxAAUjJ4X34hfb/62Kdcq9rHpQ== --osd-uuid d5e7dd8d-6228-404c-88d8-cb4a7357caf8 2026-02-17T04:43:14.161 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.159+0000 7fa058008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.162 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.160+0000 7fa058008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.161+0000 7fa058008780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.162+0000 7fa058008780 -1 bdev(0x3b9ac00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:43:14.163 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.162+0000 7fa058008780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:43:14.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:43:14.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:43:14.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:43:14.496 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:43:14.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:43:14.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:43:14.711 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:43:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:43:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:43:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:43:14.727 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.725+0000 7fca9060c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.728 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.726+0000 7fca9060c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.729 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.727+0000 7fca9060c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:14.859 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:14.857+0000 7fca9060c780 -1 Falling back to public interface 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:14.878 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:14.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:14.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:15.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:15.148 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:15.145+0000 7fca9060c780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:16.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:16.211 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1646004439,v1:127.0.0.1:6811/1646004439] [v2:127.0.0.1:6812/1646004439,v1:127.0.0.1:6813/1646004439] exists,up d5e7dd8d-6228-404c-88d8-cb4a7357caf8 2026-02-17T04:43:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:729: TEST_repair_stats: create_pool testpool 1 1 2026-02-17T04:43:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-17T04:43:16.404 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:43:16.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:43:17.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:730: TEST_repair_stats: ceph osd pool set testpool size 2 2026-02-17T04:43:17.627 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 size to 2 2026-02-17T04:43:17.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:731: TEST_repair_stats: wait_for_clean 2026-02-17T04:43:17.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:43:17.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:43:17.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:43:17.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:43:17.638 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:43:17.638 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:43:17.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:43:17.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:43:17.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:43:17.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:43:17.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:43:17.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:43:17.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:43:17.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:17.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:17.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:17.899 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:43:17.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:17.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:17.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:17.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:43:17.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:43:17.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:43:17.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:17.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:43:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:43:18.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-17T04:43:18.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:18.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:43:18.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:18.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:18.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:43:18.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:18.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:43:18.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:43:18.020 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:43:18.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:18.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:43:18.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:19.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:19.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:19.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:43:19.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:19.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:43:19.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:19.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:19.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:43:19.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:19.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:43:19.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:43:19.367 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:43:19.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:19.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-17T04:43:19.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:43:19.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:19.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:19.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:43:19.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:43:19.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:43:19.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:43:19.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:19.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:20.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:43:20.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:43:20.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:43:20.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:734: TEST_repair_stats: local payload=ABCDEF 2026-02-17T04:43:20.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:735: TEST_repair_stats: echo ABCDEF 2026-02-17T04:43:20.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: seq 1 30 2026-02-17T04:43:20.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj11 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj12 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj13 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj14 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj15 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj16 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj17 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj18 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj19 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj20 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj21 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj22 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj23 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj24 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj25 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj26 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj27 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj28 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj29 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-17T04:43:20.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj30 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:20.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:743: TEST_repair_stats: get_not_primary testpool obj1 2026-02-17T04:43:20.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:43:20.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T04:43:20.612 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-17T04:43:20.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:43:20.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:43:20.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:20.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:43:20.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:43:20.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:20.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:43:20.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:743: TEST_repair_stats: local other=0 2026-02-17T04:43:20.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:744: TEST_repair_stats: get_pg testpool obj1 2026-02-17T04:43:20.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:43:20.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-17T04:43:20.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-17T04:43:20.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:43:21.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:744: TEST_repair_stats: local pgid=1.0 2026-02-17T04:43:21.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:745: TEST_repair_stats: get_primary testpool obj1 2026-02-17T04:43:21.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:43:21.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:43:21.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:21.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:43:21.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:745: TEST_repair_stats: local primary=1 2026-02-17T04:43:21.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:747: TEST_repair_stats: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:43:21.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:21.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:21.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:21.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:21.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:748: TEST_repair_stats: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:43:21.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:21.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:21.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:21.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: seq 1 20 2026-02-17T04:43:21.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:21.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 1 % 2 2026-02-17T04:43:21.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:21.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 remove 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:21.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 remove 2026-02-17T04:43:21.810 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:43:21.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:21.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 2 % 2 2026-02-17T04:43:21.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:21.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:21.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-17T04:43:21.958 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:104778fc:::obj2:head# 2026-02-17T04:43:22.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 3 % 2 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj3 remove 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:22.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:22.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj3 remove 2026-02-17T04:43:22.104 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:8dd16f86:::obj3:head# 2026-02-17T04:43:22.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 4 % 2 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj4 remove 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:22.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj4 remove 2026-02-17T04:43:22.233 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:0ee9ae15:::obj4:head# 2026-02-17T04:43:22.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 5 % 2 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj5 remove 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:22.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj5 remove 2026-02-17T04:43:22.365 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:head# 2026-02-17T04:43:22.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 6 % 2 2026-02-17T04:43:22.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj6 remove 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj6 remove 2026-02-17T04:43:22.496 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:233a42c1:::obj6:head# 2026-02-17T04:43:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 7 % 2 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj7 remove 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:22.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:22.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj7 remove 2026-02-17T04:43:22.628 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:9a09113a:::obj7:head# 2026-02-17T04:43:22.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 8 % 2 2026-02-17T04:43:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj8 remove 2026-02-17T04:43:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:22.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj8 remove 2026-02-17T04:43:22.753 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:a557efb1:::obj8:head# 2026-02-17T04:43:22.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 9 % 2 2026-02-17T04:43:22.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj9 remove 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:22.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj9 remove 2026-02-17T04:43:22.884 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:fe351e27:::obj9:head# 2026-02-17T04:43:22.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:22.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 10 % 2 2026-02-17T04:43:22.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj10 remove 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj10 remove 2026-02-17T04:43:23.012 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:d1337354:::obj10:head# 2026-02-17T04:43:23.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 11 % 2 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj11 remove 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj11 remove 2026-02-17T04:43:23.130 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:eeae2a94:::obj11:head# 2026-02-17T04:43:23.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 12 % 2 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj12 remove 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:23.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj12 remove 2026-02-17T04:43:23.260 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:af5f95cb:::obj12:head# 2026-02-17T04:43:23.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 13 % 2 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj13 remove 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:23.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:23.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj13 remove 2026-02-17T04:43:23.387 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:a61ad63e:::obj13:head# 2026-02-17T04:43:23.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 14 % 2 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj14 remove 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:23.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj14 remove 2026-02-17T04:43:23.513 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:e0a44829:::obj14:head# 2026-02-17T04:43:23.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 15 % 2 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj15 remove 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:23.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj15 remove 2026-02-17T04:43:23.633 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ab946124:::obj15:head# 2026-02-17T04:43:23.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 16 % 2 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj16 remove 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj16 remove 2026-02-17T04:43:23.762 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:461f8b5e:::obj16:head# 2026-02-17T04:43:23.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 17 % 2 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj17 remove 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:23.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj17 remove 2026-02-17T04:43:23.900 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:24fc6e92:::obj17:head# 2026-02-17T04:43:23.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:23.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 18 % 2 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj18 remove 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:23.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj18 remove 2026-02-17T04:43:24.034 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:b9836a99:::obj18:head# 2026-02-17T04:43:24.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:24.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 19 % 2 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj19 remove 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:24.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj19 remove 2026-02-17T04:43:24.173 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:00b31b6c:::obj19:head# 2026-02-17T04:43:24.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:24.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 20 % 2 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj20 remove 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj20 remove 2026-02-17T04:43:24.307 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:24b5611b:::obj20:head# 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:755: TEST_repair_stats: activate_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:24.354 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:43:24.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:24.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:43:24.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:43:24.356 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:43:24.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:43:24.367 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:24.365+0000 7fb56d645780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:24.368 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:24.367+0000 7fb56d645780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:24.369 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:24.367+0000 7fb56d645780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:24.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:24.500+0000 7fb56d645780 -1 Falling back to public interface 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:24.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:24.520 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:24.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:24.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:24.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:24.840 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:24.838+0000 7fb56d645780 -1 osd.1 17 log_to_monitors true 2026-02-17T04:43:25.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:25.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:25.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:25.688 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:25.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:25.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:25.852 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 20 up_thru 20 down_at 18 last_clean_interval [10,17) [v2:127.0.0.1:6800/1446347850,v1:127.0.0.1:6801/1446347850] [v2:127.0.0.1:6802/1446347850,v1:127.0.0.1:6803/1446347850] exists,up d5e7dd8d-6228-404c-88d8-cb4a7357caf8 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:756: TEST_repair_stats: activate_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:43:25.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:25.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:25.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:43:25.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:43:25.861 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:43:25.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:43:25.871 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:25.868+0000 7ffbc5a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:25.872 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:25.870+0000 7ffbc5a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:25.872 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:25.871+0000 7ffbc5a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:26.015 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:26.013+0000 7ffbc5a43780 -1 Falling back to public interface 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:26.026 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:26.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:26.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:26.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:26.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:26.308 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:26.306+0000 7ffbc5a43780 -1 osd.0 15 log_to_monitors true 2026-02-17T04:43:27.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:27.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:27.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:27.195 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:27.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:27.364 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 16 last_clean_interval [5,15) [v2:127.0.0.1:6810/1157396024,v1:127.0.0.1:6811/1157396024] [v2:127.0.0.1:6812/1157396024,v1:127.0.0.1:6813/1157396024] exists,up a117f9e0-c167-4cbd-8d8c-21f06f20a79b 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:757: TEST_repair_stats: wait_for_clean 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:43:27.366 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:43:27.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:43:27.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:43:27.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:43:27.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:43:27.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:43:27.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:43:27.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:43:27.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:27.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:27.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:27.627 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:43:27.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:27.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:27.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:27.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:43:27.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:43:27.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-17T04:43:27.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:27.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:27.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345922 2026-02-17T04:43:27.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345922 2026-02-17T04:43:27.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-85899345922' 2026-02-17T04:43:27.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:27.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-17T04:43:27.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:27.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:27.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-17T04:43:27.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:27.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:43:27.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-17T04:43:27.752 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215106 2026-02-17T04:43:27.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 103079215106 2026-02-17T04:43:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:28.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:28.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:29.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:43:29.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:29.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345922 2026-02-17T04:43:29.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:29.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:29.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345922 2026-02-17T04:43:29.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:29.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345922 2026-02-17T04:43:29.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345922' 2026-02-17T04:43:29.089 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 85899345922 2026-02-17T04:43:29.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:29.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345922 -lt 85899345922 2026-02-17T04:43:29.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:43:29.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:29.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:29.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:43:29.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:43:29.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:43:29.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:43:29.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:29.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:759: TEST_repair_stats: repair 1.0 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T04:43:29.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T04:43:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:30.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:30.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T04:43:30.171 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:43:30.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:30.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:30.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:30.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:30.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:30.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:30.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:16.401867+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:30.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:31.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:31.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:31.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:31.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:31.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:31.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:31.345 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:31.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:16.401867+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:31.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:32.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:32.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:32.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:32.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:32.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:32.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:32.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:32.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:16.401867+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:32.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:33.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:33.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:33.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:33.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:33.685 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:33.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:33.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:33.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:16.401867+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:33.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:34.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:34.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:34.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:34.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:34.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:34.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:34.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:35.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:16.401867+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:35.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:43:36.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:43:36.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:43:36.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:43:36.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:43:36.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:43:36.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:43:36.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:43:36.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:30.802711+0000 '>' 2026-02-17T04:43:16.401867+0000 2026-02-17T04:43:36.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:43:36.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:760: TEST_repair_stats: wait_for_clean 2026-02-17T04:43:36.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:43:36.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:43:36.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:43:36.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:43:36.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:43:36.192 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:43:36.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:43:36.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:43:36.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:43:36.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:43:36.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:43:36.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:43:36.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:43:36.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:36.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:36.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:36.458 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:43:36.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:36.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:36.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:36.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-17T04:43:36.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-17T04:43:36.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109' 2026-02-17T04:43:36.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:36.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:36.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345925 2026-02-17T04:43:36.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345925 2026-02-17T04:43:36.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109 1-85899345925' 2026-02-17T04:43:36.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:36.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215109 2026-02-17T04:43:36.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:36.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:36.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215109 2026-02-17T04:43:36.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:36.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215109 2026-02-17T04:43:36.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215109' 2026-02-17T04:43:36.582 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215109 2026-02-17T04:43:36.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:36.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215109 2026-02-17T04:43:36.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:37.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:37.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:37.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215109 2026-02-17T04:43:37.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:38.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:43:38.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:39.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-17T04:43:39.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345925 2026-02-17T04:43:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:39.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:39.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345925 2026-02-17T04:43:39.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:39.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345925 2026-02-17T04:43:39.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345925' 2026-02-17T04:43:39.096 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 85899345925 2026-02-17T04:43:39.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:39.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345925 -lt 85899345925 2026-02-17T04:43:39.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:43:39.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:39.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:43:39.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:43:39.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:43:39.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:43:39.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:43:39.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:39.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:43:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:43:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:43:39.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:761: TEST_repair_stats: ceph pg dump pgs 2026-02-17T04:43:40.023 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:43:40.023 INFO:tasks.workunit.client.0.trial090.stdout:1.0 30 0 0 0 0 210 0 0 30 0 30 active+clean 2026-02-17T04:43:30.813468+0000 15'30 25:132 [1,0] 1 [1,0] 1 15'30 2026-02-17T04:43:30.802711+0000 15'30 2026-02-17T04:43:30.802711+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:43:30.802711+0000 20 0 2026-02-17T04:43:40.023 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:43:40.024 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:43:40.024 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:43:40.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:762: TEST_repair_stats: flush_pg_stats 2026-02-17T04:43:40.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:40.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:40.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:40.196 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:43:40.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:40.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:40.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-17T04:43:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-17T04:43:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110' 2026-02-17T04:43:40.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:40.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345927 2026-02-17T04:43:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345927 2026-02-17T04:43:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-85899345927' 2026-02-17T04:43:40.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:40.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215110 2026-02-17T04:43:40.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:40.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:40.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215110 2026-02-17T04:43:40.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:40.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215110 2026-02-17T04:43:40.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215110' 2026-02-17T04:43:40.319 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215110 2026-02-17T04:43:40.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:40.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215110 2026-02-17T04:43:40.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:41.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:41.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:41.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215110 2026-02-17T04:43:41.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:42.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:43:42.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:42.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215111 -lt 103079215110 2026-02-17T04:43:42.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:42.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345927 2026-02-17T04:43:42.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:42.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:42.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345927 2026-02-17T04:43:42.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:42.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345927 2026-02-17T04:43:42.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345927' 2026-02-17T04:43:42.825 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 85899345927 2026-02-17T04:43:42.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:42.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345927 -lt 85899345927 2026-02-17T04:43:42.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:765: TEST_repair_stats: ceph pg 1.0 query 2026-02-17T04:43:42.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:765: TEST_repair_stats: jq .info.stats.stat_sum 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes": 210, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects": 30, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_object_clones": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_object_copies": 60, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_missing": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_degraded": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_misplaced": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_unfound": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_dirty": 30, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_whiteouts": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_read": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_read_kb": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_write": 30, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_write_kb": 30, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_scrub_errors": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_deep_scrub_errors": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_recovered": 20, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes_recovered": 140, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_keys_recovered": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_omap": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_kb": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_kb": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_promote": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_mode_high": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_mode_low": 0, 2026-02-17T04:43:43.052 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_mode_some": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_mode_full": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_pinned": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_legacy_snapsets": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_large_omap_objects": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_manifest": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_omap_bytes": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_omap_keys": 0, 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_repaired": 20 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: ceph pg 1.0 query 2026-02-17T04:43:43.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: jq .info.stats.stat_sum.num_objects_repaired 2026-02-17T04:43:43.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: COUNT=20 2026-02-17T04:43:43.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:767: TEST_repair_stats: test 20 = 20 2026-02-17T04:43:43.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:769: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:769: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 1 )' 2026-02-17T04:43:43.265 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 20, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 85899345927, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 1, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 1, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 1, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 104857600, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 28568, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 328, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 8, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 28215, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 104829032, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "total": 107374182400, 2026-02-17T04:43:43.273 INFO:tasks.workunit.client.0.trial090.stdout: "available": 107344928768, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 335872, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 56228, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 8307, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 28893069 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [ 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: 0 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 10, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:43:43.274 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:43:43.275 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.275 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [] 2026-02-17T04:43:43.275 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:43:43.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 1 ).num_shards_repaired' 2026-02-17T04:43:43.428 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:43.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: COUNT=10 2026-02-17T04:43:43.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:771: TEST_repair_stats: expr 20 / 2 2026-02-17T04:43:43.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:771: TEST_repair_stats: test 10 = 10 2026-02-17T04:43:43.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:773: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:773: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 0 )' 2026-02-17T04:43:43.591 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 24, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 103079215111, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 1, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 1, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 1, 2026-02-17T04:43:43.599 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 104857600, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 28568, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 328, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 5, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 28218, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 104829032, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "total": 107374182400, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "available": 107344928768, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:43:43.600 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 335872, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 56228, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 5702, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 28895674 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [ 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:43:43.601 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 10, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:43:43.602 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:43:43.603 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.603 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [] 2026-02-17T04:43:43.603 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:43:43.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 0 ).num_shards_repaired' 2026-02-17T04:43:43.754 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:43.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: COUNT=10 2026-02-17T04:43:43.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:775: TEST_repair_stats: expr 20 / 2 2026-02-17T04:43:43.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:775: TEST_repair_stats: test 10 = 10 2026-02-17T04:43:43.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:777: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:777: TEST_repair_stats: jq .pg_map.osd_stats_sum 2026-02-17T04:43:43.917 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:43.924 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:43:43.924 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 0, 2026-02-17T04:43:43.924 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 2, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 2, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 2, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 2, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 209715200, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 57136, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 656, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 13, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 56434, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 209658064, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "total": 214748364800, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "available": 214689857536, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 671744, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 112456, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 14009, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 57788743 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [], 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 20, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [], 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout: "network_ping_times": [] 2026-02-17T04:43:43.925 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:43:43.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-17T04:43:43.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: jq .pg_map.osd_stats_sum.num_shards_repaired 2026-02-17T04:43:44.089 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: COUNT=20 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:779: TEST_repair_stats: test 20 = 20 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:44.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:44.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:44.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:44.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:44.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:44.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:44.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:44.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:44.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:44.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:44.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:44.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:44.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:44.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:44.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:44.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:44.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:44.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:44.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:44.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:44.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:44.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:43:44.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:44.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:44.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:43:44.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:43:44.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:43:44.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:43:44.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:43:44.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:43:44.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:44.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:43:44.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:43:44.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:43:44.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:43:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:43:44.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:43:44.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:43:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:43:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:43:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:43:44.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:43:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:43:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:43:44.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:43:44.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:43:44.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_repair_stats_ec td/osd-scrub-repair 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:783: TEST_repair_stats_ec: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:784: TEST_repair_stats_ec: local poolname=testpool 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:785: TEST_repair_stats_ec: local OSDS=3 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:786: TEST_repair_stats_ec: local OBJS=30 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:788: TEST_repair_stats_ec: local REPAIRS=26 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:789: TEST_repair_stats_ec: local allow_overwrites=false 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:792: TEST_repair_stats_ec: run_mon td/osd-scrub-repair a 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:43:44.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:43:44.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:43:44.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:43:44.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:44.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:43:44.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:43:44.284 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:43:44.285 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:43:44.285 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:43:44.286 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.286 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.286 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:43:44.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:43:44.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:43:44.329 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:43:44.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:43:44.330 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:43:44.331 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.331 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.331 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:43:44.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:43:44.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:793: TEST_repair_stats_ec: run_mgr td/osd-scrub-repair x 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:43:44.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:44.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:43:44.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:43:44.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:795: TEST_repair_stats_ec: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:44.472 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: expr 3 - 1 2026-02-17T04:43:44.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: seq 0 2 2026-02-17T04:43:44.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:43:44.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:44.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:44.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:44.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8255690b-19ec-4b5a-929f-d30f74f9a601 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8255690b-19ec-4b5a-929f-d30f74f9a601' 2026-02-17T04:43:44.481 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 8255690b-19ec-4b5a-929f-d30f74f9a601 2026-02-17T04:43:44.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:43:44.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAA8pNpU0L2HBAA87zJJm6GRIkxmxEozAKnZA== 2026-02-17T04:43:44.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAA8pNpU0L2HBAA87zJJm6GRIkxmxEozAKnZA=="}' 2026-02-17T04:43:44.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8255690b-19ec-4b5a-929f-d30f74f9a601 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:43:44.567 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:44.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:43:44.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAA8pNpU0L2HBAA87zJJm6GRIkxmxEozAKnZA== --osd-uuid 8255690b-19ec-4b5a-929f-d30f74f9a601 2026-02-17T04:43:44.592 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:44.590+0000 7fc71f1d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:44.593 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:44.591+0000 7fc71f1d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:44.594 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:44.592+0000 7fc71f1d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:44.594 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:44.592+0000 7fc71f1d6780 -1 bdev(0x3452c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:43:44.594 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:44.592+0000 7fc71f1d6780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:43:45.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:43:45.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:43:45.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:43:45.006 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:43:45.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:43:45.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:43:45.089 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:43:45.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:45.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:43:45.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:43:45.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:43:45.106 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:45.105+0000 7fd606e2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:45.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:45.106+0000 7fd606e2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:45.108 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:45.106+0000 7fd606e2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:45.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:45.166 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:45.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:45.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:45.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:45.334 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:45.332+0000 7fd606e2d780 -1 Falling back to public interface 2026-02-17T04:43:45.643 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:45.641+0000 7fd606e2d780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:43:46.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:46.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:46.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:46.246 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:46.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:46.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:43:46.323 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1994564176,v1:127.0.0.1:6801/1994564176] [v2:127.0.0.1:6802/1994564176,v1:127.0.0.1:6803/1994564176] exists,up 8255690b-19ec-4b5a-929f-d30f74f9a601 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:43:46.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:46.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:46.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:46.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:46.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:43:46.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=98e8c587-7df0-48b3-9f75-9244cabaf28c 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 98e8c587-7df0-48b3-9f75-9244cabaf28c' 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 98e8c587-7df0-48b3-9f75-9244cabaf28c 2026-02-17T04:43:46.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:43:46.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAC8pNpmPARFBAAYrJNtW62DqucXoj8qhsDeg== 2026-02-17T04:43:46.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAC8pNpmPARFBAAYrJNtW62DqucXoj8qhsDeg=="}' 2026-02-17T04:43:46.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 98e8c587-7df0-48b3-9f75-9244cabaf28c -i td/osd-scrub-repair/1/new.json 2026-02-17T04:43:46.419 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:46.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:43:46.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAC8pNpmPARFBAAYrJNtW62DqucXoj8qhsDeg== --osd-uuid 98e8c587-7df0-48b3-9f75-9244cabaf28c 2026-02-17T04:43:46.443 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:46.442+0000 7f4af002e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:46.444 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:46.444+0000 7f4af002e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:46.445 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:46.445+0000 7f4af002e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:46.446 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:46.445+0000 7f4af002e780 -1 bdev(0x2660c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:43:46.446 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:46.445+0000 7f4af002e780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:43:46.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:43:46.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:43:46.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:43:46.793 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:43:46.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:43:47.003 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:43:47.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:43:47.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:47.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:43:47.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:43:47.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:43:47.018 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:47.017+0000 7fbc98a31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:47.019 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:47.019+0000 7fbc98a31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:47.020 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:47.020+0000 7fbc98a31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:47.152 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:47.150+0000 7fbc98a31780 -1 Falling back to public interface 2026-02-17T04:43:47.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:43:47.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:47.169 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:47.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:47.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:47.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:47.428 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:47.427+0000 7fbc98a31780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:43:48.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:48.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:48.336 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:48.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:48.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:48.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:43:48.502 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1808552388,v1:127.0.0.1:6811/1808552388] [v2:127.0.0.1:6812/1808552388,v1:127.0.0.1:6813/1808552388] exists,up 98e8c587-7df0-48b3-9f75-9244cabaf28c 2026-02-17T04:43:48.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:48.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:48.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:48.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:43:48.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 2 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:43:48.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:43:48.508 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:43:48.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:43:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:43:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:43:48.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:43:48.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ca1b63ef-69fe-424d-888c-06b2155e4e7c 2026-02-17T04:43:48.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ca1b63ef-69fe-424d-888c-06b2155e4e7c' 2026-02-17T04:43:48.511 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 ca1b63ef-69fe-424d-888c-06b2155e4e7c 2026-02-17T04:43:48.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:43:48.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAE8pNpRZ3AHhAAW0yh3fsCu0x4I+EtqDTEKA== 2026-02-17T04:43:48.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAE8pNpRZ3AHhAAW0yh3fsCu0x4I+EtqDTEKA=="}' 2026-02-17T04:43:48.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ca1b63ef-69fe-424d-888c-06b2155e4e7c -i td/osd-scrub-repair/2/new.json 2026-02-17T04:43:48.679 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:43:48.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:43:48.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAE8pNpRZ3AHhAAW0yh3fsCu0x4I+EtqDTEKA== --osd-uuid ca1b63ef-69fe-424d-888c-06b2155e4e7c 2026-02-17T04:43:48.704 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:48.703+0000 7fcf48018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:48.705 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:48.704+0000 7fcf48018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:48.706 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:48.705+0000 7fcf48018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:48.707 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:48.706+0000 7fcf48018780 -1 bdev(0x3972c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:43:48.707 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:48.706+0000 7fcf48018780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:43:49.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:43:49.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:43:49.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:43:49.028 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:43:49.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:43:49.237 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:43:49.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:43:49.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:43:49.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:43:49.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:43:49.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:43:49.252 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:49.251+0000 7f8cbd80e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:49.253 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:49.253+0000 7f8cbd80e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:49.254 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:49.254+0000 7f8cbd80e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:43:49.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:43:49.409 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:43:49.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:49.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:43:49.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:49.408+0000 7f8cbd80e780 -1 Falling back to public interface 2026-02-17T04:43:49.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:43:49.698 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:43:49.697+0000 7f8cbd80e780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:43:50.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:43:50.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:43:50.575 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:43:50.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:43:50.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:43:50.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:43:50.741 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1127480339,v1:127.0.0.1:6819/1127480339] [v2:127.0.0.1:6820/1127480339,v1:127.0.0.1:6821/1127480339] exists,up ca1b63ef-69fe-424d-888c-06b2155e4e7c 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:801: TEST_repair_stats_ec: create_ec_pool testpool false k=2 m=1 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=testpool 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:43:50.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:43:50.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:43:50.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T04:43:50.958 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:43:50.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool testpool 1 1 erasure myprofile 2026-02-17T04:43:50.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 erasure myprofile 2026-02-17T04:43:51.264 INFO:tasks.workunit.client.0.trial090.stderr:pool 'testpool' created 2026-02-17T04:43:51.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:43:52.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:43:52.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:43:52.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:43:52.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:43:52.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:43:52.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:43:52.279 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:43:52.279 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:43:52.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:43:52.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:43:52.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:43:52.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:43:52.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:43:52.540 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:43:52.540 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:43:52.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:43:52.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:52.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:43:52.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:43:52.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:43:52.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:43:52.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:52.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:43:52.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:43:52.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:43:52.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T04:43:52.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:43:52.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:43:52.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T04:43:52.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T04:43:52.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542147' 2026-02-17T04:43:52.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:52.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:43:52.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:52.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:43:52.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:43:52.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:52.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:43:52.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:43:52.726 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:43:52.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:43:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:53.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:43:53.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:54.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:43:54.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:43:55.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:43:55.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:43:55.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:43:55.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:55.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:43:55.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:55.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:43:55.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:43:55.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:55.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:43:55.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:43:55.231 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:43:55.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:43:55.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-17T04:43:55.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:43:55.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T04:43:55.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:43:55.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:43:55.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T04:43:55.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:43:55.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T04:43:55.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T04:43:55.406 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T04:43:55.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:43:55.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T04:43:55.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:43:55.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:55.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:55.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:43:55.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:43:55.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:43:55.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:43:55.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:43:55.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:43:55.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:43:56.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:43:56.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:43:56.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:43:56.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:43:56.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:804: TEST_repair_stats_ec: local payload=ABCDEF 2026-02-17T04:43:56.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:805: TEST_repair_stats_ec: echo ABCDEF 2026-02-17T04:43:56.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: seq 1 30 2026-02-17T04:43:56.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj11 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj12 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj13 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj14 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj15 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj16 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj17 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj18 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj19 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj20 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj21 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj22 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj23 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj24 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj25 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj26 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj27 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj28 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj29 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-17T04:43:56.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj30 td/osd-scrub-repair/ORIGINAL 2026-02-17T04:43:56.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:813: TEST_repair_stats_ec: get_not_primary testpool obj1 2026-02-17T04:43:56.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:56.667 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:43:56.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:43:56.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:56.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:43:57.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:813: TEST_repair_stats_ec: local other=0 2026-02-17T04:43:57.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:814: TEST_repair_stats_ec: get_pg testpool obj1 2026-02-17T04:43:57.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-17T04:43:57.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-17T04:43:57.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-17T04:43:57.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:814: TEST_repair_stats_ec: local pgid=1.0 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:815: TEST_repair_stats_ec: get_primary testpool obj1 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-17T04:43:57.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:43:57.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:815: TEST_repair_stats_ec: local primary=1 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:817: TEST_repair_stats_ec: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:57.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:57.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:57.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:818: TEST_repair_stats_ec: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-17T04:43:57.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:43:57.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:43:57.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:43:57.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:43:57.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:43:57.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:43:57.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: seq 1 26 2026-02-17T04:43:57.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:57.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 1 % 2 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 remove 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:57.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 remove 2026-02-17T04:43:57.659 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:ff7b1f36:::obj1:head# 2026-02-17T04:43:57.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:57.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 2 % 2 2026-02-17T04:43:57.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:57.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-17T04:43:57.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:57.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-17T04:43:57.793 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:104778fc:::obj2:head# 2026-02-17T04:43:57.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:57.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 3 % 2 2026-02-17T04:43:57.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj3 remove 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:57.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj3 remove 2026-02-17T04:43:57.929 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:8dd16f86:::obj3:head# 2026-02-17T04:43:57.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:57.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 4 % 2 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj4 remove 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:57.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj4 remove 2026-02-17T04:43:58.052 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:0ee9ae15:::obj4:head# 2026-02-17T04:43:58.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 5 % 2 2026-02-17T04:43:58.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:58.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj5 remove 2026-02-17T04:43:58.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj5 remove 2026-02-17T04:43:58.176 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:c52c9666:::obj5:head# 2026-02-17T04:43:58.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 6 % 2 2026-02-17T04:43:58.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj6 remove 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:58.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj6 remove 2026-02-17T04:43:58.309 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:233a42c1:::obj6:head# 2026-02-17T04:43:58.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.353 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 7 % 2 2026-02-17T04:43:58.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:58.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj7 remove 2026-02-17T04:43:58.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj7 remove 2026-02-17T04:43:58.440 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:9a09113a:::obj7:head# 2026-02-17T04:43:58.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 8 % 2 2026-02-17T04:43:58.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:58.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj8 remove 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:58.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj8 remove 2026-02-17T04:43:58.584 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:a557efb1:::obj8:head# 2026-02-17T04:43:58.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 9 % 2 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj9 remove 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:58.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj9 remove 2026-02-17T04:43:58.719 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:fe351e27:::obj9:head# 2026-02-17T04:43:58.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 10 % 2 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj10 remove 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:58.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:58.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj10 remove 2026-02-17T04:43:58.850 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:d1337354:::obj10:head# 2026-02-17T04:43:58.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:58.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 11 % 2 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj11 remove 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj11 remove 2026-02-17T04:43:58.978 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:eeae2a94:::obj11:head# 2026-02-17T04:43:59.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 12 % 2 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj12 remove 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:59.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj12 remove 2026-02-17T04:43:59.100 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:af5f95cb:::obj12:head# 2026-02-17T04:43:59.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 13 % 2 2026-02-17T04:43:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj13 remove 2026-02-17T04:43:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:59.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:59.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj13 remove 2026-02-17T04:43:59.236 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:a61ad63e:::obj13:head# 2026-02-17T04:43:59.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 14 % 2 2026-02-17T04:43:59.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj14 remove 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:59.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj14 remove 2026-02-17T04:43:59.357 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:e0a44829:::obj14:head# 2026-02-17T04:43:59.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 15 % 2 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj15 remove 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj15 remove 2026-02-17T04:43:59.482 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:ab946124:::obj15:head# 2026-02-17T04:43:59.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 16 % 2 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj16 remove 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:59.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj16 remove 2026-02-17T04:43:59.614 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:461f8b5e:::obj16:head# 2026-02-17T04:43:59.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 17 % 2 2026-02-17T04:43:59.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:59.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj17 remove 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:59.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj17 remove 2026-02-17T04:43:59.744 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:24fc6e92:::obj17:head# 2026-02-17T04:43:59.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 18 % 2 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj18 remove 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:43:59.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj18 remove 2026-02-17T04:43:59.869 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:b9836a99:::obj18:head# 2026-02-17T04:43:59.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:43:59.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 19 % 2 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj19 remove 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:43:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:43:59.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj19 remove 2026-02-17T04:43:59.994 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:00b31b6c:::obj19:head# 2026-02-17T04:44:00.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 20 % 2 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj20 remove 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj20 remove 2026-02-17T04:44:00.113 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:24b5611b:::obj20:head# 2026-02-17T04:44:00.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 21 % 2 2026-02-17T04:44:00.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:44:00.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj21 remove 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:44:00.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj21 remove 2026-02-17T04:44:00.241 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:1243fe1a:::obj21:head# 2026-02-17T04:44:00.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 22 % 2 2026-02-17T04:44:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:44:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj22 remove 2026-02-17T04:44:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:44:00.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:00.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj22 remove 2026-02-17T04:44:00.374 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:c0c49def:::obj22:head# 2026-02-17T04:44:00.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 23 % 2 2026-02-17T04:44:00.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj23 remove 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:44:00.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj23 remove 2026-02-17T04:44:00.513 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:242c40e0:::obj23:head# 2026-02-17T04:44:00.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 24 % 2 2026-02-17T04:44:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:44:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj24 remove 2026-02-17T04:44:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:44:00.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:00.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj24 remove 2026-02-17T04:44:00.651 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:7eacede5:::obj24:head# 2026-02-17T04:44:00.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 25 % 2 2026-02-17T04:44:00.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj25 remove 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:44:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj25 remove 2026-02-17T04:44:00.784 INFO:tasks.workunit.client.0.trial090.stdout:remove 0#1:7109478f:::obj25:head# 2026-02-17T04:44:00.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-17T04:44:00.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 26 % 2 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj26 remove 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:00.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj26 remove 2026-02-17T04:44:00.918 INFO:tasks.workunit.client.0.trial090.stdout:remove 1#1:f3c2593a:::obj26:head# 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:825: TEST_repair_stats_ec: activate_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:44:00.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:44:00.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:44:00.955 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:44:00.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:44:00.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-17T04:44:00.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:44:00.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:44:00.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:44:00.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:44:00.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:00.970+0000 7fd36b232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:00.972 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:00.971+0000 7fd36b232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:00.973 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:00.972+0000 7fd36b232780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:44:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:01.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:44:01.143 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:01.142+0000 7fd36b232780 -1 Falling back to public interface 2026-02-17T04:44:01.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:44:01.452 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:01.451+0000 7fd36b232780 -1 osd.1 21 log_to_monitors true 2026-02-17T04:44:02.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:44:02.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:02.290 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:44:02.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:44:02.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:02.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:44:02.455 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 24 up_thru 24 down_at 21 last_clean_interval [10,21) [v2:127.0.0.1:6800/210955099,v1:127.0.0.1:6801/210955099] [v2:127.0.0.1:6802/210955099,v1:127.0.0.1:6803/210955099] exists,up 98e8c587-7df0-48b3-9f75-9244cabaf28c 2026-02-17T04:44:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:44:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:44:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:44:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:826: TEST_repair_stats_ec: activate_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:44:02.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:44:02.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:44:02.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:44:02.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:44:02.462 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:44:02.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-17T04:44:02.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:44:02.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:44:02.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:44:02.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:44:02.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:44:02.473 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:02.472+0000 7f3ab9a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:02.474 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:02.473+0000 7f3ab9a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:02.475 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:02.474+0000 7f3ab9a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:02.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:44:02.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:44:02.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:44:02.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:44:02.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:44:02.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:02.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:44:02.629 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:44:02.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:02.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:44:02.665 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:02.664+0000 7f3ab9a0f780 -1 Falling back to public interface 2026-02-17T04:44:02.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:44:02.971 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:02.970+0000 7f3ab9a0f780 -1 osd.0 19 log_to_monitors true 2026-02-17T04:44:03.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:44:03.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:03.793 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:44:03.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:44:03.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:03.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:44:03.958 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 28 up_thru 0 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6810/3987836642,v1:127.0.0.1:6811/3987836642] [v2:127.0.0.1:6812/3987836642,v1:127.0.0.1:6813/3987836642] exists,up 8255690b-19ec-4b5a-929f-d30f74f9a601 2026-02-17T04:44:03.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:44:03.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:827: TEST_repair_stats_ec: wait_for_clean 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:44:03.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:44:03.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:44:04.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:44:04.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:44:04.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:44:04.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:44:04.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:44:04.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:04.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:44:04.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T04:44:04.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T04:44:04.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290' 2026-02-17T04:44:04.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:04.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:44:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:44:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:44:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290 1-103079215106' 2026-02-17T04:44:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:04.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:44:04.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T04:44:04.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T04:44:04.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084290 1-103079215106 2-60129542150' 2026-02-17T04:44:04.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:04.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084290 2026-02-17T04:44:04.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:04.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:44:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084290 2026-02-17T04:44:04.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T04:44:04.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084290' 2026-02-17T04:44:04.405 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 120259084290 2026-02-17T04:44:04.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:04.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 120259084290 2026-02-17T04:44:04.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:44:05.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:44:05.573 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:05.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T04:44:05.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:05.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-103079215106 2026-02-17T04:44:05.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:05.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:44:05.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-103079215106 2026-02-17T04:44:05.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:44:05.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 103079215106' 2026-02-17T04:44:05.743 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 103079215106 2026-02-17T04:44:05.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:44:05.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:44:05.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:05.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T04:44:05.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:05.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:44:05.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T04:44:05.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:05.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T04:44:05.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T04:44:05.911 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542150 2026-02-17T04:44:05.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:44:06.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T04:44:06.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:44:06.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:06.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:06.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:44:06.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:44:06.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:44:06.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:44:06.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:44:06.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:06.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:06.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:829: TEST_repair_stats_ec: repair 1.0 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:06.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:06.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T04:44:06.994 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-17T04:44:07.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:07.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:07.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:07.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:51.262013+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:07.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:08.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:08.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:08.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:08.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:08.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:08.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:08.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:08.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:51.262013+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:08.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:09.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:09.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:09.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:09.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:51.262013+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:09.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:10.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:10.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:10.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:10.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:10.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:10.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:10.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:10.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:51.262013+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:10.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:11.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:11.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:11.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:11.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:11.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:11.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:11.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:43:51.262013+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:11.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:12.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:12.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:12.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:12.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:12.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:12.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:12.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:13.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:07.443277+0000 '>' 2026-02-17T04:43:51.262013+0000 2026-02-17T04:44:13.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:830: TEST_repair_stats_ec: wait_for_clean 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:44:13.012 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:44:13.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:44:13.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:44:13.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:44:13.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:44:13.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:44:13.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:44:13.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:44:13.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:44:13.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:44:13.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:44:13.277 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:44:13.278 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:44:13.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:44:13.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:13.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:44:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084293 2026-02-17T04:44:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084293 2026-02-17T04:44:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084293' 2026-02-17T04:44:13.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:13.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:44:13.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-17T04:44:13.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-17T04:44:13.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084293 1-103079215109' 2026-02-17T04:44:13.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:13.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084293 1-103079215109 2-60129542153' 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084293 2026-02-17T04:44:13.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:13.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:44:13.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084293 2026-02-17T04:44:13.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:13.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084293 2026-02-17T04:44:13.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084293' 2026-02-17T04:44:13.460 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 120259084293 2026-02-17T04:44:13.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:13.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084291 -lt 120259084293 2026-02-17T04:44:13.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:44:14.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:44:14.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:14.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084293 -lt 120259084293 2026-02-17T04:44:14.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:14.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-103079215109 2026-02-17T04:44:14.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:14.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:44:14.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-103079215109 2026-02-17T04:44:14.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:14.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215109 2026-02-17T04:44:14.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 103079215109' 2026-02-17T04:44:14.807 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 103079215109 2026-02-17T04:44:14.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:44:14.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-17T04:44:14.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:14.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T04:44:14.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:14.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:44:14.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T04:44:14.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:14.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T04:44:14.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T04:44:14.981 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542153 2026-02-17T04:44:14.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:44:15.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T04:44:15.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:44:15.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:15.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:44:15.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:44:15.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:44:15.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:44:15.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:44:15.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:44:15.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:44:15.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:44:15.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:44:15.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:44:15.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:15.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:15.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:44:15.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:44:15.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:44:15.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:831: TEST_repair_stats_ec: ceph pg dump pgs 2026-02-17T04:44:15.895 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:44:15.895 INFO:tasks.workunit.client.0.trial090.stdout:1.0 30 0 0 0 0 210 0 0 30 0 30 active+clean 2026-02-17T04:44:07.466120+0000 19'30 29:135 [1,0,2] 1 [1,0,2] 1 19'30 2026-02-17T04:44:07.443277+0000 19'30 2026-02-17T04:44:07.443277+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:44:07.443277+0000 17 0 2026-02-17T04:44:15.895 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:44:15.895 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:44:15.895 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:44:15.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:832: TEST_repair_stats_ec: flush_pg_stats 2026-02-17T04:44:15.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:44:15.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:44:16.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:44:16.071 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:44:16.071 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:44:16.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:44:16.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:16.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:44:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084294 2026-02-17T04:44:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084294 2026-02-17T04:44:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084294' 2026-02-17T04:44:16.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:16.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:44:16.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-17T04:44:16.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-17T04:44:16.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084294 1-103079215110' 2026-02-17T04:44:16.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:16.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:44:16.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-17T04:44:16.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-17T04:44:16.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-120259084294 1-103079215110 2-60129542155' 2026-02-17T04:44:16.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:16.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-120259084294 2026-02-17T04:44:16.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:16.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:44:16.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-120259084294 2026-02-17T04:44:16.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:16.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084294 2026-02-17T04:44:16.259 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 120259084294 2026-02-17T04:44:16.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 120259084294' 2026-02-17T04:44:16.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:16.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084293 -lt 120259084294 2026-02-17T04:44:16.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:44:17.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:44:17.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:17.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084294 -lt 120259084294 2026-02-17T04:44:17.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:17.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-103079215110 2026-02-17T04:44:17.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:17.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:44:17.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-103079215110 2026-02-17T04:44:17.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215110 2026-02-17T04:44:17.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 103079215110' 2026-02-17T04:44:17.595 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 103079215110 2026-02-17T04:44:17.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:44:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215111 -lt 103079215110 2026-02-17T04:44:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:17.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-17T04:44:17.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:17.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:44:17.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-17T04:44:17.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:17.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-17T04:44:17.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-17T04:44:17.764 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542155 2026-02-17T04:44:17.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:44:17.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-17T04:44:17.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:835: TEST_repair_stats_ec: ceph pg 1.0 query 2026-02-17T04:44:17.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:835: TEST_repair_stats_ec: jq .info.stats.stat_sum 2026-02-17T04:44:17.998 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:17.998 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes": 210, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects": 30, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_object_clones": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_object_copies": 90, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_missing": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_degraded": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_misplaced": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_unfound": 0, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_dirty": 30, 2026-02-17T04:44:17.999 INFO:tasks.workunit.client.0.trial090.stdout: "num_whiteouts": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_read": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_read_kb": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_write": 30, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_write_kb": 30, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_scrub_errors": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_deep_scrub_errors": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_recovered": 26, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes_recovered": 182, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_keys_recovered": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_omap": 0, 2026-02-17T04:44:18.000 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_kb": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_kb": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_promote": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_mode_high": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_flush_mode_low": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_mode_some": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_evict_mode_full": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_pinned": 0, 2026-02-17T04:44:18.001 INFO:tasks.workunit.client.0.trial090.stdout: "num_legacy_snapsets": 0, 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout: "num_large_omap_objects": 0, 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_manifest": 0, 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout: "num_omap_bytes": 0, 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout: "num_omap_keys": 0, 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout: "num_objects_repaired": 26 2026-02-17T04:44:18.002 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:18.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: ceph pg 1.0 query 2026-02-17T04:44:18.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: jq .info.stats.stat_sum.num_objects_repaired 2026-02-17T04:44:18.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: COUNT=26 2026-02-17T04:44:18.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:837: TEST_repair_stats_ec: test 26 = 26 2026-02-17T04:44:18.059 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: expr 3 - 1 2026-02-17T04:44:18.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: seq 0 2 2026-02-17T04:44:18.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:44:18.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 0 = 0 -o 0 = 1 ']' 2026-02-17T04:44:18.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: expr 26 / 2 2026-02-17T04:44:18.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: repair=13 2026-02-17T04:44:18.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 0 )' 2026-02-17T04:44:18.217 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:18.224 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:18.224 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:44:18.224 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 28, 2026-02-17T04:44:18.224 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 120259084294, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 1, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 1, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 1, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 104857600, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 28472, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 360, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 5, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 28090, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 104829128, 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:44:18.225 INFO:tasks.workunit.client.0.trial090.stdout: "total": 107374182400, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "available": 107345027072, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 368640, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 200766, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 5704, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 28764600 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [ 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: 1, 2026-02-17T04:44:18.226 INFO:tasks.workunit.client.0.trial090.stdout: 2 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 13, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:44:18.227 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [] 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 0 ).num_shards_repaired' 2026-02-17T04:44:18.380 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:18.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=13 2026-02-17T04:44:18.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 13 = 13 2026-02-17T04:44:18.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:44:18.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 1 = 0 -o 1 = 1 ']' 2026-02-17T04:44:18.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: expr 26 / 2 2026-02-17T04:44:18.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: repair=13 2026-02-17T04:44:18.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 1 )' 2026-02-17T04:44:18.544 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 24, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 103079215111, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 1, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 1, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 1, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 104857600, 2026-02-17T04:44:18.552 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 28472, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 360, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 8, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 28087, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 104829128, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "total": 107374182400, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "available": 107345027072, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 368640, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 200766, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:44:18.553 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 8307, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 28761997 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [ 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: 0, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: 2 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 13, 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:44:18.554 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [] 2026-02-17T04:44:18.555 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:18.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 1 ).num_shards_repaired' 2026-02-17T04:44:18.710 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=13 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 13 = 13 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 2 = 0 -o 2 = 1 ']' 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:843: TEST_repair_stats_ec: repair=0 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 2 )' 2026-02-17T04:44:18.875 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 2, 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 14, 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 60129542155, 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 1, 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 1, 2026-02-17T04:44:18.884 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 1, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 1, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 104857600, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 27320, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 360, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 11, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 26932, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 104830280, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "total": 107374182400, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "available": 107346206720, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:44:18.885 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 368640, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 200766, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 12041, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 27578615 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [ 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: 0, 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:44:18.886 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:18.887 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [] 2026-02-17T04:44:18.888 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:18.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:18.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 2 ).num_shards_repaired' 2026-02-17T04:44:19.038 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:19.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=0 2026-02-17T04:44:19.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 0 = 0 2026-02-17T04:44:19.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:851: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:19.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:851: TEST_repair_stats_ec: jq .pg_map.osd_stats_sum 2026-02-17T04:44:19.200 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:19.208 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:19.208 INFO:tasks.workunit.client.0.trial090.stdout: "up_from": 0, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "num_pgs": 3, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "num_osds": 3, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_osds": 3, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb": 314572800, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used": 84264, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_data": 1080, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_omap": 25, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb_used_meta": 83110, 2026-02-17T04:44:19.209 INFO:tasks.workunit.client.0.trial090.stdout: "kb_avail": 314488536, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "statfs": { 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "total": 322122547200, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "available": 322036260864, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "internally_reserved": 0, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "allocated": 1105920, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "data_stored": 602298, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed": 0, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_allocated": 0, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "data_compressed_original": 0, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "omap_allocated": 26052, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "internal_metadata": 85105212 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "hb_peers": [], 2026-02-17T04:44:19.210 INFO:tasks.workunit.client.0.trial090.stdout: "snap_trim_queue_len": 0, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "num_snap_trimming": 0, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "num_shards_repaired": 26, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "op_queue_age_hist": { 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "histogram": [], 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "upper_bound": 1 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "perf_stat": { 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ms": 0, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ms": 0, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "commit_latency_ns": 0, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "apply_latency_ns": 0 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "alerts": [], 2026-02-17T04:44:19.211 INFO:tasks.workunit.client.0.trial090.stdout: "network_ping_times": [] 2026-02-17T04:44:19.212 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:19.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-17T04:44:19.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: jq .pg_map.osd_stats_sum.num_shards_repaired 2026-02-17T04:44:19.365 INFO:tasks.workunit.client.0.trial090.stderr:dumped all 2026-02-17T04:44:19.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: COUNT=26 2026-02-17T04:44:19.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:853: TEST_repair_stats_ec: test 26 = 26 2026-02-17T04:44:19.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:44:19.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:44:19.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:44:19.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:44:19.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:44:19.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:44:19.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:44:19.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:44:19.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:44:19.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:44:19.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:44:19.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:44:19.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:44:19.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:44:19.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:44:19.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:44:19.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:44:19.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:44:19.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:44:19.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:44:19.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:44:19.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:44:19.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:44:19.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:44:19.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:44:19.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:44:19.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:44:19.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:44:19.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:44:19.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:44:19.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:44:19.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:44:19.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:44:19.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:44:19.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:44:19.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:44:19.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:44:19.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:44:19.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:44:19.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:44:19.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:44:19.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:44:19.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:44:19.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:44:19.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:44:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:44:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:44:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:44:19.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:44:19.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:44:19.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_request_scrub_priority td/osd-scrub-repair 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6369: TEST_request_scrub_priority: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6370: TEST_request_scrub_priority: local poolname=psr_pool 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6371: TEST_request_scrub_priority: local objname=POBJ 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6372: TEST_request_scrub_priority: local OBJECTS=64 2026-02-17T04:44:19.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6373: TEST_request_scrub_priority: local PGS=8 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6375: TEST_request_scrub_priority: run_mon td/osd-scrub-repair a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:44:19.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:44:19.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:44:19.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:44:19.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:44:19.535 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:44:19.535 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.535 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:19.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:44:19.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:44:19.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:44:19.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:44:19.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:44:19.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:44:19.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:44:19.564 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:44:19.564 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:44:19.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:44:19.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:44:19.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:44:19.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:44:19.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:44:19.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:44:19.609 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:44:19.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:44:19.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6376: TEST_request_scrub_priority: run_mgr td/osd-scrub-repair x 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:44:19.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.734 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:19.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:44:19.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6377: TEST_request_scrub_priority: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6378: TEST_request_scrub_priority: ceph_osd_args+=--osd_scrub_backoff_ratio=0 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6379: TEST_request_scrub_priority: run_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:44:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:44:19.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:44:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0' 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a705ea48-3126-495e-83be-5a9c9bf22393 2026-02-17T04:44:19.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a705ea48-3126-495e-83be-5a9c9bf22393' 2026-02-17T04:44:19.758 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a705ea48-3126-495e-83be-5a9c9bf22393 2026-02-17T04:44:19.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:44:19.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAj8pNpPyd5LRAAL7ipcbM1L96Gq18Cna00xQ== 2026-02-17T04:44:19.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAj8pNpPyd5LRAAL7ipcbM1L96Gq18Cna00xQ=="}' 2026-02-17T04:44:19.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a705ea48-3126-495e-83be-5a9c9bf22393 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:44:19.843 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:44:19.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:44:19.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --mkfs --key AQAj8pNpPyd5LRAAL7ipcbM1L96Gq18Cna00xQ== --osd-uuid a705ea48-3126-495e-83be-5a9c9bf22393 2026-02-17T04:44:19.868 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:19.866+0000 7fcfa67d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:19.869 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:19.868+0000 7fcfa67d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:19.870 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:19.869+0000 7fcfa67d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:19.871 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:19.869+0000 7fcfa67d8780 -1 bdev(0x281ac00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:44:19.871 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:19.869+0000 7fcfa67d8780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:44:20.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:44:20.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:44:20.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:44:20.281 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:44:20.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:44:20.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:44:20.383 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:20.381+0000 7ff93da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:20.384 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:20.383+0000 7ff93da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:20.385 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:20.383+0000 7ff93da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:20.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:44:20.447 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:44:20.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:20.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:44:20.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:44:20.582 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:20.580+0000 7ff93da0c780 -1 Falling back to public interface 2026-02-17T04:44:20.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:44:20.891+0000 7ff93da0c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:44:21.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:44:21.610 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2107136666,v1:127.0.0.1:6801/2107136666] [v2:127.0.0.1:6802/2107136666,v1:127.0.0.1:6803/2107136666] exists,up a705ea48-3126-495e-83be-5a9c9bf22393 2026-02-17T04:44:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:44:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:44:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:44:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6381: TEST_request_scrub_priority: create_pool psr_pool 8 8 2026-02-17T04:44:21.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool 8 8 2026-02-17T04:44:21.778 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool' created 2026-02-17T04:44:21.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:44:22.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6382: TEST_request_scrub_priority: wait_for_clean 2026-02-17T04:44:22.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:44:22.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:44:22.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:44:22.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:44:22.789 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:44:22.789 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:44:22.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:44:22.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:44:22.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:44:22.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:44:22.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:44:22.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:44:22.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:44:22.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:44:22.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:44:23.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:44:23.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:44:23.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:23.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:44:23.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:44:23.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:44:23.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:44:23.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:23.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:44:23.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:23.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:44:23.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:44:23.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:23.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:44:23.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:44:23.116 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:44:23.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:44:23.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:44:24.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:44:24.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:24.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:44:24.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:44:24.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:24.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:44:24.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:44:24.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:44:24.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:44:24.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:44:24.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:44:24.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:44:24.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:44:24.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:44:24.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:44:24.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:44:24.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:44:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:44:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:44:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:44:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6384: TEST_request_scrub_priority: local osd=0 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6385: TEST_request_scrub_priority: add_something td/osd-scrub-repair psr_pool POBJ noscrub 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=psr_pool 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=POBJ 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:44:25.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:44:25.246 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:44:25.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:44:25.451 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:44:25.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:44:25.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:44:25.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool psr_pool put POBJ td/osd-scrub-repair/ORIGINAL 2026-02-17T04:44:25.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6386: TEST_request_scrub_priority: get_primary psr_pool POBJ 2026-02-17T04:44:25.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=psr_pool 2026-02-17T04:44:25.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=POBJ 2026-02-17T04:44:25.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map psr_pool POBJ 2026-02-17T04:44:25.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:44:25.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6386: TEST_request_scrub_priority: local primary=0 2026-02-17T04:44:25.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6387: TEST_request_scrub_priority: get_pg psr_pool POBJ 2026-02-17T04:44:25.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=psr_pool 2026-02-17T04:44:25.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=POBJ 2026-02-17T04:44:25.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map psr_pool POBJ 2026-02-17T04:44:25.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:44:25.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6387: TEST_request_scrub_priority: local pg=1.1 2026-02-17T04:44:25.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: ceph osd dump 2026-02-17T04:44:25.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: grep '^pool.*['\'']psr_pool['\'']' 2026-02-17T04:44:25.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: awk '{ print $2 }' 2026-02-17T04:44:25.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: poolid=1 2026-02-17T04:44:25.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6390: TEST_request_scrub_priority: local otherpgs 2026-02-17T04:44:25.979 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: expr 8 - 1 2026-02-17T04:44:25.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: seq 0 7 2026-02-17T04:44:25.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:25.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.0 2026-02-17T04:44:25.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.0 = 1.1 ']' 2026-02-17T04:44:25.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 ' 2026-02-17T04:44:25.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:25.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:25.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:25.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:25.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:26.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:26.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.0 schedule-scrub 1.0 2026-02-17T04:44:26.201 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:26.201 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:26.201 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:26.201 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:26.200168+0000" 2026-02-17T04:44:26.201 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:26.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:26.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.1 2026-02-17T04:44:26.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.1 = 1.1 ']' 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6395: TEST_request_scrub_priority: continue 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.2 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.2 = 1.1 ']' 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 ' 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:26.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:26.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:26.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.2 schedule-scrub 1.2 2026-02-17T04:44:26.427 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:26.427 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:26.427 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:26.427 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:26.426359+0000" 2026-02-17T04:44:26.427 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:26.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:26.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.3 2026-02-17T04:44:26.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.3 = 1.1 ']' 2026-02-17T04:44:26.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 ' 2026-02-17T04:44:26.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:26.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:26.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:26.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:26.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:26.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:26.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.3 schedule-scrub 1.3 2026-02-17T04:44:26.650 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:26.650 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:26.651 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:26.651 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:26.649997+0000" 2026-02-17T04:44:26.651 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:26.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:26.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.4 2026-02-17T04:44:26.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.4 = 1.1 ']' 2026-02-17T04:44:26.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 ' 2026-02-17T04:44:26.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:26.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:26.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:26.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:26.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:26.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:26.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.4 schedule-scrub 1.4 2026-02-17T04:44:26.876 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:26.876 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:26.876 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:26.876 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:26.875253+0000" 2026-02-17T04:44:26.876 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.5 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.5 = 1.1 ']' 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 ' 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:26.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:26.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:26.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:26.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:27.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:27.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.5 schedule-scrub 1.5 2026-02-17T04:44:27.100 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:27.101 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:27.101 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:27.101 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:27.100275+0000" 2026-02-17T04:44:27.101 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:27.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:27.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.6 2026-02-17T04:44:27.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.6 = 1.1 ']' 2026-02-17T04:44:27.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 1.6 ' 2026-02-17T04:44:27.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:27.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:27.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:27.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:27.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:27.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:27.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.6 schedule-scrub 1.6 2026-02-17T04:44:27.325 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:27.325 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:27.326 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:27.326 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:27.325011+0000" 2026-02-17T04:44:27.326 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:27.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.7 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.7 = 1.1 ']' 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 1.6 1.7 ' 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:27.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:27.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:27.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:27.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:27.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.7 schedule-scrub 1.7 2026-02-17T04:44:27.555 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:27.555 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:27.556 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:44:27.556 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:44:27.554814+0000" 2026-02-17T04:44:27.556 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:27.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6403: TEST_request_scrub_priority: sleep 15 2026-02-17T04:44:42.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6404: TEST_request_scrub_priority: flush_pg_stats 2026-02-17T04:44:42.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:44:42.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:44:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:44:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:44:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:44:42.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:44:42.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:44:42.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:44:42.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:44:42.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:44:42.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:44:42.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:44:42.793 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:44:42.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:42.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T04:44:42.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:44:43.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:44:43.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:44:44.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:44:44.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6407: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-17T04:44:44.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:44.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:44.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:44.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:44.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6407: TEST_request_scrub_priority: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:44.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6408: TEST_request_scrub_priority: ceph tell 1.1 scrub 2026-02-17T04:44:44.354 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:44:44.354 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:44:44.354 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:44:44.355 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:44:44.355 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:44:44.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6410: TEST_request_scrub_priority: ceph osd unset noscrub 2026-02-17T04:44:44.573 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is unset 2026-02-17T04:44:44.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6411: TEST_request_scrub_priority: ceph osd unset nodeep-scrub 2026-02-17T04:44:44.777 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is unset 2026-02-17T04:44:44.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6413: TEST_request_scrub_priority: wait_for_scrub 1.1 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.1 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:44.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:44.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:21.776151+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:44.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:45.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:45.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-17T04:44:45.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:45.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:45.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:45.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:46.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:21.776151+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:46.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:47.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:47.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:47.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-17T04:44:47.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:47.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:47.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:47.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:47.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:21.776151+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:47.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:48.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:48.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:48.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-17T04:44:48.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:44:48.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:48.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:48.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:44:48.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:44.693869+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:48.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:44:48.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.0 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:48.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:48.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:48.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:49.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:49.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:49.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:49.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:49.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:49.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:49.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:50.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:50.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:50.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:50.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:50.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:50.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:50.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:50.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:50.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:51.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:51.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:51.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:51.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:51.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:51.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:51.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:52.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:52.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:53.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:53.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:53.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:53.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:53.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:53.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:53.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:53.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:53.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:54.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:54.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:54.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:54.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:54.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:54.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:54.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:54.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:54.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:55.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:55.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:55.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:55.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:55.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:55.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:55.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:56.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:56.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:56.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:56.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:56.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:56.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:56.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:56.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:56.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:57.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:57.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:44:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:44:58.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:44:58.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:44:58.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:44:58.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:44:58.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:44:58.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:44:59.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:44:59.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:00.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:00.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:00.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:00.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:00.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:00.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:00.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:00.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:00.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:01.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:01.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:01.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:01.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:01.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:01.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:01.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:01.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:02.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:02.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:02.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:02.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:02.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:02.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:02.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:02.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:02.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:03.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:03.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:03.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:03.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:03.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:03.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:03.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:03.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:03.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:04.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:04.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:04.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:04.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:04.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:04.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:04.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:05.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:05.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:06.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:06.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:06.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:06.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:06.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:06.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:06.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:06.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:06.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:07.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:07.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:07.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:07.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:07.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:07.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:07.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:07.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:08.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:08.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:08.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:08.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:08.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:08.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:08.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:09.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:09.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:09.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:09.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:09.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:09.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:10.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:10.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:10.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:10.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:10.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:10.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:10.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:10.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:10.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:11.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:11.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:11.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:11.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:11.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:11.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:11.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:12.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:12.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:13.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:13.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:13.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:13.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:13.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:13.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:13.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:13.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:13.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:14.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:14.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:14.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:14.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:14.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:14.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:14.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:14.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:15.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:15.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:15.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:15.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:15.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:15.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:15.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:15.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:16.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:16.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:16.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:16.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:16.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:16.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:16.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:16.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:16.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:17.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:17.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:17.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:17.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:17.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:17.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:17.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:17.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:17.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:18.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:18.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:18.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:18.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:18.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:18.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:18.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:19.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:19.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:20.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:20.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:20.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:20.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:20.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:20.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:20.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:20.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:20.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:21.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:21.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:21.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:21.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:21.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:21.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:21.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:21.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:22.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:22.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:22.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:22.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:22.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:22.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:22.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:22.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:22.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:23.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:23.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:23.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:23.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:23.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:23.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:23.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:23.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:23.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:24.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:24.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:24.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:24.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:24.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:24.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:24.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:25.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:25.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:25.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:25.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:25.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:25.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:25.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:26.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:26.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:27.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:27.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:27.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:27.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:27.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:27.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:27.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:27.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:27.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:28.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:28.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:28.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:28.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:28.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:28.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:28.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:28.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:28.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:29.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:29.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:29.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:29.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:29.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:29.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:29.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:29.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:29.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:30.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:30.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:30.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:30.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:30.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:30.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:30.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:30.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:30.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:31.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:31.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:31.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:31.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:31.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:31.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:31.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:32.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:32.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:32.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:32.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:32.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:32.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:32.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:33.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:26.200168+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:33.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:34.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:34.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:45:34.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:45:34.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:27.751670+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.2 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.2 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:34.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2026-02-17T04:45:34.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.2 2026-02-17T04:45:34.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2026-02-17T04:45:34.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:28.708460+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.3 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-17T04:45:34.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:45:34.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:45:34.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:29.686611+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.4 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.4 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:34.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.4 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:30.671041+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.5 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.5 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:34.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2026-02-17T04:45:34.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.5 2026-02-17T04:45:34.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:31.696097+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.6 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.6 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:34.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-17T04:45:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:27.325011+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:35.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:36.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:36.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-17T04:45:36.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-17T04:45:36.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:36.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:36.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-17T04:45:36.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:27.325011+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:36.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:37.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:37.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-17T04:45:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-17T04:45:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:37.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-17T04:45:37.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T04:44:27.325011+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:37.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:45:38.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:45:38.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:38.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-17T04:45:38.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-17T04:45:38.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:38.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:38.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-17T04:45:38.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:32.663624+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.7 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.7 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.7 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:38.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:45:33.639300+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.1 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.1 2026-02-17T04:45:38.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:45:38.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-17T04:45:38.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:44:44.693869+0000 '>' 2026-02-17T04:44:21.776151+0000 2026-02-17T04:45:38.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:45:38.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep 'log_channel.*scrub ok' td/osd-scrub-repair/osd.0.log 2026-02-17T04:45:38.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep -v purged_snaps 2026-02-17T04:45:38.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: head -1 2026-02-17T04:45:38.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: sed 's/.*[[]DBG[]]//' 2026-02-17T04:45:38.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep -q 1.1 2026-02-17T04:45:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:45:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:45:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:45:38.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:45:38.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:45:38.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:45:38.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:45:38.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:45:38.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:45:39.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:45:39.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:45:39.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:45:39.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:45:39.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:45:39.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:45:39.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:45:39.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:45:39.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:45:39.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:45:39.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:45:39.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:45:39.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:45:39.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:45:39.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:45:39.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:45:39.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:45:39.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:45:39.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:45:39.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:45:39.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:45:39.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:45:39.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:45:39.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:45:39.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:45:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:45:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:45:39.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:45:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:45:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:45:39.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:45:39.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:45:39.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:45:39.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:45:39.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:45:39.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:45:39.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:45:39.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:45:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:45:39.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:45:39.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:45:39.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:45:39.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_scrub_warning td/osd-scrub-repair 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6011: TEST_scrub_warning: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6012: TEST_scrub_warning: local poolname=psr_pool 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6013: TEST_scrub_warning: local objname=POBJ 2026-02-17T04:45:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6014: TEST_scrub_warning: local scrubs=5 2026-02-17T04:45:39.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6015: TEST_scrub_warning: local deep_scrubs=5 2026-02-17T04:45:39.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6016: TEST_scrub_warning: local i1_day=86400 2026-02-17T04:45:39.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6017: TEST_scrub_warning: calc 86400 '*' 7 2026-02-17T04:45:39.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 86400 * 7}' 2026-02-17T04:45:39.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6017: TEST_scrub_warning: local i7_days=604800 2026-02-17T04:45:39.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6018: TEST_scrub_warning: calc 86400 '*' 14 2026-02-17T04:45:39.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 86400 * 14}' 2026-02-17T04:45:39.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6018: TEST_scrub_warning: local i14_days=1209600 2026-02-17T04:45:39.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6019: TEST_scrub_warning: local overdue=0.5 2026-02-17T04:45:39.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6020: TEST_scrub_warning: calc 604800 + 86400 + '(' 604800 '*' 0.5 ')' 2026-02-17T04:45:39.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 604800 + 86400 + ( 604800 * 0.5 )}' 2026-02-17T04:45:39.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6020: TEST_scrub_warning: local conf_overdue_seconds=993600 2026-02-17T04:45:39.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6021: TEST_scrub_warning: calc 1209600 + 86400 + '(' 1209600 '*' 0.5 ')' 2026-02-17T04:45:39.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 1209600 + 86400 + ( 1209600 * 0.5 )}' 2026-02-17T04:45:39.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6021: TEST_scrub_warning: local pool_overdue_seconds=1900800 2026-02-17T04:45:39.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6023: TEST_scrub_warning: run_mon td/osd-scrub-repair a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:45:39.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:45:39.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:45:39.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:45:39.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:45:39.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:45:39.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:45:39.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:45:39.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:45:39.073 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:45:39.073 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.074 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:45:39.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-17T04:45:39.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:45:39.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:45:39.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:45:39.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:45:39.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:45:39.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:45:39.099 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:45:39.099 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:45:39.099 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:45:39.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:45:39.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:45:39.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:45:39.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:45:39.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:45:39.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:45:39.145 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:45:39.145 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:45:39.145 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:45:39.145 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:45:39.145 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.146 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.146 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:45:39.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:45:39.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:45:39.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6024: TEST_scrub_warning: run_mgr td/osd-scrub-repair x --mon_warn_pg_not_scrubbed_ratio=0.5 --mon_warn_pg_not_deep_scrubbed_ratio=0.5 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:45:39.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:45:39.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:45:39.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon_warn_pg_not_scrubbed_ratio=0.5 --mon_warn_pg_not_deep_scrubbed_ratio=0.5 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6025: TEST_scrub_warning: run_osd td/osd-scrub-repair 0 --osd_scrub_backoff_ratio=0 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:45:39.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:45:39.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:45:39.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_backoff_ratio=0 2026-02-17T04:45:39.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:45:39.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:45:39.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=054cb929-bb4a-4063-85fe-65b03add8dac 2026-02-17T04:45:39.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 054cb929-bb4a-4063-85fe-65b03add8dac' 2026-02-17T04:45:39.298 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 054cb929-bb4a-4063-85fe-65b03add8dac 2026-02-17T04:45:39.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:45:39.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBz8pNpFb0YEhAAG5oKVSiJDb6sBrTeMu81ow== 2026-02-17T04:45:39.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBz8pNpFb0YEhAAG5oKVSiJDb6sBrTeMu81ow=="}' 2026-02-17T04:45:39.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 054cb929-bb4a-4063-85fe-65b03add8dac -i td/osd-scrub-repair/0/new.json 2026-02-17T04:45:39.386 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:45:39.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:45:39.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_backoff_ratio=0 --mkfs --key AQBz8pNpFb0YEhAAG5oKVSiJDb6sBrTeMu81ow== --osd-uuid 054cb929-bb4a-4063-85fe-65b03add8dac 2026-02-17T04:45:39.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.409+0000 7f53fee35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:39.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.410+0000 7f53fee35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:39.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.411+0000 7f53fee35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:39.414 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.411+0000 7f53fee35780 -1 bdev(0x41f6c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:45:39.414 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.412+0000 7f53fee35780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:45:39.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:45:39.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:45:39.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:45:39.836 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:45:39.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:45:39.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:45:39.924 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:45:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_backoff_ratio=0 2026-02-17T04:45:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:45:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:45:39.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:45:39.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.937+0000 7f8592e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:39.941 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.939+0000 7f8592e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:39.941 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:39.940+0000 7f8592e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:45:40.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:45:40.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:45:40.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:45:40.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:45:40.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:45:40.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:45:40.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:45:40.007 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:45:40.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:45:40.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:45:40.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:45:40.148 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:40.146+0000 7f8592e33780 -1 Falling back to public interface 2026-02-17T04:45:40.532 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:45:40.530+0000 7f8592e33780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:45:41.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:45:41.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:45:41.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:45:41.090 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:45:41.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:45:41.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:45:41.170 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1251705277,v1:127.0.0.1:6801/1251705277] [v2:127.0.0.1:6802/1251705277,v1:127.0.0.1:6803/1251705277] exists,up 054cb929-bb4a-4063-85fe-65b03add8dac 2026-02-17T04:45:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:45:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:45:41.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:45:41.171 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: expr 5 + 5 2026-02-17T04:45:41.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: seq 1 10 2026-02-17T04:45:41.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:45:41.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-1 1 1 2026-02-17T04:45:41.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-1 1 1 2026-02-17T04:45:41.342 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-1' created 2026-02-17T04:45:41.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:45:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:45:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:45:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:45:42.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:45:42.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:45:42.353 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:45:42.353 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:45:42.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:45:42.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:45:42.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:45:42.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:45:42.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:45:42.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:45:42.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:45:42.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:45:42.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:45:42.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:45:42.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:45:42.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:45:42.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:45:42.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:45:42.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:45:42.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:45:42.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:45:42.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:45:42.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:45:42.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:45:42.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:45:42.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:45:42.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:45:42.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:45:42.675 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:45:42.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:42.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:45:42.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:43.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:45:43.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:44.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:45:44.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:45:44.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:44.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:44.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:45:44.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:45:44.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:45:44.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:45:44.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:45:44.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:44.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:44.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:45:44.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:45:44.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:45:44.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 1 = 1 ']' 2026-02-17T04:45:44.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6033: TEST_scrub_warning: ceph osd pool set psr_pool-1 scrub_max_interval 1209600 2026-02-17T04:45:44.799 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 scrub_max_interval to 1209600 2026-02-17T04:45:44.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:45:44.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 1 = 6 ']' 2026-02-17T04:45:44.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:45:44.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-2 1 1 2026-02-17T04:45:44.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-2 1 1 2026-02-17T04:45:45.003 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-2' created 2026-02-17T04:45:45.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:45:46.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:45:46.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:45:46.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:45:46.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:45:46.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:45:46.015 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:45:46.015 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:45:46.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:45:46.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:45:46.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:45:46.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:45:46.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:45:46.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:45:46.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:45:46.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:45:46.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:45:46.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:45:46.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:45:46.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:45:46.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:45:46.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:45:46.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:45:46.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:45:46.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:45:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:45:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:45:46.341 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:45:46.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:46.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:45:46.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:47.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:45:47.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:47.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836483 2026-02-17T04:45:47.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:45:47.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:47.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 2 == 0 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:45:47.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:45:47.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:45:48.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=2 2026-02-17T04:45:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:45:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:48.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:48.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 2 = 2 2026-02-17T04:45:48.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:45:48.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:45:48.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 2 = 1 ']' 2026-02-17T04:45:48.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:45:48.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 2 = 6 ']' 2026-02-17T04:45:48.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:45:48.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-3 1 1 2026-02-17T04:45:48.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-3 1 1 2026-02-17T04:45:48.469 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-3' created 2026-02-17T04:45:48.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:45:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:45:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:45:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:45:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:45:49.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:45:49.480 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:45:49.480 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:45:49.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:45:49.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:45:49.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:45:49.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:45:49.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:45:49.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:45:49.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:45:49.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:45:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:45:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:45:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:45:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:45:49.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:45:49.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:45:49.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:45:49.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:45:49.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:45:49.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:45:49.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:45:49.807 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:45:49.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:49.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:45:49.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:50.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:45:50.974 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:51.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-17T04:45:51.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:52.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:45:52.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:52.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:45:52.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:45:52.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:52.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:52.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 3 == 0 2026-02-17T04:45:52.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:45:52.523 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:45:52.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=3 2026-02-17T04:45:52.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:45:52.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:52.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 3 = 3 2026-02-17T04:45:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:45:52.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:45:52.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 3 = 1 ']' 2026-02-17T04:45:52.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:45:52.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 3 = 6 ']' 2026-02-17T04:45:52.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:45:52.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-4 1 1 2026-02-17T04:45:52.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-4 1 1 2026-02-17T04:45:53.111 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-4' created 2026-02-17T04:45:53.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:45:54.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:45:54.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:45:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:45:54.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:45:54.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:45:54.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:45:54.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:45:54.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:45:54.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:45:54.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:45:54.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:45:54.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:45:54.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:45:54.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:45:54.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:45:54.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:45:54.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:45:54.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:45:54.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:45:54.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:45:54.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:45:54.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:45:54.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:45:54.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:45:54.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:45:54.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:45:54.451 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:45:54.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:54.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-17T04:45:54.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:55.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:45:55.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:55.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:45:55.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:45:55.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:55.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:55.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:45:55.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:45:56.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:45:56.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:45:56.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:45:56.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:45:56.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:45:56.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:45:56.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:45:56.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 4 = 1 ']' 2026-02-17T04:45:56.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:45:56.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 4 = 6 ']' 2026-02-17T04:45:56.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:45:56.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-5 1 1 2026-02-17T04:45:56.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-5 1 1 2026-02-17T04:45:56.547 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-5' created 2026-02-17T04:45:56.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:45:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:45:57.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:45:57.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:45:57.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:45:57.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:45:57.559 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:45:57.559 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:45:57.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:45:57.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:45:57.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:45:57.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:45:57.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:45:57.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:45:57.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:45:57.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:45:57.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:45:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:45:57.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:45:57.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:45:57.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:45:57.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-17T04:45:57.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-17T04:45:57.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T04:45:57.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:45:57.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836489 2026-02-17T04:45:57.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:45:57.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:45:57.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-17T04:45:57.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:45:57.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836489 2026-02-17T04:45:57.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T04:45:57.886 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836489 2026-02-17T04:45:57.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:58.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836489 2026-02-17T04:45:58.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:45:59.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:45:59.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:45:59.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836489 2026-02-17T04:45:59.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:00.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:46:00.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:00.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T04:46:00.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:00.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:00.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:00.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-17T04:46:00.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:00.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:00.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-17T04:46:00.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:00.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:00.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-17T04:46:00.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:00.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 5 = 1 ']' 2026-02-17T04:46:00.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 5 = 6 ']' 2026-02-17T04:46:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-6 1 1 2026-02-17T04:46:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-6 1 1 2026-02-17T04:46:01.201 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-6' created 2026-02-17T04:46:01.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:02.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:46:02.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:02.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:02.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:02.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:02.215 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:02.215 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:02.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:02.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:02.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:02.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:02.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:02.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:02.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:02.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T04:46:02.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T04:46:02.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T04:46:02.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:02.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T04:46:02.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:02.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:02.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T04:46:02.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:02.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T04:46:02.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T04:46:02.540 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836491 2026-02-17T04:46:02.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:02.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-17T04:46:02.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:03.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:03.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:03.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-17T04:46:03.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:03.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:03.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:04.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-17T04:46:04.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:04.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:04.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-17T04:46:04.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:04.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:04.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:04.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-17T04:46:04.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:04.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:04.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 6 = 1 ']' 2026-02-17T04:46:04.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 6 = 6 ']' 2026-02-17T04:46:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6037: TEST_scrub_warning: ceph osd pool set psr_pool-6 deep_scrub_interval 1209600 2026-02-17T04:46:04.665 INFO:tasks.workunit.client.0.trial090.stderr:set pool 6 deep_scrub_interval to 1209600 2026-02-17T04:46:04.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:04.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-7 1 1 2026-02-17T04:46:04.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-7 1 1 2026-02-17T04:46:04.870 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-7' created 2026-02-17T04:46:04.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:05.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:46:05.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:05.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:05.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:05.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:05.881 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:05.881 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:05.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:05.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:05.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:05.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:05.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:05.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:05.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:05.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:05.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:06.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:06.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:06.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:06.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:06.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T04:46:06.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T04:46:06.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T04:46:06.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:06.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T04:46:06.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:06.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:06.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T04:46:06.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:06.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T04:46:06.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T04:46:06.209 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:46:06.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:06.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-17T04:46:06.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:07.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:07.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:07.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836492 2026-02-17T04:46:07.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:07.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:07.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 7 == 0 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:07.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:07.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:07.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:07.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=7 2026-02-17T04:46:07.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:07.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:07.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:08.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 7 = 7 2026-02-17T04:46:08.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:08.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:08.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 7 = 1 ']' 2026-02-17T04:46:08.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:08.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 7 = 6 ']' 2026-02-17T04:46:08.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:08.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-8 1 1 2026-02-17T04:46:08.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-8 1 1 2026-02-17T04:46:08.340 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-8' created 2026-02-17T04:46:08.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:09.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:46:09.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:09.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:09.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:09.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:09.354 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:09.355 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:09.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:09.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:09.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:09.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:09.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:09.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:09.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:09.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:09.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-17T04:46:09.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-17T04:46:09.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T04:46:09.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:09.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-17T04:46:09.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:09.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:09.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-17T04:46:09.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:09.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-17T04:46:09.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T04:46:09.678 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836494 2026-02-17T04:46:09.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-17T04:46:09.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:10.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:10.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:11.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-17T04:46:11.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:12.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:46:12.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:12.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T04:46:12.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:12.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:12.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:12.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-17T04:46:12.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:12.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:12.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:12.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-17T04:46:12.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:12.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:12.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:12.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-17T04:46:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:12.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 8 = 1 ']' 2026-02-17T04:46:12.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 8 = 6 ']' 2026-02-17T04:46:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-9 1 1 2026-02-17T04:46:12.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-9 1 1 2026-02-17T04:46:12.984 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-9' created 2026-02-17T04:46:12.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:13.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:46:13.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:13.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:13.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:13.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:13.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:13.997 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:13.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:13.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:13.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:14.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:14.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:14.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:14.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:14.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:14.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-17T04:46:14.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-17T04:46:14.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T04:46:14.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:14.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-17T04:46:14.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:14.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:14.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-17T04:46:14.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:14.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-17T04:46:14.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T04:46:14.323 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836496 2026-02-17T04:46:14.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:14.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836496 2026-02-17T04:46:14.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:15.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:15.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:15.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-17T04:46:15.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:15.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:15.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:15.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 9 == 0 2026-02-17T04:46:15.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:15.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=9 2026-02-17T04:46:16.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:16.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:16.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:16.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 9 = 9 2026-02-17T04:46:16.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:16.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:16.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 9 = 1 ']' 2026-02-17T04:46:16.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:16.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 9 = 6 ']' 2026-02-17T04:46:16.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:16.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-10 1 1 2026-02-17T04:46:16.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-10 1 1 2026-02-17T04:46:16.497 INFO:tasks.workunit.client.0.trial090.stderr:pool 'psr_pool-10' created 2026-02-17T04:46:16.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-17T04:46:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:17.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:17.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:17.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:17.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:17.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:17.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:17.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:17.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:17.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:17.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:17.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:17.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:17.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-17T04:46:17.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-17T04:46:17.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-17T04:46:17.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:17.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836498 2026-02-17T04:46:17.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:17.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:17.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-17T04:46:17.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:17.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-17T04:46:17.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-17T04:46:17.839 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836498 2026-02-17T04:46:17.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:18.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836498 2026-02-17T04:46:18.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:19.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:19.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:19.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836498 2026-02-17T04:46:19.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:20.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:46:20.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:20.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-17T04:46:20.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:20.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:20.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:20.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 10 == 0 2026-02-17T04:46:20.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:20.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:20.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:20.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=10 2026-02-17T04:46:20.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:20.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:20.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:20.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 10 = 10 2026-02-17T04:46:20.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:20.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:20.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 10 = 1 ']' 2026-02-17T04:46:20.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:20.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 10 = 6 ']' 2026-02-17T04:46:20.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6042: TEST_scrub_warning: local primary=0 2026-02-17T04:46:20.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6044: TEST_scrub_warning: ceph osd set noscrub 2026-02-17T04:46:21.162 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:46:21.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6045: TEST_scrub_warning: ceph osd set nodeep-scrub 2026-02-17T04:46:21.367 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:46:21.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6046: TEST_scrub_warning: ceph config set global osd_scrub_interval_randomize_ratio 0 2026-02-17T04:46:21.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6047: TEST_scrub_warning: ceph config set global osd_deep_scrub_randomize_ratio 0 2026-02-17T04:46:21.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6048: TEST_scrub_warning: ceph config set global osd_scrub_max_interval 604800 2026-02-17T04:46:21.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6049: TEST_scrub_warning: ceph config set global osd_deep_scrub_interval 604800 2026-02-17T04:46:22.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: seq 1 5 2026-02-17T04:46:22.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-17T04:46:22.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 1 = 1 ']' 2026-02-17T04:46:22.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6056: TEST_scrub_warning: overdue_seconds=1900800 2026-02-17T04:46:22.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 1900800 + 100 2026-02-17T04:46:22.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 1.0 schedule-scrub 1900900 2026-02-17T04:46:22.099 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.099 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:22.099 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.099 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-01-26T04:44:42.098571+0000" 2026-02-17T04:46:22.100 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-17T04:46:22.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 2 = 1 ']' 2026-02-17T04:46:22.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 200 2026-02-17T04:46:22.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 2.0 schedule-scrub 993800 2026-02-17T04:46:22.159 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.159 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:22.159 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.159 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:43:02.159105+0000" 2026-02-17T04:46:22.159 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-17T04:46:22.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 3 = 1 ']' 2026-02-17T04:46:22.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 300 2026-02-17T04:46:22.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 3.0 schedule-scrub 993900 2026-02-17T04:46:22.220 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.220 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:22.221 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.221 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:41:22.220064+0000" 2026-02-17T04:46:22.221 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-17T04:46:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 4 = 1 ']' 2026-02-17T04:46:22.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 400 2026-02-17T04:46:22.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 4.0 schedule-scrub 994000 2026-02-17T04:46:22.281 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.282 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:22.282 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.282 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:39:42.280913+0000" 2026-02-17T04:46:22.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-17T04:46:22.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 5 = 1 ']' 2026-02-17T04:46:22.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 500 2026-02-17T04:46:22.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 5.0 schedule-scrub 994100 2026-02-17T04:46:22.341 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.342 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:22.342 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.342 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:38:02.340963+0000" 2026-02-17T04:46:22.342 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.346 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.348 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: expr 5 + 5 2026-02-17T04:46:22.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: seq 6 10 2026-02-17T04:46:22.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:22.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 6 = 6 ']' 2026-02-17T04:46:22.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6067: TEST_scrub_warning: overdue_seconds=1900800 2026-02-17T04:46:22.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 1900800 + 600 2026-02-17T04:46:22.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 6.0 schedule-deep-scrub 1901400 2026-02-17T04:46:22.408 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.408 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:46:22.408 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.408 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-01-26T04:36:22.407321+0000" 2026-02-17T04:46:22.408 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:22.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 7 = 6 ']' 2026-02-17T04:46:22.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 700 2026-02-17T04:46:22.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 7.0 schedule-deep-scrub 994300 2026-02-17T04:46:22.470 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.470 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:46:22.470 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.470 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:34:42.469571+0000" 2026-02-17T04:46:22.470 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:22.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 8 = 6 ']' 2026-02-17T04:46:22.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 800 2026-02-17T04:46:22.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 8.0 schedule-deep-scrub 994400 2026-02-17T04:46:22.530 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.530 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:46:22.530 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.530 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:33:02.529948+0000" 2026-02-17T04:46:22.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:22.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 9 = 6 ']' 2026-02-17T04:46:22.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.538 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 900 2026-02-17T04:46:22.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 9.0 schedule-deep-scrub 994500 2026-02-17T04:46:22.594 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.594 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:46:22.594 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.595 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:31:22.593672+0000" 2026-02-17T04:46:22.595 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-17T04:46:22.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-17T04:46:22.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 10 = 6 ']' 2026-02-17T04:46:22.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-17T04:46:22.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 1000 2026-02-17T04:46:22.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 10.0 schedule-deep-scrub 994600 2026-02-17T04:46:22.654 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:22.655 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:46:22.655 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:22.655 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-05T16:29:42.654238+0000" 2026-02-17T04:46:22.655 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:22.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6073: TEST_scrub_warning: flush_pg_stats 2026-02-17T04:46:22.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:22.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:46:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:22.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:22.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-17T04:46:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-17T04:46:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-17T04:46:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:22.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-17T04:46:22.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:22.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:22.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-17T04:46:22.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:22.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-17T04:46:22.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-17T04:46:22.886 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836500 2026-02-17T04:46:22.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:23.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836500 2026-02-17T04:46:23.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:24.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:24.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-17T04:46:24.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6075: TEST_scrub_warning: ceph health 2026-02-17T04:46:24.405 INFO:tasks.workunit.client.0.trial090.stdout:HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 5 pgs not deep-scrubbed in time; 5 pgs not scrubbed in time; 10 pool(s) have no replicas configured; OSD count 1 < osd_pool_default_size 3 2026-02-17T04:46:24.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6076: TEST_scrub_warning: ceph health detail 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout:HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 5 pgs not deep-scrubbed in time; 5 pgs not scrubbed in time; 10 pool(s) have no replicas configured; OSD count 1 < osd_pool_default_size 3 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout:[WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout:[WRN] PG_NOT_DEEP_SCRUBBED: 5 pgs not deep-scrubbed in time 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout: pg 10.0 not deep-scrubbed since 2026-02-05T16:29:42.654238+0000 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout: pg 9.0 not deep-scrubbed since 2026-02-05T16:31:22.593672+0000 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout: pg 8.0 not deep-scrubbed since 2026-02-05T16:33:02.529948+0000 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout: pg 7.0 not deep-scrubbed since 2026-02-05T16:34:42.469571+0000 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout: pg 6.0 not deep-scrubbed since 2026-01-26T04:36:22.407321+0000 2026-02-17T04:46:24.615 INFO:tasks.workunit.client.0.trial090.stdout:[WRN] PG_NOT_SCRUBBED: 5 pgs not scrubbed in time 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pg 5.0 not scrubbed since 2026-02-05T16:38:02.340963+0000 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pg 4.0 not scrubbed since 2026-02-05T16:39:42.280913+0000 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pg 3.0 not scrubbed since 2026-02-05T16:41:22.220064+0000 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pg 2.0 not scrubbed since 2026-02-05T16:43:02.159105+0000 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pg 1.0 not scrubbed since 2026-01-26T04:44:42.098571+0000 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout:[WRN] POOL_NO_REDUNDANCY: 10 pool(s) have no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-1' has no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-2' has no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-3' has no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-4' has no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-5' has no replicas configured 2026-02-17T04:46:24.616 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-6' has no replicas configured 2026-02-17T04:46:24.617 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-7' has no replicas configured 2026-02-17T04:46:24.617 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-8' has no replicas configured 2026-02-17T04:46:24.617 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-9' has no replicas configured 2026-02-17T04:46:24.617 INFO:tasks.workunit.client.0.trial090.stdout: pool 'psr_pool-10' has no replicas configured 2026-02-17T04:46:24.617 INFO:tasks.workunit.client.0.trial090.stdout:[WRN] TOO_FEW_OSDS: OSD count 1 < osd_pool_default_size 3 2026-02-17T04:46:24.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6077: TEST_scrub_warning: ceph health 2026-02-17T04:46:24.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6077: TEST_scrub_warning: grep -q ' pgs not deep-scrubbed in time' 2026-02-17T04:46:24.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6078: TEST_scrub_warning: ceph health 2026-02-17T04:46:24.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6078: TEST_scrub_warning: grep -q ' pgs not scrubbed in time' 2026-02-17T04:46:25.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: ceph health detail 2026-02-17T04:46:25.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: grep 'not scrubbed since' 2026-02-17T04:46:25.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: wc -l 2026-02-17T04:46:25.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: COUNT=5 2026-02-17T04:46:25.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6085: TEST_scrub_warning: expr 5+5 2026-02-17T04:46:25.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6085: TEST_scrub_warning: (( 5 != 5 && 5 != 5+5 )) 2026-02-17T04:46:25.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: ceph health detail 2026-02-17T04:46:25.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: grep 'not deep-scrubbed since' 2026-02-17T04:46:25.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: wc -l 2026-02-17T04:46:25.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: COUNT=5 2026-02-17T04:46:25.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6090: TEST_scrub_warning: '[' 5 '!=' 5 ']' 2026-02-17T04:46:25.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:46:25.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:46:25.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:46:25.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:46:25.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:46:25.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:46:25.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:46:25.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:46:25.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:46:25.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:46:25.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:25.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:46:25.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:46:25.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:25.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:46:25.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:46:25.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:46:25.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:46:25.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:25.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:25.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:46:25.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:46:25.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:46:25.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:46:25.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:46:25.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:46:25.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:46:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:46:25.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:46:25.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:46:25.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:46:25.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:46:25.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:25.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:46:25.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:46:25.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:25.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:46:25.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:46:25.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:46:25.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:46:25.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:25.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:25.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:46:25.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:46:25.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:46:25.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:46:25.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:46:25.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:25.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:25.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:46:25.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_skip_non_repair_during_recovery td/osd-scrub-repair 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:160: TEST_skip_non_repair_during_recovery: local dir=td/osd-scrub-repair 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:161: TEST_skip_non_repair_during_recovery: cluster_conf=(['osds_num']='2' ['pgs_in_pool']='4' ['pool_name']='nopool' ['pool_default_size']='2' ['extras']='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true') 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:161: TEST_skip_non_repair_during_recovery: local -A cluster_conf 2026-02-17T04:46:25.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:169: TEST_skip_non_repair_during_recovery: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=2 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=nopool 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=nopool 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=2 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=2 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars=--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T04:46:25.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:46:25.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:46:25.818 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 89996537-ef61-4e7f-b0a7-c9f49a57d3ed 2026-02-17T04:46:25.909 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:25.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:25.937+0000 7f7fda243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:25.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:25.938+0000 7f7fda243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:25.940 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:25.939+0000 7f7fda243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:25.941 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:25.939+0000 7f7fda243780 -1 bdev(0x2f76c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:25.941 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:25.940+0000 7f7fda243780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:46:26.390 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:46:26.474 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:46:26.495 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:26.494+0000 7f1e5005c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:26.496 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:26.495+0000 7f1e5005c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:26.497 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:26.496+0000 7f1e5005c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:26.555 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:26.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:26.676+0000 7f1e5005c780 -1 Falling back to public interface 2026-02-17T04:46:27.039 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.038+0000 7f1e5005c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:46:27.637 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:27.719 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3367156979,v1:127.0.0.1:6801/3367156979] [v2:127.0.0.1:6802/3367156979,v1:127.0.0.1:6803/3367156979] exists,up 89996537-ef61-4e7f-b0a7-c9f49a57d3ed 2026-02-17T04:46:27.723 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 da1394ba-fba4-453c-b01d-8d4a8d146db1 2026-02-17T04:46:27.813 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:27.842 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.841+0000 7f85e5e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:27.843 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.842+0000 7f85e5e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:27.844 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.843+0000 7f85e5e2f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:27.845 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.844+0000 7f85e5e2f780 -1 bdev(0x3ef8c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:27.845 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:27.844+0000 7f85e5e2f780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:46:28.185 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:46:28.397 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:46:28.417 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:28.417+0000 7fac51a33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:28.419 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:28.418+0000 7fac51a33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:28.420 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:28.419+0000 7fac51a33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:28.558 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:28.595 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:28.594+0000 7fac51a33780 -1 Falling back to public interface 2026-02-17T04:46:28.925 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:28.924+0000 7fac51a33780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:46:29.724 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:29.893 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1802133521,v1:127.0.0.1:6811/1802133521] [v2:127.0.0.1:6812/1802133521,v1:127.0.0.1:6813/1802133521] exists,up da1394ba-fba4-453c-b01d-8d4a8d146db1 2026-02-17T04:46:30.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:170: TEST_skip_non_repair_during_recovery: local poolname=rbd 2026-02-17T04:46:30.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:171: TEST_skip_non_repair_during_recovery: create_rbd_pool 2026-02-17T04:46:30.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-17T04:46:31.053 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' does not exist 2026-02-17T04:46:31.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-17T04:46:31.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-17T04:46:31.273 INFO:tasks.workunit.client.0.trial090.stderr:pool 'rbd' created 2026-02-17T04:46:31.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:32.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-17T04:46:32.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:172: TEST_skip_non_repair_during_recovery: wait_for_clean 2026-02-17T04:46:32.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:32.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:32.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:32.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:32.565 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:32.565 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:32.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:32.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:32.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:32.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:32.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:46:32.820 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:46:32.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:32.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:32.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:32.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-17T04:46:32.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-17T04:46:32.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-17T04:46:32.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:32.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:46:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T04:46:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T04:46:32.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705668' 2026-02-17T04:46:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:32.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-17T04:46:32.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:32.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-17T04:46:32.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:32.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-17T04:46:32.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-17T04:46:32.941 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836486 2026-02-17T04:46:32.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:33.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-17T04:46:33.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:34.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:34.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836486 2026-02-17T04:46:34.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:34.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T04:46:34.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:34.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:46:34.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T04:46:34.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:34.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T04:46:34.279 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705668 2026-02-17T04:46:34.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T04:46:34.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:46:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705668 2026-02-17T04:46:34.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:34.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:34.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:34.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:34.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:34.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:46:34.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:34.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:34.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:35.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:46:35.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:35.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:174: TEST_skip_non_repair_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:46:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:46:35.249 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:46:35.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:46:35.454 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:46:35.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:46:35.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:46:35.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:46:35.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:175: TEST_skip_non_repair_during_recovery: get_not_primary rbd SOMETHING 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:46:35.483 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:46:35.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:46:35.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-17T04:46:35.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:46:35.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:175: TEST_skip_non_repair_during_recovery: scrub_and_not_schedule td/osd-scrub-repair rbd 0 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:214: scrub_and_not_schedule: local dir=td/osd-scrub-repair 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:215: scrub_and_not_schedule: local poolname=rbd 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:216: scrub_and_not_schedule: local osd=0 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:221: scrub_and_not_schedule: get_pg rbd SOMETHING 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-17T04:46:35.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:46:35.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:221: scrub_and_not_schedule: local pg=1.3 2026-02-17T04:46:35.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:222: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:46:35.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:46:35.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:46:35.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:46:35.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:46:36.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:222: scrub_and_not_schedule: local last_scrub=2026-02-17T04:46:31.272088+0000 2026-02-17T04:46:36.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:223: scrub_and_not_schedule: ceph tell 1.3 schedule-scrub 2026-02-17T04:46:36.213 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:46:36.213 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:46:36.213 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:46:36.214 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:46:36.212876+0000" 2026-02-17T04:46:36.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:46:36.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:228: scrub_and_not_schedule: sleep 3 2026-02-17T04:46:39.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i=0 )) 2026-02-17T04:46:39.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-17T04:46:39.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:46:39.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:46:39.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:46:39.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:46:39.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:46:39.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-15T04:46:36.212876+0000 '>' 2026-02-17T04:46:31.272088+0000 2026-02-17T04:46:39.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-17T04:46:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-17T04:46:40.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-17T04:46:40.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:46:40.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:46:40.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:46:40.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:46:40.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:46:40.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-15T04:46:36.212876+0000 '>' 2026-02-17T04:46:31.272088+0000 2026-02-17T04:46:40.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-17T04:46:41.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-17T04:46:41.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-17T04:46:41.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-17T04:46:41.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-17T04:46:41.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:46:41.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:46:41.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-17T04:46:41.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-15T04:46:36.212876+0000 '>' 2026-02-17T04:46:31.272088+0000 2026-02-17T04:46:41.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-17T04:46:42.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-17T04:46:42.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-17T04:46:42.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:239: scrub_and_not_schedule: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:46:42.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:46:42.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:46:42.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:46:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:46:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:46:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:46:42.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-17T04:46:42.888 INFO:tasks.workunit.client.0.trial090.stdout:_ 2026-02-17T04:46:42.888 INFO:tasks.workunit.client.0.trial090.stdout:snapset 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:46:42.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:46:42.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:46:42.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:start osd.0 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:46:42.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:46:42.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:46:42.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:46:42.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:46:42.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:46:42.940 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:42.939+0000 7f288f083780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:42.942 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:42.940+0000 7f288f083780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:42.943 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:42.941+0000 7f288f083780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:43.063 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:43.061+0000 7f288f083780 -1 Falling back to public interface 2026-02-17T04:46:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:46:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:46:43.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:43.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:46:43.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:46:43.424 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:43.422+0000 7f288f083780 -1 osd.0 20 log_to_monitors true 2026-02-17T04:46:44.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:46:44.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:44.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:46:44.263 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:46:44.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:44.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 20 last_clean_interval [5,20) [v2:127.0.0.1:6800/1010792724,v1:127.0.0.1:6801/1010792724] [v2:127.0.0.1:6802/1010792724,v1:127.0.0.1:6803/1010792724] exists,up 89996537-ef61-4e7f-b0a7-c9f49a57d3ed 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:44.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:44.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:44.430 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:44.431 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:44.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:44.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:44.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:44.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:44.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:46:44.690 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:46:44.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:44.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:44.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:44.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247811 2026-02-17T04:46:44.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247811 2026-02-17T04:46:44.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811' 2026-02-17T04:46:44.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:44.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:46:44.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705681 2026-02-17T04:46:44.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705681 2026-02-17T04:46:44.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247811 1-38654705681' 2026-02-17T04:46:44.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:44.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247811 2026-02-17T04:46:44.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:44.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:44.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247811 2026-02-17T04:46:44.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:44.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247811 2026-02-17T04:46:44.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247811' 2026-02-17T04:46:44.814 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 98784247811 2026-02-17T04:46:44.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:44.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247811 2026-02-17T04:46:44.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:45.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:45.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:46.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247811 2026-02-17T04:46:46.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:46.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705681 2026-02-17T04:46:46.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:46.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:46:46.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705681 2026-02-17T04:46:46.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:46.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705681 2026-02-17T04:46:46.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705681' 2026-02-17T04:46:46.154 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705681 2026-02-17T04:46:46.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:46:46.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705682 -lt 38654705681 2026-02-17T04:46:46.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:46:46.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:46.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:46:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:46:46.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-17T04:46:46.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:46:46.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:46:46.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:46:46.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-17T04:46:46.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:46:46.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:46:46.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:240: scrub_and_not_schedule: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-17T04:46:46.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:241: scrub_and_not_schedule: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-17T04:46:46.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:46:46.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:46:46.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:46:46.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:46:46.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:46:46.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:46:46.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:46:46.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:46:46.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:46:47.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:46:47.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:46:47.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:46:47.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:46:47.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:46:47.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:46:47.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:46:47.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:47.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:46:47.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:46:47.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:47.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:46:47.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:46:47.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:46:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:46:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:46:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:46:47.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:46:47.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:46:47.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:46:47.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:46:47.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:46:47.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:46:47.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:46:47.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:46:47.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:47.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:46:47.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:46:47.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:46:47.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:46:47.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:46:47.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:46:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:46:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:46:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:46:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:46:47.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:46:47.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:46:47.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:46:47.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:46:47.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:46:47.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:46:47.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:46:47.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_unfound_erasure_coded_appends td/osd-scrub-repair 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:962: TEST_unfound_erasure_coded_appends: unfound_erasure_coded td/osd-scrub-repair false 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:911: unfound_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:912: unfound_erasure_coded: local allow_overwrites=false 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:913: unfound_erasure_coded: local poolname=ecpool 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:914: unfound_erasure_coded: local payload=ABCDEF 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:916: unfound_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:46:47.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:46:47.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:46:47.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:46:47.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:47.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:46:47.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:46:47.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:46:47.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:46:47.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:46:47.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:46:47.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:46:47.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:46:47.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:46:47.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:46:47.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:46:47.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:46:47.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:46:47.157 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:46:47.157 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:46:47.157 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:46:47.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:917: unfound_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:46:47.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:46:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:46:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:47.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:47.280 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:47.280 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.281 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:47.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:46:47.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:46:47.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: seq 0 3 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:46:47.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:47.302 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:46:47.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced 2026-02-17T04:46:47.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced' 2026-02-17T04:46:47.305 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced 2026-02-17T04:46:47.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:46:47.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC38pNp8+aPEhAAHVy0ndqOxAxsXgmTDcGpZQ== 2026-02-17T04:46:47.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC38pNp8+aPEhAAHVy0ndqOxAxsXgmTDcGpZQ=="}' 2026-02-17T04:46:47.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced -i td/osd-scrub-repair/0/new.json 2026-02-17T04:46:47.394 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:47.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:46:47.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC38pNp8+aPEhAAHVy0ndqOxAxsXgmTDcGpZQ== --osd-uuid c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced 2026-02-17T04:46:47.417 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.416+0000 7f4e50457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.419 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.417+0000 7f4e50457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.420 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.418+0000 7f4e50457780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.420 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.418+0000 7f4e50457780 -1 bdev(0x417ac00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:47.420 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.418+0000 7f4e50457780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:46:47.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:46:47.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:46:47.820 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:46:47.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:46:47.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:46:47.903 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:46:47.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:46:47.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:46:47.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:46:47.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:46:47.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:46:47.919 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.917+0000 7fd7d565e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.920 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.918+0000 7fd7d565e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.921 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:47.919+0000 7fd7d565e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:47.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:47.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:46:47.984 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:47.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:47.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:46:48.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:46:48.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:48.091+0000 7fd7d565e780 -1 Falling back to public interface 2026-02-17T04:46:48.514 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:48.512+0000 7fd7d565e780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:46:49.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:46:49.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:49.065 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:49.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:46:49.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:49.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:46:49.146 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3483474493,v1:127.0.0.1:6801/3483474493] [v2:127.0.0.1:6802/3483474493,v1:127.0.0.1:6803/3483474493] exists,up c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:46:49.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:46:49.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:46:49.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b98bdad-60e2-4371-a241-db0d71e5c272 2026-02-17T04:46:49.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0b98bdad-60e2-4371-a241-db0d71e5c272' 2026-02-17T04:46:49.155 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 0b98bdad-60e2-4371-a241-db0d71e5c272 2026-02-17T04:46:49.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:46:49.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC58pNpcayFCRAAY4ak2H5sTEgU/wvl1FDNCQ== 2026-02-17T04:46:49.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC58pNpcayFCRAAY4ak2H5sTEgU/wvl1FDNCQ=="}' 2026-02-17T04:46:49.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b98bdad-60e2-4371-a241-db0d71e5c272 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:46:49.240 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:49.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:46:49.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC58pNpcayFCRAAY4ak2H5sTEgU/wvl1FDNCQ== --osd-uuid 0b98bdad-60e2-4371-a241-db0d71e5c272 2026-02-17T04:46:49.263 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.261+0000 7f332cf3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.265 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.263+0000 7f332cf3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.265 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.264+0000 7f332cf3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.266 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.264+0000 7f332cf3d780 -1 bdev(0x3026c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:49.266 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.264+0000 7f332cf3d780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:46:49.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:46:49.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:46:49.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:46:49.627 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:46:49.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:46:49.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:46:49.839 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:46:49.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:46:49.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:46:49.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:46:49.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:46:49.853 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.852+0000 7f32d0419780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.855 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.853+0000 7f32d0419780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.856 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.854+0000 7f32d0419780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:49.990 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:49.988+0000 7f32d0419780 -1 Falling back to public interface 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:50.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:46:50.001 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:50.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:50.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:46:50.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:46:50.289 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:50.287+0000 7f32d0419780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:46:51.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:46:51.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:51.169 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:51.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:46:51.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:51.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:46:51.335 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4149974227,v1:127.0.0.1:6811/4149974227] [v2:127.0.0.1:6812/4149974227,v1:127.0.0.1:6813/4149974227] exists,up 0b98bdad-60e2-4371-a241-db0d71e5c272 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:46:51.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:51.339 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:46:51.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:46:51.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:46:51.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7bcc1041-c0be-4820-b9c0-ac7b5714af1c 2026-02-17T04:46:51.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7bcc1041-c0be-4820-b9c0-ac7b5714af1c' 2026-02-17T04:46:51.341 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 7bcc1041-c0be-4820-b9c0-ac7b5714af1c 2026-02-17T04:46:51.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:46:51.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC78pNpa63UFBAAkflp5HyEmWKhyyC5t0iIoQ== 2026-02-17T04:46:51.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC78pNpa63UFBAAkflp5HyEmWKhyyC5t0iIoQ=="}' 2026-02-17T04:46:51.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7bcc1041-c0be-4820-b9c0-ac7b5714af1c -i td/osd-scrub-repair/2/new.json 2026-02-17T04:46:51.513 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:46:51.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:46:51.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC78pNpa63UFBAAkflp5HyEmWKhyyC5t0iIoQ== --osd-uuid 7bcc1041-c0be-4820-b9c0-ac7b5714af1c 2026-02-17T04:46:51.539 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:51.537+0000 7fe67562c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:51.541 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:51.539+0000 7fe67562c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:51.542 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:51.540+0000 7fe67562c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:51.542 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:51.540+0000 7fe67562c780 -1 bdev(0x3b04c00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:51.542 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:51.540+0000 7fe67562c780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:46:51.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:46:51.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:46:51.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:46:51.866 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:46:51.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:46:52.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:46:52.079 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:46:52.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:46:52.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:46:52.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:46:52.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:46:52.094 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:52.092+0000 7fb173060780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:52.095 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:52.093+0000 7fb173060780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:52.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:52.094+0000 7fb173060780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:52.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:46:52.243 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:52.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:52.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:46:52.283 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:52.281+0000 7fb173060780 -1 Falling back to public interface 2026-02-17T04:46:52.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:46:52.591 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:52.589+0000 7fb173060780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:46:53.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:46:53.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:53.408 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:46:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:46:53.582 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2576984171,v1:127.0.0.1:6819/2576984171] [v2:127.0.0.1:6820/2576984171,v1:127.0.0.1:6821/2576984171] exists,up 7bcc1041-c0be-4820-b9c0-ac7b5714af1c 2026-02-17T04:46:53.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:46:53.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:46:53.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 3 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:46:53.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:46:53.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:46:53.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5aa5950e-1d43-4f75-b28a-9d2ab326e46c 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5aa5950e-1d43-4f75-b28a-9d2ab326e46c' 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 5aa5950e-1d43-4f75-b28a-9d2ab326e46c 2026-02-17T04:46:53.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:46:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC98pNpoQOGIxAA9lu70FaFoB6dr5kvTZCSjQ== 2026-02-17T04:46:53.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC98pNpoQOGIxAA9lu70FaFoB6dr5kvTZCSjQ=="}' 2026-02-17T04:46:53.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5aa5950e-1d43-4f75-b28a-9d2ab326e46c -i td/osd-scrub-repair/3/new.json 2026-02-17T04:46:53.761 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:46:53.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:46:53.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC98pNpoQOGIxAA9lu70FaFoB6dr5kvTZCSjQ== --osd-uuid 5aa5950e-1d43-4f75-b28a-9d2ab326e46c 2026-02-17T04:46:53.785 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:53.784+0000 7fe7f0885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:53.787 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:53.785+0000 7fe7f0885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:53.788 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:53.786+0000 7fe7f0885780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:53.788 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:53.786+0000 7fe7f0885780 -1 bdev(0x293cc00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:46:53.788 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:53.786+0000 7fe7f0885780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:46:54.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:46:54.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:46:54.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:46:54.107 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:46:54.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:46:54.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:46:54.330 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:46:54.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:46:54.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:46:54.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:46:54.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:46:54.344 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:54.342+0000 7fc2f2bdf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:54.346 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:54.344+0000 7fc2f2bdf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:54.347 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:54.344+0000 7fc2f2bdf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:46:54.468 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:54.466+0000 7fc2f2bdf780 -1 Falling back to public interface 2026-02-17T04:46:54.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:46:54.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:46:54.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:46:54.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:46:54.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:46:54.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:54.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:46:54.496 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:46:54.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:54.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:46:54.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:46:54.796 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:46:54.794+0000 7fc2f2bdf780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:46:55.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:46:55.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:46:55.660 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:46:55.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:46:55.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:46:55.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:46:55.824 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3414312917,v1:127.0.0.1:6827/3414312917] [v2:127.0.0.1:6828/3414312917,v1:127.0.0.1:6829/3414312917] exists,up 5aa5950e-1d43-4f75-b28a-9d2ab326e46c 2026-02-17T04:46:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:46:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:46:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:46:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:922: unfound_erasure_coded: create_ec_pool ecpool false k=2 m=2 2026-02-17T04:46:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:46:55.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:46:55.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-17T04:46:55.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:46:55.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-17T04:46:56.040 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:46:56.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:46:56.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:46:56.345 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:46:56.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:46:57.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:46:57.360 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:46:57.360 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:46:57.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:46:57.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:46:57.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:46:57.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:46:57.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:46:57.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:46:57.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:46:57.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:46:57.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:46:57.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:46:57.616 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:46:57.617 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:46:57.617 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:46:57.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:46:57.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:57.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:46:57.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:46:57.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:46:57.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:46:57.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:57.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:46:57.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-17T04:46:57.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-17T04:46:57.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-17T04:46:57.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:57.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:46:57.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509442 2026-02-17T04:46:57.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509442 2026-02-17T04:46:57.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509442' 2026-02-17T04:46:57.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:46:57.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:46:57.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378626 2026-02-17T04:46:57.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378626 2026-02-17T04:46:57.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509442 3-81604378626' 2026-02-17T04:46:57.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:46:57.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:46:57.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:46:57.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:46:57.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:46:57.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:46:57.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:46:57.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:46:57.858 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:46:57.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:58.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:46:58.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:46:59.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:46:59.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:46:59.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:46:59.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:00.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:47:00.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:00.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:47:00.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:00.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-17T04:47:00.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:00.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:00.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-17T04:47:00.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:00.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-17T04:47:00.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T04:47:00.363 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672963 2026-02-17T04:47:00.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:00.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T04:47:00.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:00.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509442 2026-02-17T04:47:00.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:00.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:00.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509442 2026-02-17T04:47:00.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:00.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509442 2026-02-17T04:47:00.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509442' 2026-02-17T04:47:00.537 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509442 2026-02-17T04:47:00.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:00.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509443 -lt 64424509442 2026-02-17T04:47:00.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:00.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378626 2026-02-17T04:47:00.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:00.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:00.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378626 2026-02-17T04:47:00.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:00.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378626 2026-02-17T04:47:00.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378626' 2026-02-17T04:47:00.708 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 81604378626 2026-02-17T04:47:00.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:00.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378626 -lt 81604378626 2026-02-17T04:47:00.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:00.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:00.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:01.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:01.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:01.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:01.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:01.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:01.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:01.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:01.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:01.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:01.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:01.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:01.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:01.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:924: unfound_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:47:01.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:47:01.681 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:47:01.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:47:01.885 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:47:01.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:47:01.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:47:01.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:47:01.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:47:01.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:47:01.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:47:01.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:01.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:47:02.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: local primary=1 2026-02-17T04:47:02.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:47:02.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:47:02.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:47:02.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: sed -e s/1// 2026-02-17T04:47:02.083 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:02.083 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:47:02.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:47:02.251 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:47:02.251 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:47:02.251 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:47:02.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 3 2026-02-17T04:47:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: osds=('0' '2' '3') 2026-02-17T04:47:02.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: local -a osds 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:928: unfound_erasure_coded: local not_primary_first=0 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:929: unfound_erasure_coded: local not_primary_second=2 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:930: unfound_erasure_coded: local not_primary_third=3 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:935: unfound_erasure_coded: pids= 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:936: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 829274"' 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 829274' 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:937: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 829275"' 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 829275' 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:938: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/829277: /' 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 829278"' 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 829278' 2026-02-17T04:47:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:939: unfound_erasure_coded: wait_background pids 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 829274 829275 829278' 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 829274 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/829280: /' 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/829284: /' 2026-02-17T04:47:02.723 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:02.724 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-17T04:47:02.725 INFO:tasks.workunit.client.0.trial090.stderr:829280: remove 2#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:02.726 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:02.727 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:02.727 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:02.727 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:47:02.727 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:02.728 INFO:tasks.workunit.client.0.trial090.stderr:829280: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:02.729 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:47:02.730 INFO:tasks.workunit.client.0.trial090.stderr:829280: start osd.2 2026-02-17T04:47:02.731 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.731 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:02.732 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: remove 3#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:02.733 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:02.734 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:02.735 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:47:02.736 INFO:tasks.workunit.client.0.trial090.stderr:829284: start osd.3 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:47:02.737 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:47:02.738 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: remove 1#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:02.739 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:02.740 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:02.741 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:47:02.742 INFO:tasks.workunit.client.0.trial090.stderr:829277: start osd.0 2026-02-17T04:47:04.243 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:04.243 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:47:04.243 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:47:04.243 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:04.243 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2026-02-17T04:47:02.743+0000 7fd4f6c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2026-02-17T04:47:02.744+0000 7fd4f6c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2026-02-17T04:47:02.745+0000 7fd4f6c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: 0 2026-02-17T04:47:04.244 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2026-02-17T04:47:02.963+0000 7fd4f6c39780 -1 Falling back to public interface 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2026-02-17T04:47:03.358+0000 7fd4f6c39780 -1 osd.3 26 log_to_monitors true 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: 1 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:04.245 INFO:tasks.workunit.client.0.trial090.stderr:829284: osd.3 up in weight 1 up_from 30 up_thru 0 down_at 27 last_clean_interval [19,26) [v2:127.0.0.1:6800/2560242184,v1:127.0.0.1:6801/2560242184] [v2:127.0.0.1:6802/2560242184,v1:127.0.0.1:6803/2560242184] exists,up 5aa5950e-1d43-4f75-b28a-9d2ab326e46c 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:04.246 INFO:tasks.workunit.client.0.trial090.stderr:829284: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829284: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2026-02-17T04:47:02.739+0000 7f5ab8c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2026-02-17T04:47:02.740+0000 7f5ab8c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.247 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2026-02-17T04:47:02.741+0000 7f5ab8c14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: 0 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2026-02-17T04:47:02.963+0000 7f5ab8c14780 -1 Falling back to public interface 2026-02-17T04:47:04.248 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2026-02-17T04:47:03.336+0000 7f5ab8c14780 -1 osd.2 26 log_to_monitors true 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: 1 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: osd.2 up in weight 1 up_from 30 up_thru 0 down_at 27 last_clean_interval [15,26) [v2:127.0.0.1:6804/4172435708,v1:127.0.0.1:6807/4172435708] [v2:127.0.0.1:6819/4172435708,v1:127.0.0.1:6821/4172435708] exists,up 7bcc1041-c0be-4820-b9c0-ac7b5714af1c 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:04.249 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:04.250 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:04.250 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:04.250 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:04.250 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:04.250 INFO:tasks.workunit.client.0.trial090.stderr:829280: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:04.258 INFO:tasks.workunit.client.0.trial090.stderr:829280: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-17T04:47:04.258 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:47:04.258 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:47:04.258 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2026-02-17T04:47:02.752+0000 7f812f04e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2026-02-17T04:47:02.753+0000 7f812f04e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2026-02-17T04:47:02.754+0000 7f812f04e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:04.259 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: 0 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2026-02-17T04:47:02.987+0000 7f812f04e780 -1 Falling back to public interface 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2026-02-17T04:47:03.370+0000 7f812f04e780 -1 osd.0 26 log_to_monitors true 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: 1 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:04.260 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: osd.0 up in weight 1 up_from 30 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6826/3277967201,v1:127.0.0.1:6827/3277967201] [v2:127.0.0.1:6828/3277967201,v1:127.0.0.1:6829/3277967201] exists,up c2f1ddc1-fbf6-4b66-aee5-fef8425e4ced 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:04.261 INFO:tasks.workunit.client.0.trial090.stderr:829277: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:04.754 INFO:tasks.workunit.client.0.trial090.stderr:829277: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593:: get_timeout_delays: echo true 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:04.755 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: 1 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: 2 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: 3' 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-17T04:47:04.756 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882' 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882 1-42949672966' 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018883 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018883 2026-02-17T04:47:04.757 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882 1-42949672966 2-128849018883' 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018883 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018883 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882 1-42949672966 2-128849018883 3-128849018883' 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:: get_timeout_delays: echo true 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:04.758 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: 1 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: 2 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: 3' 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:04.759 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018883 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018883 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883' 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883 1-42949672965' 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:04.760 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883 1-42949672965 2-128849018882' 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883 1-42949672965 2-128849018882 3-128849018882' 2026-02-17T04:47:04.761 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: get_timeout_delays: echo true 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:04.766 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: 1 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: 2 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: 3' 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.767 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018884' 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018884 1-42949672967' 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-17T04:47:04.768 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018884 1-42949672967 2-128849018884' 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018884 1-42949672967 2-128849018884 3-128849018884' 2026-02-17T04:47:04.769 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-128849018882 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018882 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 128849018882' 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: waiting osd.0 seq 128849018882 2026-02-17T04:47:06.454 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 128849018882 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018882 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.455 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: waiting osd.1 seq 42949672966 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-128849018883 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-128849018883 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018883 2026-02-17T04:47:06.456 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 128849018883' 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829284: waiting osd.2 seq 128849018883 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018883 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/ flush_pg_stats: echo 0-128849018883 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018883 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018883 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 128849018883' 2026-02-17T04:47:06.457 INFO:tasks.workunit.client.0.trial090.stderr:829280: waiting osd.0 seq 128849018883 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 128849018883 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018883 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.458 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: waiting osd.1 seq 42949672965 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672965 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-128849018882 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-128849018882 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-17T04:47:06.459 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 128849018882' 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829280: waiting osd.2 seq 128849018882 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018882 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/flush_pg_stats: echo 0-128849018884 2026-02-17T04:47:06.460 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018884 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018884 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 128849018884' 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: waiting osd.0 seq 128849018884 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 128849018884 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:06.461 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: waiting osd.1 seq 42949672967 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:06.462 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-128849018884 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-128849018884 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018884 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 128849018884' 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: waiting osd.2 seq 128849018884 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-17T04:47:06.463 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:07.223 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/ccephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-128849018882 2026-02-17T04:47:07.223 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:07.223 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:07.223 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-128849018882 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 128849018882' 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: waiting osd.3 seq 128849018882 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018882 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.224 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:07.225 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:829280: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:829280: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:07.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-128849018883 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-128849018883 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018883 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 128849018883' 2026-02-17T04:47:07.232 INFO:tasks.workunit.client.0.trial090.stderr:829284: waiting osd.3 seq 128849018883 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018883 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:07.233 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:829284: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:07.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:ephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-128849018884 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-128849018884 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018884 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 128849018884' 2026-02-17T04:47:07.237 INFO:tasks.workunit.client.0.trial090.stderr:829277: waiting osd.3 seq 128849018884 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:07.238 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:829277: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:07.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 829275 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 829278 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:940: unfound_erasure_coded: return_code=0 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:941: unfound_erasure_coded: '[' 0 -ne 0 ']' 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: get_pg ecpool SOMETHING 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:47:07.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:47:07.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:07.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:47:07.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: local pg=1.0 2026-02-17T04:47:07.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:947: unfound_erasure_coded: repair 1.0 2026-02-17T04:47:07.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T04:47:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T04:47:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:07.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:07.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T04:47:07.725 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:47:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:46:56.344015+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:07.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:08.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:08.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:08.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:08.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:08.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:08.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:08.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:46:56.344015+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:09.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:10.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:10.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:10.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:10.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:10.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:10.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:10.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:10.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:46:56.344015+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:10.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:11.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:11.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:11.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:11.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:11.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:11.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:11.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:11.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:46:56.344015+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:11.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:12.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:12.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:12.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:46:56.344015+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:12.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:13.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:13.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:13.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:13.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:13.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:13.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:13.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:13.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:08.471499+0000 '>' 2026-02-17T04:46:56.344015+0000 2026-02-17T04:47:13.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:47:13.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: seq 1 60 2026-02-17T04:47:13.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: for f in `seq 1 60` 2026-02-17T04:47:13.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: ceph -s 2026-02-17T04:47:13.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-17T04:47:13.944 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:13.945 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:13.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: break 2026-02-17T04:47:13.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: ceph -s 2026-02-17T04:47:13.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: grep '4 up' 2026-02-17T04:47:14.159 INFO:tasks.workunit.client.0.trial090.stdout: osd: 4 osds: 4 up (since 10s), 4 in (since 20s) 2026-02-17T04:47:14.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: ceph -s 2026-02-17T04:47:14.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: grep '4 in' 2026-02-17T04:47:14.370 INFO:tasks.workunit.client.0.trial090.stdout: osd: 4 osds: 4 up (since 10s), 4 in (since 20s) 2026-02-17T04:47:14.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: ceph -s 2026-02-17T04:47:14.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-17T04:47:14.575 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:14.576 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:14.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:14.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:14.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:14.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:14.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:14.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:47:14.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:47:14.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:47:14.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:47:14.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:47:14.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:47:14.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:14.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:47:14.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:47:14.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:14.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:47:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:47:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:47:14.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:47:14.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:14.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:14.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:14.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:47:14.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:47:14.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:47:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:47:14.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:47:14.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:47:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:47:14.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:47:14.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:14.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:47:14.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:47:14.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:47:14.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:47:14.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:47:14.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:47:14.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:47:14.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-17T04:47:14.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:47:14.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.430464 2026-02-17T04:47:14.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_unfound_erasure_coded_overwrites td/osd-scrub-repair 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:966: TEST_unfound_erasure_coded_overwrites: '[' true = true ']' 2026-02-17T04:47:14.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:967: TEST_unfound_erasure_coded_overwrites: unfound_erasure_coded td/osd-scrub-repair true 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:911: unfound_erasure_coded: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:912: unfound_erasure_coded: local allow_overwrites=true 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:913: unfound_erasure_coded: local poolname=ecpool 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:914: unfound_erasure_coded: local payload=ABCDEF 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:916: unfound_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-17T04:47:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-17T04:47:14.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:14.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T04:47:14.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:47:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:47:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:47:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:47:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:47:14.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:47:14.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:47:14.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get fsid 2026-02-17T04:47:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:47:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:47:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:47:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:47:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.814 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.430464/ceph-mon.a.asok 2026-02-17T04:47:14.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:47:14.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.430464/ceph-mon.a.asok config get mon_host 2026-02-17T04:47:14.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:917: unfound_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-17T04:47:14.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:47:14.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:47:14.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:47:14.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-17T04:47:14.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:47:14.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:47:14.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:14.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:14.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:14.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:14.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:47:14.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:47:14.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: seq 0 3 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:47:14.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:14.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:14.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:47:14.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:47:14.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6fc765f2-79df-4232-ba30-6f23ff85a056 2026-02-17T04:47:14.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6fc765f2-79df-4232-ba30-6f23ff85a056' 2026-02-17T04:47:14.967 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 6fc765f2-79df-4232-ba30-6f23ff85a056 2026-02-17T04:47:14.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:47:14.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDS8pNpEqP4ORAAeqnZWwHbYvzZDwNlP/ub5g== 2026-02-17T04:47:14.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDS8pNpEqP4ORAAeqnZWwHbYvzZDwNlP/ub5g=="}' 2026-02-17T04:47:14.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6fc765f2-79df-4232-ba30-6f23ff85a056 -i td/osd-scrub-repair/0/new.json 2026-02-17T04:47:15.054 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:15.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-17T04:47:15.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDS8pNpEqP4ORAAeqnZWwHbYvzZDwNlP/ub5g== --osd-uuid 6fc765f2-79df-4232-ba30-6f23ff85a056 2026-02-17T04:47:15.077 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.075+0000 7f5da7a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.079 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.077+0000 7f5da7a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.077+0000 7f5da7a43780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.077+0000 7f5da7a43780 -1 bdev(0x3702c00 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:47:15.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.078+0000 7f5da7a43780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-17T04:47:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-17T04:47:15.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:47:15.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:47:15.497 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:47:15.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:47:15.581 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:47:15.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:47:15.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:47:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:47:15.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:47:15.597 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.595+0000 7f7969a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.598 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.596+0000 7f7969a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.599 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.597+0000 7f7969a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:15.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:15.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:15.799 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:15.798+0000 7f7969a0c780 -1 Falling back to public interface 2026-02-17T04:47:16.172 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.170+0000 7f7969a0c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:47:16.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:16.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:16.743 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:16.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:16.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:16.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:16.821 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2133117776,v1:127.0.0.1:6801/2133117776] [v2:127.0.0.1:6802/2133117776,v1:127.0.0.1:6803/2133117776] exists,up 6fc765f2-79df-4232-ba30-6f23ff85a056 2026-02-17T04:47:16.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:16.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:16.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:16.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:47:16.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=51d708f4-ae12-490b-b3ec-4de02ae4aff7 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 51d708f4-ae12-490b-b3ec-4de02ae4aff7' 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 51d708f4-ae12-490b-b3ec-4de02ae4aff7 2026-02-17T04:47:16.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:47:16.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDU8pNpcAnAMRAAwLaJlKBIrzqk2tDdVbUF0g== 2026-02-17T04:47:16.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDU8pNpcAnAMRAAwLaJlKBIrzqk2tDdVbUF0g=="}' 2026-02-17T04:47:16.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 51d708f4-ae12-490b-b3ec-4de02ae4aff7 -i td/osd-scrub-repair/1/new.json 2026-02-17T04:47:16.917 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:16.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-17T04:47:16.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDU8pNpcAnAMRAAwLaJlKBIrzqk2tDdVbUF0g== --osd-uuid 51d708f4-ae12-490b-b3ec-4de02ae4aff7 2026-02-17T04:47:16.941 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.939+0000 7fcf08c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:16.942 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.940+0000 7fcf08c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:16.943 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.941+0000 7fcf08c31780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:16.943 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.941+0000 7fcf08c31780 -1 bdev(0x3e40c00 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:47:16.943 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:16.941+0000 7fcf08c31780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-17T04:47:17.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-17T04:47:17.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:47:17.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:47:17.299 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:47:17.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:47:17.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:47:17.509 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:47:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:47:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:47:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:47:17.524 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:17.522+0000 7f4095233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:17.525 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:17.525+0000 7f4095233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:17.526 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:17.525+0000 7f4095233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:17.656 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:17.654+0000 7f4095233780 -1 Falling back to public interface 2026-02-17T04:47:17.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:17.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:17.675 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:17.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:17.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:47:17.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:17.980 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:17.979+0000 7f4095233780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:47:18.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:18.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:18.838 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:18.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:18.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:18.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:47:19.004 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2431472702,v1:127.0.0.1:6811/2431472702] [v2:127.0.0.1:6812/2431472702,v1:127.0.0.1:6813/2431472702] exists,up 51d708f4-ae12-490b-b3ec-4de02ae4aff7 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:47:19.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:19.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:47:19.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:47:19.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:47:19.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=531e8e8d-5c06-499b-b0bf-73849adb2375 2026-02-17T04:47:19.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 531e8e8d-5c06-499b-b0bf-73849adb2375' 2026-02-17T04:47:19.009 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 531e8e8d-5c06-499b-b0bf-73849adb2375 2026-02-17T04:47:19.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:47:19.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDX8pNptYgVARAAAc7J5pjPklVYp0UPFifcVw== 2026-02-17T04:47:19.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDX8pNptYgVARAAAc7J5pjPklVYp0UPFifcVw=="}' 2026-02-17T04:47:19.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 531e8e8d-5c06-499b-b0bf-73849adb2375 -i td/osd-scrub-repair/2/new.json 2026-02-17T04:47:19.183 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:47:19.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-17T04:47:19.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDX8pNptYgVARAAAc7J5pjPklVYp0UPFifcVw== --osd-uuid 531e8e8d-5c06-499b-b0bf-73849adb2375 2026-02-17T04:47:19.209 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.208+0000 7fc73abd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.210 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.210+0000 7fc73abd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.211 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.210+0000 7fc73abd6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.212 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.211+0000 7fc73abd6780 -1 bdev(0x34bcc00 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:47:19.212 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.211+0000 7fc73abd6780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-17T04:47:19.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-17T04:47:19.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:47:19.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:47:19.523 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:47:19.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:47:19.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:47:19.732 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:47:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:47:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:47:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:47:19.745 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.745+0000 7f7ff71d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.747 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.746+0000 7f7ff71d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.748 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.747+0000 7f7ff71d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:19.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:47:19.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:19.897 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:19.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:19.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:19.927 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:19.926+0000 7f7ff71d8780 -1 Falling back to public interface 2026-02-17T04:47:20.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:20.260 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:20.259+0000 7f7ff71d8780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:47:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:21.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:21.060 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:21.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:21.229 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4199440718,v1:127.0.0.1:6819/4199440718] [v2:127.0.0.1:6820/4199440718,v1:127.0.0.1:6821/4199440718] exists,up 531e8e8d-5c06-499b-b0bf-73849adb2375 2026-02-17T04:47:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-17T04:47:21.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 3 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:47:21.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:47:21.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:47:21.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:47:21.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=99371e41-05da-404f-9cfa-d90a5bd186ea 2026-02-17T04:47:21.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 99371e41-05da-404f-9cfa-d90a5bd186ea' 2026-02-17T04:47:21.237 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 99371e41-05da-404f-9cfa-d90a5bd186ea 2026-02-17T04:47:21.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:47:21.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDZ8pNpnOh8DhAAnqMEo9mkuoQQszwrPOrSUA== 2026-02-17T04:47:21.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDZ8pNpnOh8DhAAnqMEo9mkuoQQszwrPOrSUA=="}' 2026-02-17T04:47:21.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 99371e41-05da-404f-9cfa-d90a5bd186ea -i td/osd-scrub-repair/3/new.json 2026-02-17T04:47:21.407 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:47:21.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-17T04:47:21.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZ8pNpnOh8DhAAnqMEo9mkuoQQszwrPOrSUA== --osd-uuid 99371e41-05da-404f-9cfa-d90a5bd186ea 2026-02-17T04:47:21.431 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.431+0000 7fc409012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:21.433 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.432+0000 7fc409012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:21.433 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.433+0000 7fc409012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:21.434 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.433+0000 7fc409012780 -1 bdev(0x28e2c00 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:47:21.434 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.433+0000 7fc409012780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-17T04:47:21.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-17T04:47:21.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:47:21.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T04:47:21.747 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:47:21.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:47:21.961 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:47:21.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T04:47:21.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:47:21.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:21.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:47:21.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:47:21.976 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.975+0000 7f8a36255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:21.978 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.977+0000 7f8a36255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:21.979 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:21.978+0000 7f8a36255780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:22.107 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:22.106+0000 7f8a36255780 -1 Falling back to public interface 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:22.127 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:22.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:22.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:22.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:22.389 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:22.388+0000 7f8a36255780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:47:23.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:23.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:23.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:23.295 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:23.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:23.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:23.460 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2698698845,v1:127.0.0.1:6827/2698698845] [v2:127.0.0.1:6828/2698698845,v1:127.0.0.1:6829/2698698845] exists,up 99371e41-05da-404f-9cfa-d90a5bd186ea 2026-02-17T04:47:23.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:922: unfound_erasure_coded: create_ec_pool ecpool true k=2 m=2 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T04:47:23.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-17T04:47:23.677 INFO:tasks.workunit.client.0.trial090.stderr:load: isa 2026-02-17T04:47:23.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-17T04:47:23.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-17T04:47:23.984 INFO:tasks.workunit.client.0.trial090.stderr:pool 'ecpool' created 2026-02-17T04:47:23.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:47:24.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T04:47:24.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-17T04:47:25.193 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 allow_ec_overwrites to true 2026-02-17T04:47:25.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T04:47:25.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:25.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:25.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:25.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:25.204 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:25.204 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:47:25.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:25.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:25.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:25.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:25.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:25.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:25.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:25.463 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:47:25.463 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:47:25.463 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:47:25.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:25.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:25.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:25.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T04:47:25.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T04:47:25.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T04:47:25.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:25.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:25.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-17T04:47:25.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-17T04:47:25.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-17T04:47:25.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:25.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:25.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-17T04:47:25.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-17T04:47:25.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443' 2026-02-17T04:47:25.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:25.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345922 2026-02-17T04:47:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345922 2026-02-17T04:47:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509443 3-85899345922' 2026-02-17T04:47:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:25.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T04:47:25.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:25.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:25.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T04:47:25.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:25.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T04:47:25.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T04:47:25.707 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T04:47:25.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:47:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:26.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:26.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:27.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-17T04:47:27.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:28.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:47:28.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:28.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T04:47:28.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:28.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-17T04:47:28.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:28.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:28.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-17T04:47:28.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:28.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-17T04:47:28.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-17T04:47:28.211 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672963 2026-02-17T04:47:28.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:28.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672963 2026-02-17T04:47:28.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:28.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-17T04:47:28.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:28.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:28.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-17T04:47:28.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:28.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-17T04:47:28.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-17T04:47:28.382 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509443 2026-02-17T04:47:28.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:28.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509443 2026-02-17T04:47:28.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:28.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-85899345922 2026-02-17T04:47:28.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:28.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-85899345922 2026-02-17T04:47:28.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:28.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345922 2026-02-17T04:47:28.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 85899345922' 2026-02-17T04:47:28.556 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 85899345922 2026-02-17T04:47:28.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:28.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345922 -lt 85899345922 2026-02-17T04:47:28.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:28.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:28.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:28.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:28.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:29.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:29.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:29.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:29.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:924: unfound_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-17T04:47:29.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-17T04:47:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-17T04:47:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-17T04:47:29.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-17T04:47:29.536 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:47:29.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-17T04:47:29.741 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:47:29.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-17T04:47:29.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-17T04:47:29.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-17T04:47:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: get_primary ecpool SOMETHING 2026-02-17T04:47:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-17T04:47:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T04:47:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:29.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:47:29.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: local primary=1 2026-02-17T04:47:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: get_osds ecpool SOMETHING 2026-02-17T04:47:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: sed -e s/1// 2026-02-17T04:47:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-17T04:47:29.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-17T04:47:29.940 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:29.940 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:2 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:3' 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 3 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: osds=('0' '2' '3') 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: local -a osds 2026-02-17T04:47:30.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:928: unfound_erasure_coded: local not_primary_first=0 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:929: unfound_erasure_coded: local not_primary_second=2 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:930: unfound_erasure_coded: local not_primary_third=3 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:935: unfound_erasure_coded: pids= 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:936: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 839886"' 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 839886' 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:937: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:30.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 839887"' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 839887' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:938: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/839889: /' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 839890"' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 839890' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:939: unfound_erasure_coded: wait_background pids 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 839886 839887 839890' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 839886 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/839892: /' 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:30.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/839895: /' 2026-02-17T04:47:30.375 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.375 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:30.375 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.376 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: remove 3#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:30.377 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:30.378 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:30.379 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:30.380 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-17T04:47:30.380 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T04:47:30.380 INFO:tasks.workunit.client.0.trial090.stderr:839895: start osd.3 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.381 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: remove 1#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:30.382 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:30.383 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:30.384 INFO:tasks.workunit.client.0.trial090.stderr:839889: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:47:30.385 INFO:tasks.workunit.client.0.trial090.stderr:839889: start osd.0 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.394 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-17T04:47:30.395 INFO:tasks.workunit.client.0.trial090.stderr:839892: remove 2#1:eb822e21:::SOMETHING:head# 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:30.396 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:30.397 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T04:47:30.398 INFO:tasks.workunit.client.0.trial090.stderr:839892: start osd.2 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=adc2624f-fdd4-4f31-b40c-585c63474a5c --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.430464/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2026-02-17T04:47:30.392+0000 7fcefde57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2026-02-17T04:47:30.393+0000 7fcefde57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2026-02-17T04:47:30.394+0000 7fcefde57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.890 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: 0 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2026-02-17T04:47:30.599+0000 7fcefde57780 -1 Falling back to public interface 2026-02-17T04:47:31.891 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2026-02-17T04:47:31.025+0000 7fcefde57780 -1 osd.3 29 log_to_monitors true 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: 1 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: osd.3 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [20,29) [v2:127.0.0.1:6818/1314060480,v1:127.0.0.1:6819/1314060480] [v2:127.0.0.1:6820/1314060480,v1:127.0.0.1:6821/1314060480] exists,up 99371e41-05da-404f-9cfa-d90a5bd186ea 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:31.892 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:31.893 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:31.893 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:31.893 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:31.893 INFO:tasks.workunit.client.0.trial090.stderr:839895: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:31.897 INFO:tasks.workunit.client.0.trial090.stderr:839895: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2026-02-17T04:47:30.398+0000 7f7a66a36780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2026-02-17T04:47:30.399+0000 7f7a66a36780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2026-02-17T04:47:30.400+0000 7f7a66a36780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:31.898 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: 0 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2026-02-17T04:47:30.609+0000 7f7a66a36780 -1 Falling back to public interface 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2026-02-17T04:47:31.030+0000 7f7a66a36780 -1 osd.0 29 log_to_monitors true 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:31.899 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: 1 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: osd.0 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6826/570132342,v1:127.0.0.1:6827/570132342] [v2:127.0.0.1:6828/570132342,v1:127.0.0.1:6829/570132342] exists,up 6fc765f2-79df-4232-ba30-6f23ff85a056 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:31.900 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:31.901 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:31.901 INFO:tasks.workunit.client.0.trial090.stderr:839889: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:31.908 INFO:tasks.workunit.client.0.trial090.stderr:839889: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: getps 2026-02-17T04:47:31.908 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-17T04:47:31.908 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T04:47:31.908 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2026-02-17T04:47:30.410+0000 7f5974e25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2026-02-17T04:47:30.411+0000 7f5974e25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2026-02-17T04:47:30.412+0000 7f5974e25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.909 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: 0 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2026-02-17T04:47:30.589+0000 7f5974e25780 -1 Falling back to public interface 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2026-02-17T04:47:30.992+0000 7f5974e25780 -1 osd.2 29 log_to_monitors true 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: 1 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:47:31.910 INFO:tasks.workunit.client.0.trial090.stderr:839892: osd.2 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [15,29) [v2:127.0.0.1:6800/2125664560,v1:127.0.0.1:6801/2125664560] [v2:127.0.0.1:6802/2125664560,v1:127.0.0.1:6803/2125664560] exists,up 531e8e8d-5c06-499b-b0bf-73849adb2375 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:31.911 INFO:tasks.workunit.client.0.trial090.stderr:839892: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:32.399 INFO:tasks.workunit.client.0.trial090.stderr:839892: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: 1 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: 2 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: 3' 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770' 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770 1-42949672965' 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770 1-42949672965 2-141733920770' 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920770 1-42949672965 2-141733920770 3-141733920770' 2026-02-17T04:47:32.400 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:_timeout_delays: echo true 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: 1 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: 2 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: 3' 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771' 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771 1-42949672966' 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771 1-42949672966 2-141733920771' 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-17T04:47:32.401 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-17T04:47:32.402 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771 1-42949672966 2-141733920771 3-141733920771' 2026-02-17T04:47:32.402 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flus: get_timeout_delays: echo true 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: 1 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: 2 2026-02-17T04:47:32.417 INFO:tasks.workunit.client.0.trial090.stderr:839892: 3' 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920772' 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920772 1-42949672967' 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.418 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920772 1-42949672967 2-141733920772' 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920772 1-42949672967 2-141733920772 3-141733920772' 2026-02-17T04:47:32.419 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.093 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-141733920770 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920770 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920770' 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: waiting osd.0 seq 141733920770 2026-02-17T04:47:34.094 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 141733920770 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920770 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-17T04:47:34.095 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: waiting osd.1 seq 42949672965 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672965 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-141733920770 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-141733920770 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 141733920770' 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: waiting osd.2 seq 141733920770 2026-02-17T04:47:34.096 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:34.097 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920770 2026-02-17T04:47:34.097 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.098 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/h_pg_stats: echo 0-141733920771 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920771 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: waiting osd.0 seq 141733920771 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 141733920771 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:34.099 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920771 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: waiting osd.1 seq 42949672966 2026-02-17T04:47:34.100 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-141733920771 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-141733920771 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.101 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920771 2026-02-17T04:47:34.102 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 141733920771' 2026-02-17T04:47:34.102 INFO:tasks.workunit.client.0.trial090.stderr:839889: waiting osd.2 seq 141733920771 2026-02-17T04:47:34.102 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:34.102 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920771 2026-02-17T04:47:34.102 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.111 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cepht flush_pg_stats: echo 0-141733920772 2026-02-17T04:47:34.111 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.111 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:34.111 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920772 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920772 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920772' 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: waiting osd.0 seq 141733920772 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 141733920772 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-17T04:47:34.112 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: waiting osd.1 seq 42949672967 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-141733920772 2026-02-17T04:47:34.113 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-141733920772 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920772 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 141733920772' 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: waiting osd.2 seq 141733920772 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-17T04:47:34.114 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/est/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-141733920771 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-141733920771 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920771 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 141733920771' 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: waiting osd.3 seq 141733920771 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920771 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.873 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:839889: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:34.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 839887 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-141733920770 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-141733920770 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 141733920770' 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: waiting osd.3 seq 141733920770 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920770 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:34.877 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:839895: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:34.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-141733920772 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-141733920772 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920772 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 141733920772' 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: waiting osd.3 seq 141733920772 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:34.888 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:34.889 INFO:tasks.workunit.client.0.trial090.stderr:839892: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 839890 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:940: unfound_erasure_coded: return_code=0 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:941: unfound_erasure_coded: '[' 0 -ne 0 ']' 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: get_pg ecpool SOMETHING 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-17T04:47:34.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: local pg=1.0 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:947: unfound_erasure_coded: repair 1.0 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:35.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:35.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:35.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:35.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:35.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T04:47:35.387 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-17T04:47:35.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:35.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:47:35.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:35.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:47:35.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:35.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:35.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:23.981641+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:35.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:36.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:36.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:36.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:36.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:36.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:36.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:36.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:36.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:23.981641+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:36.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:37.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:37.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:37.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:37.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:37.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:37.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:37.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:37.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:23.981641+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:37.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:38.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:38.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:38.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:38.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:38.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:38.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:38.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:39.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:23.981641+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:39.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:40.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:40.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:40.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:40.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:40.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:40.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:40.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:40.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:23.981641+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:40.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:47:41.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:47:41.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:47:41.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:47:41.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:47:41.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:47:41.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:47:41.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:47:41.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:36.066251+0000 '>' 2026-02-17T04:47:23.981641+0000 2026-02-17T04:47:41.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:47:41.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: seq 1 60 2026-02-17T04:47:41.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: for f in `seq 1 60` 2026-02-17T04:47:41.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: ceph -s 2026-02-17T04:47:41.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-17T04:47:41.618 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:41.618 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:41.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: break 2026-02-17T04:47:41.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: ceph -s 2026-02-17T04:47:41.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: grep '4 up' 2026-02-17T04:47:41.828 INFO:tasks.workunit.client.0.trial090.stdout: osd: 4 osds: 4 up (since 10s), 4 in (since 20s) 2026-02-17T04:47:41.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: ceph -s 2026-02-17T04:47:41.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: grep '4 in' 2026-02-17T04:47:42.036 INFO:tasks.workunit.client.0.trial090.stdout: osd: 4 osds: 4 up (since 10s), 4 in (since 20s) 2026-02-17T04:47:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: ceph -s 2026-02-17T04:47:42.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stdout: 1/1 objects unfound (100.000%) 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:42.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:42.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:42.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:42.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:42.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:42.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:47:42.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:47:42.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:47:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:47:42.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:47:42.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:47:42.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:47:42.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:47:42.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:47:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:47:42.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:47:42.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:47:42.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:42.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:47:42.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:47:42.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:47:42.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-repair 0 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:42.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:42.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:42.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:47:42.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:47:42.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:47:42.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:47:42.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:47:42.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:47:42.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:47:42.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:47:42.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:47:42.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T04:47:42.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.430464 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.430464 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:47:42.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:47:42.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T04:47:42.386 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T04:47:42.386 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:47:42.413 INFO:tasks.workunit:Running workunit scrub/osd-scrub-snaps.sh... 2026-02-17T04:47:42.413 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-scrub-snaps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh 2026-02-17T04:47:42.474 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-snaps 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:27: run: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:28: run: shift 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:30: run: export CEPH_MON=127.0.0.1:7121 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:30: run: CEPH_MON=127.0.0.1:7121 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:31: run: export CEPH_ARGS 2026-02-17T04:47:42.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:32: run: uuidgen 2026-02-17T04:47:42.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:32: run: CEPH_ARGS+='--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none ' 2026-02-17T04:47:42.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:33: run: CEPH_ARGS+='--mon-host=127.0.0.1:7121 ' 2026-02-17T04:47:42.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:35: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:47:42.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: set 2026-02-17T04:47:42.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: local 'funcs=TEST_scrub_snaps 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_snaps_primary 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_snaps_replica' 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:42.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:42.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:42.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:42.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:47:42.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:47:42.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:47:42.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:47:42.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:47:42.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:47:42.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:47:42.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:47:42.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:47:42.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:47:42.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:47:42.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:47:42.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:47:42.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:47:42.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:47:42.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:47:42.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-17T04:47:42.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:47:42.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.844249 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-17T04:47:42.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps td/osd-scrub-snaps 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:169: TEST_scrub_snaps: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:170: TEST_scrub_snaps: local poolname=test 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:171: TEST_scrub_snaps: local OBJS=16 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:172: TEST_scrub_snaps: local OSDS=1 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:174: TEST_scrub_snaps: TESTDATA=testdata.844249 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:176: TEST_scrub_snaps: run_mon td/osd-scrub-snaps a --osd_pool_default_size=1 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-17T04:47:42.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=1 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:42.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2026-02-17T04:47:42.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:47:42.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:47:42.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.536 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.537 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:47:42.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:47:42.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get fsid 2026-02-17T04:47:42.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:47:42.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:47:42.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:47:42.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:47:42.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get mon_host 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:177: TEST_scrub_snaps: run_mgr td/osd-scrub-snaps x 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-17T04:47:42.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:47:42.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:47:42.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:42.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:42.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:42.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.706 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:42.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:47:42.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:47:42.721 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: expr 1 - 1 2026-02-17T04:47:42.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: seq 0 0 2026-02-17T04:47:42.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:47:42.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:180: TEST_scrub_snaps: run_osd td/osd-scrub-snaps 0 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:47:42.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:42.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:47:42.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a70f2c45-0944-4135-b779-42094864e33d 2026-02-17T04:47:42.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a70f2c45-0944-4135-b779-42094864e33d' 2026-02-17T04:47:42.730 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a70f2c45-0944-4135-b779-42094864e33d 2026-02-17T04:47:42.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:47:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDu8pNpsHK3KxAA1dLtyWH6rAKDbomSs1ut6w== 2026-02-17T04:47:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDu8pNpsHK3KxAA1dLtyWH6rAKDbomSs1ut6w=="}' 2026-02-17T04:47:42.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a70f2c45-0944-4135-b779-42094864e33d -i td/osd-scrub-snaps/0/new.json 2026-02-17T04:47:42.817 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:42.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-17T04:47:42.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDu8pNpsHK3KxAA1dLtyWH6rAKDbomSs1ut6w== --osd-uuid a70f2c45-0944-4135-b779-42094864e33d 2026-02-17T04:47:42.838 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:42.836+0000 7fd65b210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:42.840 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:42.838+0000 7fd65b210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:42.841 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:42.839+0000 7fd65b210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:42.841 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:42.839+0000 7fd65b210780 -1 bdev(0x3b9ac00 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:47:42.841 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:42.839+0000 7fd65b210780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-17T04:47:43.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-17T04:47:43.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:47:43.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:47:43.233 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:47:43.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:47:43.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:47:43.314 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:47:43.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:43.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:47:43.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:47:43.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:47:43.327 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:43.325+0000 7f9c6c243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:43.328 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:43.326+0000 7f9c6c243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:43.329 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:43.327+0000 7f9c6c243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:43.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:43.394 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:43.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:43.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:43.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:43.533 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:43.531+0000 7f9c6c243780 -1 Falling back to public interface 2026-02-17T04:47:43.943 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:43.941+0000 7f9c6c243780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:47:44.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:44.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:44.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:44.474 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:44.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:44.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:44.552 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1458923502,v1:127.0.0.1:6801/1458923502] [v2:127.0.0.1:6802/1458923502,v1:127.0.0.1:6803/1458923502] exists,up a70f2c45-0944-4135-b779-42094864e33d 2026-02-17T04:47:44.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:44.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:44.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:44.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:184: TEST_scrub_snaps: ceph osd set noscrub 2026-02-17T04:47:44.725 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:47:44.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:185: TEST_scrub_snaps: ceph osd set nodeep-scrub 2026-02-17T04:47:44.867 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:47:44.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:188: TEST_scrub_snaps: create_pool test 1 1 2026-02-17T04:47:44.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:47:45.068 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:47:45.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:47:46.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:189: TEST_scrub_snaps: wait_for_clean 2026-02-17T04:47:46.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:46.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:46.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:46.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:46.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:46.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:47:46.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:46.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:46.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:46.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:46.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:47:46.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:46.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:46.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:46.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:47:46.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:47:46.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:47:46.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:46.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:47:46.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:46.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:46.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:47:46.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:46.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:47:46.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:47:46.387 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:47:46.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:46.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:47:46.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:47.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:47.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:47.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:47:47.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:47.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:47.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:47.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:48.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:48.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:48.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:48.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: ceph osd dump 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: grep '^pool.*['\'']test['\'']' 2026-02-17T04:47:48.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: awk '{ print $2 }' 2026-02-17T04:47:48.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: poolid=1 2026-02-17T04:47:48.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:192: TEST_scrub_snaps: dd if=/dev/urandom of=testdata.844249 bs=1032 count=1 2026-02-17T04:47:48.464 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:47:48.464 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:47:48.464 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.5166e-05 s, 29.3 MB/s 2026-02-17T04:47:48.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: seq 1 16 2026-02-17T04:47:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj1 testdata.844249 2026-02-17T04:47:48.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj2 testdata.844249 2026-02-17T04:47:48.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj3 testdata.844249 2026-02-17T04:47:48.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj4 testdata.844249 2026-02-17T04:47:48.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj5 testdata.844249 2026-02-17T04:47:48.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj6 testdata.844249 2026-02-17T04:47:48.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj7 testdata.844249 2026-02-17T04:47:48.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj8 testdata.844249 2026-02-17T04:47:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj9 testdata.844249 2026-02-17T04:47:48.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj10 testdata.844249 2026-02-17T04:47:48.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj11 testdata.844249 2026-02-17T04:47:48.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj12 testdata.844249 2026-02-17T04:47:48.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj13 testdata.844249 2026-02-17T04:47:48.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj14 testdata.844249 2026-02-17T04:47:48.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj15 testdata.844249 2026-02-17T04:47:48.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-17T04:47:48.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj16 testdata.844249 2026-02-17T04:47:48.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:198: TEST_scrub_snaps: get_primary test obj1 2026-02-17T04:47:48.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:47:48.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:47:48.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:47:48.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:47:48.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:198: TEST_scrub_snaps: local primary=0 2026-02-17T04:47:48.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:200: TEST_scrub_snaps: create_scenario td/osd-scrub-snaps test testdata.844249 0 2026-02-17T04:47:48.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-17T04:47:48.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-17T04:47:48.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.844249 2026-02-17T04:47:48.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=0 2026-02-17T04:47:48.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-17T04:47:48.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-17T04:47:48.902 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap1 2026-02-17T04:47:48.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=1 2026-02-17T04:47:48.904 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:47:48.904 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:47:48.905 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 5.7747e-05 s, 4.4 MB/s 2026-02-17T04:47:48.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.844249 2026-02-17T04:47:48.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:47:48.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:47:48.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-17T04:47:48.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:48.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.844249 2026-02-17T04:47:48.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:48.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.844249 2026-02-17T04:47:48.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:48.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.844249 2026-02-17T04:47:49.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.844249 2026-02-17T04:47:49.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.844249 2026-02-17T04:47:49.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.844249 2026-02-17T04:47:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.844249 2026-02-17T04:47:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.844249 2026-02-17T04:47:49.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:47:49.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.844249 2026-02-17T04:47:49.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-17T04:47:49.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-17T04:47:49.159 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap2 2026-02-17T04:47:49.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=2 2026-02-17T04:47:49.161 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records in 2026-02-17T04:47:49.161 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records out 2026-02-17T04:47:49.161 INFO:tasks.workunit.client.0.trial090.stderr:512 bytes copied, 6.6023e-05 s, 7.8 MB/s 2026-02-17T04:47:49.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:47:49.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-17T04:47:49.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-17T04:47:49.262 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap3 2026-02-17T04:47:49.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=3 2026-02-17T04:47:49.266 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records in 2026-02-17T04:47:49.266 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records out 2026-02-17T04:47:49.266 INFO:tasks.workunit.client.0.trial090.stderr:768 bytes copied, 7.8866e-05 s, 9.7 MB/s 2026-02-17T04:47:49.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:47:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-17T04:47:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-17T04:47:49.362 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap4 2026-02-17T04:47:49.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=4 2026-02-17T04:47:49.366 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records in 2026-02-17T04:47:49.366 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records out 2026-02-17T04:47:49.366 INFO:tasks.workunit.client.0.trial090.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 8.4998e-05 s, 12.0 MB/s 2026-02-17T04:47:49.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:47:49.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.844249 2026-02-17T04:47:49.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-17T04:47:49.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-17T04:47:49.465 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap5 2026-02-17T04:47:49.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-17T04:47:49.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-17T04:47:49.566 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap6 2026-02-17T04:47:49.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=6 2026-02-17T04:47:49.571 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records in 2026-02-17T04:47:49.571 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records out 2026-02-17T04:47:49.571 INFO:tasks.workunit.client.0.trial090.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 6.4179e-05 s, 23.9 MB/s 2026-02-17T04:47:49.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:47:49.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-17T04:47:49.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-17T04:47:49.668 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap7 2026-02-17T04:47:49.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-17T04:47:49.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-17T04:47:49.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-17T04:47:49.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-17T04:47:49.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:47:49.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:47:49.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:47:49.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:47:49.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:47:49.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:47:49.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj1 2026-02-17T04:47:49.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:49.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-17T04:47:50.024 INFO:tasks.workunit.client.0.trial090.stdout:WARNING: only removing head with clones present 2026-02-17T04:47:50.024 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:47:50.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:47:50.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-17T04:47:50.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:50.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:47:50.226 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:2# 2026-02-17T04:47:50.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:47:50.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-17T04:47:50.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:50.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:50.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:47:50.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:47:50.470 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.471 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:50.472 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.473 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.474 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.474 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:47:50.474 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:50.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:47:50.567 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:1# 2026-02-17T04:47:50.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:47:50.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:47:50.719 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.719 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:47:50.720 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.721 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:47:50.722 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:50.723 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:50.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:47:50.723 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:50.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:47:50.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:47:50.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-17T04:47:50.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:50.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=18 2026-02-17T04:47:50.803 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records in 2026-02-17T04:47:50.803 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records out 2026-02-17T04:47:50.803 INFO:tasks.workunit.client.0.trial090.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 0.00012913 s, 35.7 MB/s 2026-02-17T04:47:50.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:47:50.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj3 2026-02-17T04:47:51.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=15 2026-02-17T04:47:51.009 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records in 2026-02-17T04:47:51.009 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records out 2026-02-17T04:47:51.009 INFO:tasks.workunit.client.0.trial090.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 7.1994e-05 s, 53.3 MB/s 2026-02-17T04:47:51.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:47:51.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj4 2026-02-17T04:47:51.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-17T04:47:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:47:51.310 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-17T04:47:51.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:47:51.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:51.461 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.462 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:47:51.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj16 2026-02-17T04:47:51.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-17T04:47:51.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:47:51.636 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-17T04:47:51.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:47:51.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:47:51.775 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:47:51.776 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:51.777 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.778 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:47:51.778 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.778 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:47:51.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:47:51.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:47:51.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj2 2026-02-17T04:47:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-17T04:47:51.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-17T04:47:51.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:51.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=7 2026-02-17T04:47:52.000 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records in 2026-02-17T04:47:52.000 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records out 2026-02-17T04:47:52.000 INFO:tasks.workunit.client.0.trial090.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 6.4139e-05 s, 27.9 MB/s 2026-02-17T04:47:52.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:47:52.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj6 2026-02-17T04:47:52.176 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:52.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:52.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:47:52.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj7 2026-02-17T04:47:52.407 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:52.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:52.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-17T04:47:52.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj8 2026-02-17T04:47:52.624 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:52.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:52.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-17T04:47:52.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj9 2026-02-17T04:47:52.849 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:52.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:52.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-17T04:47:53.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj10 2026-02-17T04:47:53.050 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:53.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:53.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-17T04:47:53.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj11 2026-02-17T04:47:53.260 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:53.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:53.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:47:53.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj13 2026-02-17T04:47:53.469 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:53.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:53.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-17T04:47:53.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj14 2026-02-17T04:47:53.676 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:53.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:53.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-17T04:47:53.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-17T04:47:53.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj15 2026-02-17T04:47:53.911 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:47:53.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:47:53.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-17T04:47:54.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-17T04:47:54.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-17T04:47:54.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:202: TEST_scrub_snaps: rm -f testdata.844249 2026-02-17T04:47:54.073 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: expr 1 - 1 2026-02-17T04:47:54.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: seq 0 0 2026-02-17T04:47:54.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:47:54.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:206: TEST_scrub_snaps: activate_osd td/osd-scrub-snaps 0 2026-02-17T04:47:54.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:47:54.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:47:54.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:47:54.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:47:54.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:47:54.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:47:54.080 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:47:54.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:47:54.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:54.089+0000 7fbbed815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:54.092 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:54.090+0000 7fbbed815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:54.093 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:54.091+0000 7fbbed815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:47:54.217 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:54.215+0000 7fbbed815780 -1 Falling back to public interface 2026-02-17T04:47:54.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:54.247 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:47:54.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:47:54.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:54.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:54.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:47:54.498 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:47:54.496+0000 7fbbed815780 -1 osd.0 18 log_to_monitors true 2026-02-17T04:47:55.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:47:55.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:47:55.414 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:47:55.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:47:55.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:47:55.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:47:55.573 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 21 up_thru 21 down_at 19 last_clean_interval [5,18) [v2:127.0.0.1:6800/914841739,v1:127.0.0.1:6801/914841739] [v2:127.0.0.1:6802/914841739,v1:127.0.0.1:6803/914841739] exists,up a70f2c45-0944-4135-b779-42094864e33d 2026-02-17T04:47:55.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:47:55.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:47:55.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:47:55.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:208: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 25 2026-02-17T04:47:55.626 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:55.626 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:47:55.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:55.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:209: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 5 2026-02-17T04:47:55.684 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:55.684 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-17T04:47:55.685 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:55.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:210: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-17T04:47:55.742 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:55.743 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-17T04:47:55.743 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:55.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:211: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-17T04:47:55.801 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:55.801 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-17T04:47:55.801 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:55.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:214: TEST_scrub_snaps: wait_for_clean 2026-02-17T04:47:55.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:47:55.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:47:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:47:55.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:47:55.806 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:55.807 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:47:55.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:55.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:55.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:55.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:47:55.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:47:55.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:47:55.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:47:55.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:55.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:56.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:47:56.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:56.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:56.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:56.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313218 2026-02-17T04:47:56.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313218 2026-02-17T04:47:56.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-90194313218' 2026-02-17T04:47:56.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:56.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-90194313218 2026-02-17T04:47:56.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:56.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-90194313218 2026-02-17T04:47:56.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:56.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313218 2026-02-17T04:47:56.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 90194313218' 2026-02-17T04:47:56.120 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 90194313218 2026-02-17T04:47:56.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:56.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 90194313218 2026-02-17T04:47:56.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:57.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:57.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:57.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313218 -lt 90194313218 2026-02-17T04:47:57.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:47:57.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:57.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:47:57.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:47:57.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:47:57.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:47:57.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:47:57.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:47:58.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:47:58.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:47:58.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:47:58.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:216: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_shallow_scrub_chunk_max 2026-02-17T04:47:58.087 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.087 INFO:tasks.workunit.client.0.trial090.stdout: "osd_shallow_scrub_chunk_max": "25" 2026-02-17T04:47:58.087 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:217: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_shallow_scrub_chunk_min 2026-02-17T04:47:58.144 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.144 INFO:tasks.workunit.client.0.trial090.stdout: "osd_shallow_scrub_chunk_min": "5" 2026-02-17T04:47:58.145 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:218: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_pg_stat_report_interval_max_seconds 2026-02-17T04:47:58.202 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.202 INFO:tasks.workunit.client.0.trial090.stdout: "osd_pg_stat_report_interval_max_seconds": "1" 2026-02-17T04:47:58.202 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:219: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_pg_stat_report_interval_max_epochs 2026-02-17T04:47:58.259 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.259 INFO:tasks.workunit.client.0.trial090.stdout: "osd_pg_stat_report_interval_max_epochs": "1" 2026-02-17T04:47:58.259 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:220: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_scrub_chunk_max 2026-02-17T04:47:58.315 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.316 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_chunk_max": "15" 2026-02-17T04:47:58.316 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:221: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_scrub_chunk_min 2026-02-17T04:47:58.373 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:47:58.373 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_chunk_min": "5" 2026-02-17T04:47:58.373 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:47:58.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:223: TEST_scrub_snaps: local pgid=1.0 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:224: TEST_scrub_snaps: pg_scrub 1.0 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:47:58.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:47:58.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:47:58.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T04:47:58.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:47:58.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:47:58.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:47:58.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313219 2026-02-17T04:47:58.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313219 2026-02-17T04:47:58.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-90194313219' 2026-02-17T04:47:58.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:47:58.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-90194313219 2026-02-17T04:47:58.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:47:58.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:47:58.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-90194313219 2026-02-17T04:47:58.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:47:58.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313219 2026-02-17T04:47:58.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 90194313219' 2026-02-17T04:47:58.803 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 90194313219 2026-02-17T04:47:58.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:47:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313218 -lt 90194313219 2026-02-17T04:47:58.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:47:59.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:47:59.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:00.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313218 -lt 90194313219 2026-02-17T04:48:00.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:01.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:48:01.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:01.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313220 -lt 90194313219 2026-02-17T04:48:01.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:48:01.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T04:48:01.306 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T04:48:01.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T04:48:01.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T04:48:01.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:48:01.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T04:48:01.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:01.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:01.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:01.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:01.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:01.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-17T04:48:01.687 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.0 to scrub 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:01.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:01.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:01.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:01.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:01.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:01.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:45.067354+0000 '>' 2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:01.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:03.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:45.067354+0000 '>' 2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:03.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:04.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:04.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:04.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:04.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:04.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:04.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:04.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:04.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:47:45.067354+0000 '>' 2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:04.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:05.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:05.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:05.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:05.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:05.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:05.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:05.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:05.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:48:02.523743+0000 '>' 2026-02-17T04:47:45.067354+0000 2026-02-17T04:48:05.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:48:05.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:05.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: wc -l 2026-02-17T04:48:05.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: test 2 = 2 2026-02-17T04:48:05.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:230: TEST_scrub_snaps: rados list-inconsistent-pg test 2026-02-17T04:48:05.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:232: TEST_scrub_snaps: jq '. | length' td/osd-scrub-snaps/json 2026-02-17T04:48:05.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:232: TEST_scrub_snaps: test 1 = 1 2026-02-17T04:48:05.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:234: TEST_scrub_snaps: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-17T04:48:05.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:234: TEST_scrub_snaps: test 1.0 = 1.0 2026-02-17T04:48:05.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:236: TEST_scrub_snaps: rados list-inconsistent-obj 1.0 2026-02-17T04:48:05.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:241: TEST_scrub_snaps: jq .inconsistents 2026-02-17T04:48:05.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:241: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:05.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:248: TEST_scrub_snaps: jq .inconsistents td/osd-scrub-snaps/json 2026-02-17T04:48:05.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:248: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:05.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:249: TEST_scrub_snaps: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:05.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:05.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:251: TEST_scrub_snaps: rados list-inconsistent-snapset 1.0 2026-02-17T04:48:05.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:253: TEST_scrub_snaps: jq .inconsistents 2026-02-17T04:48:05.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:253: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:05.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:632: TEST_scrub_snaps: jq .inconsistents td/osd-scrub-snaps/json 2026-02-17T04:48:05.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:632: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:05.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:633: TEST_scrub_snaps: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:05.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:05.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:634: TEST_scrub_snaps: test no = yes 2026-02-17T04:48:05.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:639: TEST_scrub_snaps: test '' = yes 2026-02-17T04:48:05.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: find td/osd-scrub-snaps 2026-02-17T04:48:05.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: grep 'osd[^/]*\.pid' 2026-02-17T04:48:05.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: pidfiles=td/osd-scrub-snaps/osd.0.pid 2026-02-17T04:48:05.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:645: TEST_scrub_snaps: pids= 2026-02-17T04:48:05.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:646: TEST_scrub_snaps: for pidfile in ${pidfiles} 2026-02-17T04:48:05.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:648: TEST_scrub_snaps: cat td/osd-scrub-snaps/osd.0.pid 2026-02-17T04:48:05.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:648: TEST_scrub_snaps: pids+='858958 ' 2026-02-17T04:48:05.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:651: TEST_scrub_snaps: ERRORS=0 2026-02-17T04:48:05.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: seq 1 7 2026-02-17T04:48:05.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap1 2026-02-17T04:48:05.542 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap1 2026-02-17T04:48:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap2 2026-02-17T04:48:05.645 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap2 2026-02-17T04:48:05.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap3 2026-02-17T04:48:05.745 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap3 2026-02-17T04:48:05.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap4 2026-02-17T04:48:05.848 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap4 2026-02-17T04:48:05.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap5 2026-02-17T04:48:05.949 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap5 2026-02-17T04:48:05.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:05.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap6 2026-02-17T04:48:06.051 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap6 2026-02-17T04:48:06.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-17T04:48:06.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap7 2026-02-17T04:48:06.153 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap7 2026-02-17T04:48:06.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:657: TEST_scrub_snaps: sleep 5 2026-02-17T04:48:11.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:658: TEST_scrub_snaps: local -i loop=0 2026-02-17T04:48:11.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:659: TEST_scrub_snaps: ceph pg dump pgs 2026-02-17T04:48:11.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:659: TEST_scrub_snaps: grep -q snaptrim 2026-02-17T04:48:11.313 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:11.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:661: TEST_scrub_snaps: ceph pg dump pgs 2026-02-17T04:48:11.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:661: TEST_scrub_snaps: grep -q snaptrim_error 2026-02-17T04:48:11.473 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:11.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:663: TEST_scrub_snaps: break 2026-02-17T04:48:11.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:672: TEST_scrub_snaps: ceph pg dump pgs 2026-02-17T04:48:11.636 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:48:11.636 INFO:tasks.workunit.client.0.trial090.stdout:1.0 35 0 0 0 0 23416 0 0 60 0 60 active+clean+inconsistent+snaptrim_error 2026-02-17T04:48:06.152538+0000 23'60 29:139 [0] 0 [0] 0 18'56 2026-02-17T04:48:02.523743+0000 0'0 2026-02-17T04:47:45.067354+0000 7 1 periodic scrub scheduled @ 2026-02-18T12:04:45.326531+0000 33 0 2026-02-17T04:48:11.637 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:48:11.637 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:48:11.637 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:11.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:674: TEST_scrub_snaps: for pid in $pids 2026-02-17T04:48:11.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:676: TEST_scrub_snaps: kill -0 858958 2026-02-17T04:48:11.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:683: TEST_scrub_snaps: kill_daemons td/osd-scrub-snaps 2026-02-17T04:48:11.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:11.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:11.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:11.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:11.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:685: TEST_scrub_snaps: declare -a err_strings 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:686: TEST_scrub_snaps: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj10:.* : is missing in clone_overlap' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:687: TEST_scrub_snaps: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : no '\''_'\'' attr' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:688: TEST_scrub_snaps: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : is an unexpected clone' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:689: TEST_scrub_snaps: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:4 : on disk size [(]4608[)] does not match object info size [(]512[)] adjusted for ondisk to [(]512[)]' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:690: TEST_scrub_snaps: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:2' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:691: TEST_scrub_snaps: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:1' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:692: TEST_scrub_snaps: err_strings[6]='log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj5:head : 2 missing clone[(]s[)]' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:693: TEST_scrub_snaps: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj8:head : snaps.seq not set' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:694: TEST_scrub_snaps: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj7:1 : is an unexpected clone' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:695: TEST_scrub_snaps: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj3:head : on disk size [(]3840[)] does not match object info size [(]768[)] adjusted for ondisk to [(]768[)]' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:696: TEST_scrub_snaps: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj6:1 : is an unexpected clone' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:697: TEST_scrub_snaps: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:head : no '\''snapset'\'' attr' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:698: TEST_scrub_snaps: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:7 : clone ignored due to missing snapset' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:699: TEST_scrub_snaps: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:4 : clone ignored due to missing snapset' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:700: TEST_scrub_snaps: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj4:head : expected clone .*:::obj4:7' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:701: TEST_scrub_snaps: err_strings[15]='log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj4:head : 1 missing clone[(]s[)]' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:702: TEST_scrub_snaps: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj1:1 : is an unexpected clone' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:703: TEST_scrub_snaps: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj9:1 : is missing in clone_size' 2026-02-17T04:48:16.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:704: TEST_scrub_snaps: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj11:1 : is an unexpected clone' 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:705: TEST_scrub_snaps: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj14:1 : size 1032 != clone_size 1033' 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:706: TEST_scrub_snaps: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:707: TEST_scrub_snaps: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj15:head : can'\''t decode '\''snapset'\'' attr ' 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:708: TEST_scrub_snaps: err_strings[22]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj10:.* : is missing in clone_overlap' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : no '\''_'\'' attr' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:4 : on disk size [(]4608[)] does not match object info size [(]512[)] adjusted for ondisk to [(]512[)]' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:2' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:1' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj5:head : 2 missing clone[(]s[)]' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj8:head : snaps.seq not set' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj7:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj3:head : on disk size [(]3840[)] does not match object info size [(]768[)] adjusted for ondisk to [(]768[)]' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj6:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:head : no '\''snapset'\'' attr' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:7 : clone ignored due to missing snapset' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:4 : clone ignored due to missing snapset' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj4:head : expected clone .*:::obj4:7' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj4:head : 1 missing clone[(]s[)]' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj1:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj9:1 : is missing in clone_size' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj11:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj14:1 : size 1032 != clone_size 1033' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj15:head : can'\''t decode '\''snapset'\'' attr ' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-17T04:48:16.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:16.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:719: TEST_scrub_snaps: '[' 0 '!=' 0 ']' 2026-02-17T04:48:16.994 INFO:tasks.workunit.client.0.trial090.stdout:TEST PASSED 2026-02-17T04:48:16.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:725: TEST_scrub_snaps: echo 'TEST PASSED' 2026-02-17T04:48:16.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:726: TEST_scrub_snaps: return 0 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:16.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:16.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:16.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:48:16.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:48:17.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:48:17.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:48:17.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:48:17.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:48:17.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:17.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:48:17.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:48:17.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:17.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:48:17.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:48:17.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:48:17.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:48:17.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:17.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:17.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:17.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:48:17.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:48:17.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:48:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:48:17.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:48:17.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:48:17.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:17.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:48:17.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:48:17.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:17.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:48:17.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:48:17.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:48:17.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:48:17.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:48:17.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:48:17.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:48:17.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-17T04:48:17.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:48:17.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.844249 2026-02-17T04:48:17.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:48:17.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:48:17.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps_primary td/osd-scrub-snaps 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1175: TEST_scrub_snaps_primary: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1176: TEST_scrub_snaps_primary: ORIG_ARGS='--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1177: TEST_scrub_snaps_primary: CEPH_ARGS+=' --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1178: TEST_scrub_snaps_primary: _scrub_snaps_multi td/osd-scrub-snaps primary 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:730: _scrub_snaps_multi: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:731: _scrub_snaps_multi: local poolname=test 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:732: _scrub_snaps_multi: local OBJS=16 2026-02-17T04:48:17.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:733: _scrub_snaps_multi: local OSDS=2 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:734: _scrub_snaps_multi: local which=primary 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:736: _scrub_snaps_multi: TESTDATA=testdata.844249 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:738: _scrub_snaps_multi: run_mon td/osd-scrub-snaps a --osd_pool_default_size=2 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-17T04:48:17.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=2 2026-02-17T04:48:17.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:17.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:48:17.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:48:17.078 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:48:17.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get fsid 2026-02-17T04:48:17.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:48:17.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:48:17.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:48:17.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:48:17.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:48:17.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get mon_host 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:739: _scrub_snaps_multi: run_mgr td/osd-scrub-snaps x 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:48:17.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-17T04:48:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:48:17.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:48:17.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:17.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:17.256 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:17.257 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.257 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:17.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:48:17.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:48:17.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: expr 2 - 1 2026-02-17T04:48:17.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: seq 0 1 2026-02-17T04:48:17.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:48:17.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 0 2026-02-17T04:48:17.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:48:17.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:48:17.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:48:17.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=65cb4e20-11f3-4ac2-9944-2ecaa418825e 2026-02-17T04:48:17.286 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 65cb4e20-11f3-4ac2-9944-2ecaa418825e 2026-02-17T04:48:17.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 65cb4e20-11f3-4ac2-9944-2ecaa418825e' 2026-02-17T04:48:17.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:48:17.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAR85NpCtqLERAA8yyHhXXHijnG9DKwrwl+Dw== 2026-02-17T04:48:17.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAR85NpCtqLERAA8yyHhXXHijnG9DKwrwl+Dw=="}' 2026-02-17T04:48:17.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 65cb4e20-11f3-4ac2-9944-2ecaa418825e -i td/osd-scrub-snaps/0/new.json 2026-02-17T04:48:17.380 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:17.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-17T04:48:17.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAR85NpCtqLERAA8yyHhXXHijnG9DKwrwl+Dw== --osd-uuid 65cb4e20-11f3-4ac2-9944-2ecaa418825e 2026-02-17T04:48:17.410 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.408+0000 7fa156bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:17.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.410+0000 7fa156bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:17.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.411+0000 7fa156bfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:17.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.411+0000 7fa156bfd780 -1 bdev(0x3c22c00 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:48:17.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.411+0000 7fa156bfd780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-17T04:48:17.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-17T04:48:17.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:48:17.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:48:17.872 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:48:17.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:48:17.961 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:48:17.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:48:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:48:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:48:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:48:17.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:48:17.983 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.981+0000 7ff863dd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:17.984 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.982+0000 7ff863dd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:17.985 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:17.983+0000 7ff863dd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:48:18.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:18.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:48:18.050 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:18.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:18.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:48:18.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:48:18.172 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:18.170+0000 7ff863dd8780 -1 Falling back to public interface 2026-02-17T04:48:18.579 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:18.577+0000 7ff863dd8780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:19.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:48:19.218 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1097995827,v1:127.0.0.1:6801/1097995827] [v2:127.0.0.1:6802/1097995827,v1:127.0.0.1:6803/1097995827] exists,up 65cb4e20-11f3-4ac2-9944-2ecaa418825e 2026-02-17T04:48:19.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 1 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:19.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:19.224 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:48:19.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e75338d1-af97-4cc4-a580-71da58acda3a 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e75338d1-af97-4cc4-a580-71da58acda3a' 2026-02-17T04:48:19.226 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e75338d1-af97-4cc4-a580-71da58acda3a 2026-02-17T04:48:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:48:19.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAT85NpER35DRAASxRwQBIdDd4SIoXO0CVYtw== 2026-02-17T04:48:19.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAT85NpER35DRAASxRwQBIdDd4SIoXO0CVYtw=="}' 2026-02-17T04:48:19.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e75338d1-af97-4cc4-a580-71da58acda3a -i td/osd-scrub-snaps/1/new.json 2026-02-17T04:48:19.321 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:48:19.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/1/new.json 2026-02-17T04:48:19.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAT85NpER35DRAASxRwQBIdDd4SIoXO0CVYtw== --osd-uuid e75338d1-af97-4cc4-a580-71da58acda3a 2026-02-17T04:48:19.351 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.349+0000 7fb8a4e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:19.352 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.350+0000 7fb8a4e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:19.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.351+0000 7fb8a4e35780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:19.353 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.351+0000 7fb8a4e35780 -1 bdev(0x2c40c00 td/osd-scrub-snaps/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:48:19.354 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.352+0000 7fb8a4e35780 -1 bluestore(td/osd-scrub-snaps/1) _read_fsid unparsable uuid 2026-02-17T04:48:19.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/1/keyring 2026-02-17T04:48:19.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:48:19.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:48:19.692 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:48:19.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:48:19.909 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:48:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:48:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:48:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:48:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:48:19.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:48:19.929 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.928+0000 7f54ade08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:19.931 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.929+0000 7f54ade08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:19.931 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:19.930+0000 7f54ade08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:20.066 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:20.064+0000 7f54ade08780 -1 Falling back to public interface 2026-02-17T04:48:20.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:48:20.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:48:20.080 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:20.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:20.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:48:20.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:48:20.362 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:20.360+0000 7f54ade08780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:48:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:48:21.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:21.252 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:48:21.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:48:21.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:21.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:48:21.432 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/615407254,v1:127.0.0.1:6811/615407254] [v2:127.0.0.1:6812/615407254,v1:127.0.0.1:6813/615407254] exists,up e75338d1-af97-4cc4-a580-71da58acda3a 2026-02-17T04:48:21.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:48:21.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:48:21.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:48:21.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:746: _scrub_snaps_multi: ceph osd set noscrub 2026-02-17T04:48:21.653 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:48:21.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:747: _scrub_snaps_multi: ceph osd set nodeep-scrub 2026-02-17T04:48:21.831 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:48:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:750: _scrub_snaps_multi: create_pool test 1 1 2026-02-17T04:48:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:48:22.058 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:48:22.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:48:23.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:751: _scrub_snaps_multi: wait_for_clean 2026-02-17T04:48:23.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:48:23.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:48:23.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:48:23.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:48:23.070 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:48:23.070 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:48:23.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:48:23.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:48:23.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:48:23.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:48:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:48:23.328 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:48:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:48:23.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:23.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:48:23.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:48:23.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:48:23.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:48:23.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:23.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:48:23.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-17T04:48:23.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-17T04:48:23.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705667' 2026-02-17T04:48:23.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:23.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:48:23.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:23.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:48:23.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:48:23.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:23.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:48:23.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:48:23.461 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:48:23.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:23.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:48:23.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:24.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:48:24.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:24.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-17T04:48:24.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:25.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:48:25.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:25.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-17T04:48:25.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:25.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-17T04:48:25.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:25.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:48:25.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-17T04:48:25.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:25.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-17T04:48:25.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-17T04:48:25.979 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705667 2026-02-17T04:48:25.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:48:26.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-17T04:48:26.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:48:26.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:48:26.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:48:26.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:48:26.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:48:26.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:48:26.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:48:26.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:48:26.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: ceph osd dump 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: grep '^pool.*['\'']test['\'']' 2026-02-17T04:48:26.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: awk '{ print $2 }' 2026-02-17T04:48:26.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: poolid=1 2026-02-17T04:48:26.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:754: _scrub_snaps_multi: dd if=/dev/urandom of=testdata.844249 bs=1032 count=1 2026-02-17T04:48:26.934 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:48:26.934 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:48:26.934 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.4124e-05 s, 30.2 MB/s 2026-02-17T04:48:26.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: seq 1 16 2026-02-17T04:48:26.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj1 testdata.844249 2026-02-17T04:48:26.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:26.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj2 testdata.844249 2026-02-17T04:48:26.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:26.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj3 testdata.844249 2026-02-17T04:48:26.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:26.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj4 testdata.844249 2026-02-17T04:48:27.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj5 testdata.844249 2026-02-17T04:48:27.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj6 testdata.844249 2026-02-17T04:48:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj7 testdata.844249 2026-02-17T04:48:27.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj8 testdata.844249 2026-02-17T04:48:27.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj9 testdata.844249 2026-02-17T04:48:27.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj10 testdata.844249 2026-02-17T04:48:27.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj11 testdata.844249 2026-02-17T04:48:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj12 testdata.844249 2026-02-17T04:48:27.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj13 testdata.844249 2026-02-17T04:48:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj14 testdata.844249 2026-02-17T04:48:27.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj15 testdata.844249 2026-02-17T04:48:27.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:48:27.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj16 testdata.844249 2026-02-17T04:48:27.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: get_primary test obj1 2026-02-17T04:48:27.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:48:27.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:48:27.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:48:27.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: local primary=1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: get_not_primary test obj1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:48:27.440 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:48:27.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:48:27.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-17T04:48:27.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:48:27.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: local replica=0 2026-02-17T04:48:27.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: eval create_scenario td/osd-scrub-snaps test testdata.844249 '$primary' 2026-02-17T04:48:27.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: create_scenario td/osd-scrub-snaps test testdata.844249 1 2026-02-17T04:48:27.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-17T04:48:27.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-17T04:48:27.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.844249 2026-02-17T04:48:27.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=1 2026-02-17T04:48:27.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-17T04:48:27.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-17T04:48:27.856 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap1 2026-02-17T04:48:27.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=1 2026-02-17T04:48:27.858 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:48:27.859 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:48:27.859 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 5.5964e-05 s, 4.6 MB/s 2026-02-17T04:48:27.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.844249 2026-02-17T04:48:27.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:48:27.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:48:27.921 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-17T04:48:27.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:27.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.844249 2026-02-17T04:48:27.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:27.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.844249 2026-02-17T04:48:27.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:27.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.844249 2026-02-17T04:48:27.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:27.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.844249 2026-02-17T04:48:28.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:28.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.844249 2026-02-17T04:48:28.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:28.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.844249 2026-02-17T04:48:28.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:28.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.844249 2026-02-17T04:48:28.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:28.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.844249 2026-02-17T04:48:28.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:48:28.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.844249 2026-02-17T04:48:28.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-17T04:48:28.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-17T04:48:28.173 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap2 2026-02-17T04:48:28.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=2 2026-02-17T04:48:28.175 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records in 2026-02-17T04:48:28.175 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records out 2026-02-17T04:48:28.176 INFO:tasks.workunit.client.0.trial090.stderr:512 bytes copied, 4.801e-05 s, 10.7 MB/s 2026-02-17T04:48:28.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:48:28.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-17T04:48:28.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-17T04:48:28.276 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap3 2026-02-17T04:48:28.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=3 2026-02-17T04:48:28.279 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records in 2026-02-17T04:48:28.279 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records out 2026-02-17T04:48:28.279 INFO:tasks.workunit.client.0.trial090.stderr:768 bytes copied, 5.6104e-05 s, 13.7 MB/s 2026-02-17T04:48:28.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:48:28.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-17T04:48:28.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-17T04:48:28.378 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap4 2026-02-17T04:48:28.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=4 2026-02-17T04:48:28.382 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records in 2026-02-17T04:48:28.382 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records out 2026-02-17T04:48:28.382 INFO:tasks.workunit.client.0.trial090.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 6.1164e-05 s, 16.7 MB/s 2026-02-17T04:48:28.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:48:28.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.844249 2026-02-17T04:48:28.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-17T04:48:28.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-17T04:48:28.480 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap5 2026-02-17T04:48:28.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-17T04:48:28.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-17T04:48:28.580 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap6 2026-02-17T04:48:28.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=6 2026-02-17T04:48:28.584 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records in 2026-02-17T04:48:28.585 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records out 2026-02-17T04:48:28.585 INFO:tasks.workunit.client.0.trial090.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 8.9386e-05 s, 17.2 MB/s 2026-02-17T04:48:28.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:48:28.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-17T04:48:28.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-17T04:48:28.683 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap7 2026-02-17T04:48:28.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-17T04:48:28.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-17T04:48:28.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-17T04:48:28.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-17T04:48:28.746 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:28.747 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:28.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:28.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:28.852 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj1 2026-02-17T04:48:28.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:28.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-17T04:48:29.040 INFO:tasks.workunit.client.0.trial090.stdout:WARNING: only removing head with clones present 2026-02-17T04:48:29.040 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:48:29.085 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-17T04:48:29.085 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-17T04:48:29.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:29.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:48:29.268 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:2# 2026-02-17T04:48:29.304 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-17T04:48:29.304 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-17T04:48:29.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:29.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:29.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-17T04:48:29.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:48:29.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:29.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:29.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:48:29.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:29.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:48:29.603 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:1# 2026-02-17T04:48:29.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-17T04:48:29.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:48:29.754 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.755 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-17T04:48:29.756 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-17T04:48:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:29.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=18 2026-02-17T04:48:29.850 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records in 2026-02-17T04:48:29.850 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records out 2026-02-17T04:48:29.850 INFO:tasks.workunit.client.0.trial090.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 8.5869e-05 s, 53.7 MB/s 2026-02-17T04:48:29.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:48:29.978 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj3 2026-02-17T04:48:30.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:30.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=15 2026-02-17T04:48:30.061 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records in 2026-02-17T04:48:30.061 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records out 2026-02-17T04:48:30.061 INFO:tasks.workunit.client.0.trial090.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 7.1793e-05 s, 53.5 MB/s 2026-02-17T04:48:30.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:48:30.197 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj4 2026-02-17T04:48:30.197 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-17T04:48:30.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:30.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:48:30.376 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-17T04:48:30.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-17T04:48:30.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:48:30.512 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj16 2026-02-17T04:48:30.513 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-17T04:48:30.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:30.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:48:30.688 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-17T04:48:30.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-17T04:48:30.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:48:30.824 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:48:30.825 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:48:30.826 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:30.826 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.826 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:48:30.826 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.826 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:48:30.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:48:30.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:48:30.827 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj2 2026-02-17T04:48:30.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:30.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-17T04:48:31.067 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-17T04:48:31.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=7 2026-02-17T04:48:31.069 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records in 2026-02-17T04:48:31.069 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records out 2026-02-17T04:48:31.069 INFO:tasks.workunit.client.0.trial090.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 6.3618e-05 s, 28.2 MB/s 2026-02-17T04:48:31.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:48:31.211 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj6 2026-02-17T04:48:31.259 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:31.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:48:31.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj7 2026-02-17T04:48:31.483 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:31.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-17T04:48:31.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj8 2026-02-17T04:48:31.702 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:31.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-17T04:48:31.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj9 2026-02-17T04:48:31.921 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:31.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:31.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-17T04:48:32.095 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj10 2026-02-17T04:48:32.147 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:32.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:32.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-17T04:48:32.309 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj11 2026-02-17T04:48:32.358 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:32.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:32.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:48:32.528 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj13 2026-02-17T04:48:32.575 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:32.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:32.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-17T04:48:32.757 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj14 2026-02-17T04:48:32.805 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:32.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:32.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-17T04:48:32.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-17T04:48:32.977 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj15 2026-02-17T04:48:33.026 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:48:33.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:48:33.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-17T04:48:33.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-17T04:48:33.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-17T04:48:33.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:765: _scrub_snaps_multi: rm -f testdata.844249 2026-02-17T04:48:33.199 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: expr 2 - 1 2026-02-17T04:48:33.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: seq 0 1 2026-02-17T04:48:33.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:48:33.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 0 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:48:33.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:48:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:48:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:48:33.208 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:48:33.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:48:33.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-17T04:48:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:48:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:48:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:48:33.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:48:33.224 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:33.223+0000 7f11ea243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:33.225 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:33.224+0000 7f11ea243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:33.226 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:33.225+0000 7f11ea243780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:33.367 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:33.366+0000 7f11ea243780 -1 Falling back to public interface 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:33.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:48:33.378 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:33.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:33.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:48:33.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:48:33.685 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:33.684+0000 7f11ea243780 -1 osd.0 21 log_to_monitors true 2026-02-17T04:48:34.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:48:34.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:34.550 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:48:34.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:48:34.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:34.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:48:34.721 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 24 up_thru 24 down_at 22 last_clean_interval [5,21) [v2:127.0.0.1:6800/3786683492,v1:127.0.0.1:6801/3786683492] [v2:127.0.0.1:6802/3786683492,v1:127.0.0.1:6803/3786683492] exists,up 65cb4e20-11f3-4ac2-9944-2ecaa418825e 2026-02-17T04:48:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:48:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:48:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:48:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:48:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 1 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-17T04:48:34.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:34.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-17T04:48:34.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:48:34.730 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/1/whoami 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:48:34.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:48:34.745 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:34.744+0000 7f1dcf444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:34.746 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:34.745+0000 7f1dcf444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:34.747 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:34.746+0000 7f1dcf444780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:34.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:48:34.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:48:34.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:48:34.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:48:34.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:48:34.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:34.898 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:34.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:48:34.899 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:34.896+0000 7f1dcf444780 -1 Falling back to public interface 2026-02-17T04:48:34.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:34.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:48:35.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:48:35.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:35.206+0000 7f1dcf444780 -1 osd.1 21 log_to_monitors true 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:36.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:48:36.238 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 22 last_clean_interval [9,21) [v2:127.0.0.1:6810/646564490,v1:127.0.0.1:6811/646564490] [v2:127.0.0.1:6812/646564490,v1:127.0.0.1:6813/646564490] exists,up e75338d1-af97-4cc4-a580-71da58acda3a 2026-02-17T04:48:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:48:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:48:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:48:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:772: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-17T04:48:36.300 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:48:36.300 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:48:36.300 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.308 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:48:36.308 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:48:36.308 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:773: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 3 2026-02-17T04:48:36.374 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:48:36.374 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-17T04:48:36.374 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.383 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:48:36.383 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-17T04:48:36.383 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:774: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_scrub_chunk_min 3 2026-02-17T04:48:36.448 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:48:36.449 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-17T04:48:36.449 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.456 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:48:36.456 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-17T04:48:36.457 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:775: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-17T04:48:36.522 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:48:36.522 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-17T04:48:36.522 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.530 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:48:36.530 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-17T04:48:36.530 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:776: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-17T04:48:36.595 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:48:36.595 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-17T04:48:36.595 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.604 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:48:36.604 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-17T04:48:36.604 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:777: _scrub_snaps_multi: wait_for_clean 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:48:36.610 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:48:36.611 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:48:36.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:48:36.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:48:36.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:48:36.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:48:36.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:48:36.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:48:36.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:48:36.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:48:36.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:48:36.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:48:36.866 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:48:36.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:48:36.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:36.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:48:36.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-17T04:48:36.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-17T04:48:36.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-17T04:48:36.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:36.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-120259084290' 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-17T04:48:36.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:36.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:48:36.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-17T04:48:36.999 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:37.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-17T04:48:37.000 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215106 2026-02-17T04:48:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-17T04:48:37.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:37.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-17T04:48:37.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:38.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:48:38.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:38.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-17T04:48:38.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:38.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-17T04:48:38.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:38.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:48:38.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-17T04:48:38.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:38.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T04:48:38.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-17T04:48:38.357 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 120259084290 2026-02-17T04:48:38.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:48:38.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T04:48:38.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:48:38.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:48:38.525 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:48:38.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:48:38.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:48:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:48:38.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:48:38.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:48:38.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:48:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:48:39.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:779: _scrub_snaps_multi: local pgid=1.0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:780: _scrub_snaps_multi: pg_scrub 1.0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:48:39.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:48:39.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:48:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:48:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:48:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:48:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:48:39.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:48:39.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:48:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:48:39.515 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:48:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:48:39.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:39.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:48:39.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215108 2026-02-17T04:48:39.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215108 2026-02-17T04:48:39.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108' 2026-02-17T04:48:39.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:48:39.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:48:39.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-120259084291' 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215108 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:39.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:48:39.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215108 2026-02-17T04:48:39.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:39.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215108 2026-02-17T04:48:39.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215108' 2026-02-17T04:48:39.647 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 103079215108 2026-02-17T04:48:39.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:39.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215108 2026-02-17T04:48:39.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:40.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:48:40.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:40.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215108 2026-02-17T04:48:40.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:48:41.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:48:41.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:48:42.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215108 2026-02-17T04:48:42.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:48:42.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084291 2026-02-17T04:48:42.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:48:42.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:48:42.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084291 2026-02-17T04:48:42.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:48:42.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-17T04:48:42.164 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 120259084291 2026-02-17T04:48:42.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084291' 2026-02-17T04:48:42.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:48:42.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084291 2026-02-17T04:48:42.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:48:42.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T04:48:42.342 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T04:48:42.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T04:48:42.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T04:48:42.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:48:42.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T04:48:42.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:48:42.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:42.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-17T04:48:42.741 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-17T04:48:42.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:42.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:42.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:42.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:48:22.056744+0000 '>' 2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:42.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:43.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:43.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:43.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:43.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:43.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:43.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:43.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:44.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:48:22.056744+0000 '>' 2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:44.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:45.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:45.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:45.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:45.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:45.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:45.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:45.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:45.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:48:22.056744+0000 '>' 2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:45.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:48:46.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:48:46.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:48:46.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:48:46.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:48:46.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:48:46.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:48:46.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:48:46.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:48:43.325305+0000 '>' 2026-02-17T04:48:22.056744+0000 2026-02-17T04:48:46.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:48:46.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:46.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: wc -l 2026-02-17T04:48:46.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: test 14 -gt 3 2026-02-17T04:48:46.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:48:46.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: wc -l 2026-02-17T04:48:46.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: test 14 -gt 3 2026-02-17T04:48:46.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:787: _scrub_snaps_multi: rados list-inconsistent-pg test 2026-02-17T04:48:46.464 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: jq '. | length' td/osd-scrub-snaps/json 2026-02-17T04:48:46.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: test 1 = 1 2026-02-17T04:48:46.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-17T04:48:46.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: test 1.0 = 1.0 2026-02-17T04:48:46.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:793: _scrub_snaps_multi: rados list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:48:46.487 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: "epoch": 28, 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: "inconsistents": [ 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj1", 2026-02-17T04:48:46.488 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "version": 18 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "missing" 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.489 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj1", 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1828249343, 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'18", 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'1", 2026-02-17T04:48:46.490 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4220.0:1", 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 18, 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:27.876792+0000", 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:27.877846+0000", 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.491 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.492 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.493 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: "missing" 2026-02-17T04:48:46.494 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj10", 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "version": 32 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.495 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj10", 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 718195851, 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.496 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'32", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'10", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4241.0:1", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 32, 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.023617+0000", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.023952+0000", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.497 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.498 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.499 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.500 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "????", 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.501 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj11", 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "version": 34 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.502 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj11", 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 693400951, 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'34", 2026-02-17T04:48:46.503 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'11", 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4244.0:1", 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 34, 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.043826+0000", 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.044089+0000", 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.504 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.505 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.506 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.507 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:48:46.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj13", 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "version": 38 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.509 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj13", 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2087409765, 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.510 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'38", 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'13", 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4250.0:1", 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 38, 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.082905+0000", 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.083214+0000", 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.511 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.512 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.513 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.514 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.515 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]" 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.516 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj14", 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "version": 40 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.517 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj14", 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2484217095, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'40", 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'14", 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4253.0:1", 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 40, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.518 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.101901+0000", 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.102198+0000", 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.519 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.520 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.521 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1033, 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj15", 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "version": 15 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_corrupted" 2026-02-17T04:48:46.523 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj15", 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 612772309, 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "version": "14'15", 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "0'0", 2026-02-17T04:48:46.524 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4205.0:1", 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 15, 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:27.243296+0000", 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:27.243602+0000", 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.525 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xecb10db5", 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.526 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.527 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_corrupted" 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": "Z2FyYmFnZQo=" 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj2", 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.528 INFO:tasks.workunit.client.0.trial090.stdout: "version": 56 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_missing" 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj2", 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1058988552, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "version": "21'56", 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "18'48", 2026-02-17T04:48:46.529 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4295.0:1", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 56, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.743412+0000", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.743737+0000", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "whiteout", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "dirty" 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xffffffff", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.530 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.531 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0, 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 7, 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 4, 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.532 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 4, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 3, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 2, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 7, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1024, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 7, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 6, 2026-02-17T04:48:46.533 INFO:tasks.workunit.client.0.trial090.stdout: 5 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_missing" 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.534 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj3", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "version": 44 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch" 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch_info", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "obj_size_info_mismatch" 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj3", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1643547569, 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.535 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "version": "17'44", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'22", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4265.0:1", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 44, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.296373+0000", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.297223+0000", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x7128be25", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.536 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch_info", 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "obj_size_info_mismatch" 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.537 INFO:tasks.workunit.client.0.trial090.stdout: "size": 3840, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "object_info": { 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj3", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1643547569, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "version": "17'44", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'22", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4265.0:1", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 44, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.296373+0000", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.297223+0000", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.538 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x7128be25", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj6", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.539 INFO:tasks.workunit.client.0.trial090.stdout: "version": 24 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj6", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2202164420, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'24", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'6", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4229.0:1", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 24, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:27.940730+0000", 2026-02-17T04:48:46.540 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:27.941054+0000", 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.541 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.542 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj7", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "version": 26 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj7", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1552453721, 2026-02-17T04:48:46.543 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'26", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'7", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4232.0:1", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 26, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:27.961549+0000", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:27.961819+0000", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.544 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.545 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.546 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj8", 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "version": 28 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.547 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj8", 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2381834917, 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'28", 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'8", 2026-02-17T04:48:46.548 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4235.0:1", 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 28, 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:27.982035+0000", 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:27.982377+0000", 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.549 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.550 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.551 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.552 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.553 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj9", 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "version": 30 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:48:46.554 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj9", 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 3833113727, 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'30", 2026-02-17T04:48:46.555 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "14'9", 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4238.0:1", 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 30, 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:48:28.003079+0000", 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:48:28.003409+0000", 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:48:46.556 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xb7965be1", 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:48:46.557 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.558 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "size": "????", 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:48:46.559 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:48:46.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:795: _scrub_snaps_multi: rados list-inconsistent-snapset 1.0 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:798: _scrub_snaps_multi: '[' primary = replica ']' 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:809: _scrub_snaps_multi: scruberrors=30 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:810: _scrub_snaps_multi: jq .inconsistents 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:810: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:46.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: jq .inconsistents td/osd-scrub-snaps/json 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1065: _scrub_snaps_multi: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1066: _scrub_snaps_multi: test no = yes 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1071: _scrub_snaps_multi: test '' = yes 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: find td/osd-scrub-snaps 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: grep 'osd[^/]*\.pid' 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: pidfiles='td/osd-scrub-snaps/osd.1.pid 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:td/osd-scrub-snaps/osd.0.pid' 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1077: _scrub_snaps_multi: pids= 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.1.pid 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='877472 ' 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-17T04:48:46.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.0.pid 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='876931 ' 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1083: _scrub_snaps_multi: ERRORS=0 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1087: _scrub_snaps_multi: '[' primary = primary ']' 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: seq 1 7 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:46.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap1 2026-02-17T04:48:46.609 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap1 2026-02-17T04:48:46.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:46.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap2 2026-02-17T04:48:46.709 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap2 2026-02-17T04:48:46.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:46.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap3 2026-02-17T04:48:46.812 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap3 2026-02-17T04:48:46.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:46.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap4 2026-02-17T04:48:46.914 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap4 2026-02-17T04:48:46.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:46.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap5 2026-02-17T04:48:47.015 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap5 2026-02-17T04:48:47.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:47.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap6 2026-02-17T04:48:47.118 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap6 2026-02-17T04:48:47.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-17T04:48:47.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap7 2026-02-17T04:48:47.219 INFO:tasks.workunit.client.0.trial090.stdout:removed pool test snap snap7 2026-02-17T04:48:47.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1093: _scrub_snaps_multi: sleep 5 2026-02-17T04:48:52.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1094: _scrub_snaps_multi: local -i loop=0 2026-02-17T04:48:52.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1095: _scrub_snaps_multi: ceph pg dump pgs 2026-02-17T04:48:52.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1095: _scrub_snaps_multi: grep -q snaptrim 2026-02-17T04:48:52.386 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:52.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1097: _scrub_snaps_multi: ceph pg dump pgs 2026-02-17T04:48:52.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1097: _scrub_snaps_multi: grep -q snaptrim_error 2026-02-17T04:48:52.556 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:52.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1099: _scrub_snaps_multi: break 2026-02-17T04:48:52.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1109: _scrub_snaps_multi: ceph pg dump pgs 2026-02-17T04:48:52.728 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:48:52.728 INFO:tasks.workunit.client.0.trial090.stdout:1.0 36 0 0 0 0 24448 0 0 56 0 56 active+clean+inconsistent+snaptrim_error 2026-02-17T04:48:47.219103+0000 21'56 37:136 [1,0] 1 [1,0] 1 21'56 2026-02-17T04:48:43.325305+0000 0'0 2026-02-17T04:48:22.056744+0000 7 1 periodic scrub scheduled @ 2026-02-18T12:00:19.118391+0000 33 0 2026-02-17T04:48:52.728 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:48:52.729 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:48:52.729 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:48:52.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-17T04:48:52.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 877472 2026-02-17T04:48:52.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-17T04:48:52.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 876931 2026-02-17T04:48:52.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1120: _scrub_snaps_multi: kill_daemons td/osd-scrub-snaps 2026-02-17T04:48:52.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:52.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:52.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:52.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:52.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:58.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:58.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1122: _scrub_snaps_multi: declare -a err_strings 2026-02-17T04:48:58.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1123: _scrub_snaps_multi: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' 2026-02-17T04:48:58.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1124: _scrub_snaps_multi: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' 2026-02-17T04:48:58.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1125: _scrub_snaps_multi: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1126: _scrub_snaps_multi: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1127: _scrub_snaps_multi: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1128: _scrub_snaps_multi: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1129: _scrub_snaps_multi: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1130: _scrub_snaps_multi: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 30 errors' 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:48:58.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 30 errors' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1142: _scrub_snaps_multi: declare -a rep_err_strings 2026-02-17T04:48:58.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: eval echo '$primary' 2026-02-17T04:48:58.066 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: echo 1 2026-02-17T04:48:58.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: osd=1 2026-02-17T04:48:58.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1144: _scrub_snaps_multi: rep_err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-17T04:48:58.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1145: _scrub_snaps_multi: for err_string in "${rep_err_strings[@]}" 2026-02-17T04:48:58.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1147: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:48:58.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1154: _scrub_snaps_multi: '[' 0 '!=' 0 ']' 2026-02-17T04:48:58.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1160: _scrub_snaps_multi: echo 'TEST PASSED' 2026-02-17T04:48:58.068 INFO:tasks.workunit.client.0.trial090.stdout:TEST PASSED 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1161: _scrub_snaps_multi: return 0 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1179: TEST_scrub_snaps_primary: err=0 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1180: TEST_scrub_snaps_primary: CEPH_ARGS='--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1181: TEST_scrub_snaps_primary: return 0 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:48:58.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:58.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:58.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:58.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:58.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:58.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:58.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:48:58.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:48:58.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:48:58.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:48:58.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:48:58.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:48:58.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:58.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:48:58.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:48:58.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:58.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:48:58.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:48:58.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:48:58.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:48:58.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:48:58.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:48:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:48:58.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:48:58.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:48:58.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:48:58.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:48:58.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:48:58.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:48:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:48:58.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:48:58.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:48:58.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:48:58.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:48:58.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:48:58.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:48:58.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:48:58.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:48:58.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:48:58.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-17T04:48:58.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:48:58.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.844249 2026-02-17T04:48:58.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:48:58.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:48:58.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:48:58.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-17T04:48:58.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps_replica td/osd-scrub-snaps 2026-02-17T04:48:58.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1165: TEST_scrub_snaps_replica: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1166: TEST_scrub_snaps_replica: ORIG_ARGS='--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1167: TEST_scrub_snaps_replica: CEPH_ARGS+=' --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1168: TEST_scrub_snaps_replica: _scrub_snaps_multi td/osd-scrub-snaps replica 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:730: _scrub_snaps_multi: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:731: _scrub_snaps_multi: local poolname=test 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:732: _scrub_snaps_multi: local OBJS=16 2026-02-17T04:48:58.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:733: _scrub_snaps_multi: local OSDS=2 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:734: _scrub_snaps_multi: local which=replica 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:736: _scrub_snaps_multi: TESTDATA=testdata.844249 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:738: _scrub_snaps_multi: run_mon td/osd-scrub-snaps a --osd_pool_default_size=2 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:48:58.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:48:58.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:48:58.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-17T04:48:58.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=2 2026-02-17T04:48:58.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:48:58.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:58.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:58.124 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:58.124 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.125 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:58.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:48:58.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:48:58.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:48:58.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:48:58.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:48:58.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:48:58.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:48:58.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get fsid 2026-02-17T04:48:58.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:48:58.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:48:58.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:48:58.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:48:58.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.844249/ceph-mon.a.asok 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:48:58.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.844249/ceph-mon.a.asok config get mon_host 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:739: _scrub_snaps_multi: run_mgr td/osd-scrub-snaps x 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:48:58.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-17T04:48:58.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:48:58.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:58.330 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:48:58.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:48:58.351 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: expr 2 - 1 2026-02-17T04:48:58.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: seq 0 1 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 0 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:48:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:48:58.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:48:58.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 2026-02-17T04:48:58.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8' 2026-02-17T04:48:58.360 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 2026-02-17T04:48:58.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:48:58.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA685NpbKfiFRAA7NGFMs9BjPvPA6swd7fC0w== 2026-02-17T04:48:58.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA685NpbKfiFRAA7NGFMs9BjPvPA6swd7fC0w=="}' 2026-02-17T04:48:58.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 -i td/osd-scrub-snaps/0/new.json 2026-02-17T04:48:58.453 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:58.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-17T04:48:58.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA685NpbKfiFRAA7NGFMs9BjPvPA6swd7fC0w== --osd-uuid 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 2026-02-17T04:48:58.483 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:58.481+0000 7fe13865f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:58.484 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:58.483+0000 7fe13865f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:58.485 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:58.483+0000 7fe13865f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:58.486 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:58.484+0000 7fe13865f780 -1 bdev(0x40ecc00 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:48:58.486 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:58.484+0000 7fe13865f780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-17T04:48:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-17T04:48:58.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:48:58.893 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:48:58.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:48:58.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:48:58.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:48:59.007 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:59.005+0000 7f8ef3e2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:59.008 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:59.006+0000 7f8ef3e2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:59.009 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:59.007+0000 7f8ef3e2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:48:59.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:48:59.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:48:59.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:48:59.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:48:59.202 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:59.201+0000 7f8ef3e2c780 -1 Falling back to public interface 2026-02-17T04:48:59.519 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:48:59.517+0000 7f8ef3e2c780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:00.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:49:00.247 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2816496312,v1:127.0.0.1:6801/2816496312] [v2:127.0.0.1:6802/2816496312,v1:127.0.0.1:6803/2816496312] exists,up 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 2026-02-17T04:49:00.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:49:00.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 1 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:49:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:00.253 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:49:00.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e7add0e9-a250-4472-9014-0773a0ba207f 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e7add0e9-a250-4472-9014-0773a0ba207f' 2026-02-17T04:49:00.255 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e7add0e9-a250-4472-9014-0773a0ba207f 2026-02-17T04:49:00.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:49:00.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA885NpEt/MDxAAXQe+faqWnHui+UeExeT68g== 2026-02-17T04:49:00.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA885NpEt/MDxAAXQe+faqWnHui+UeExeT68g=="}' 2026-02-17T04:49:00.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e7add0e9-a250-4472-9014-0773a0ba207f -i td/osd-scrub-snaps/1/new.json 2026-02-17T04:49:00.354 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:00.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/1/new.json 2026-02-17T04:49:00.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA885NpEt/MDxAAXQe+faqWnHui+UeExeT68g== --osd-uuid e7add0e9-a250-4472-9014-0773a0ba207f 2026-02-17T04:49:00.383 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.381+0000 7f0d7884c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:00.385 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.383+0000 7f0d7884c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:00.385 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.384+0000 7f0d7884c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:00.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.384+0000 7f0d7884c780 -1 bdev(0x3246c00 td/osd-scrub-snaps/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:00.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.384+0000 7f0d7884c780 -1 bluestore(td/osd-scrub-snaps/1) _read_fsid unparsable uuid 2026-02-17T04:49:00.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/1/keyring 2026-02-17T04:49:00.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:49:00.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:49:00.714 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:49:00.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:49:00.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:49:00.938 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:49:00.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:49:00.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:49:00.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:49:00.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:49:00.960 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.958+0000 7f308003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:00.961 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.959+0000 7f308003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:00.962 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:00.960+0000 7f308003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:01.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:49:01.114 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:01.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:01.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:49:01.115 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:01.112+0000 7f308003b780 -1 Falling back to public interface 2026-02-17T04:49:01.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:49:01.430 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:01.428+0000 7f308003b780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:49:02.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:49:02.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:02.287 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:02.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:49:02.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:02.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:49:02.463 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/222102795,v1:127.0.0.1:6811/222102795] [v2:127.0.0.1:6812/222102795,v1:127.0.0.1:6813/222102795] exists,up e7add0e9-a250-4472-9014-0773a0ba207f 2026-02-17T04:49:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:49:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:49:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:49:02.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:746: _scrub_snaps_multi: ceph osd set noscrub 2026-02-17T04:49:02.649 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:49:02.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:747: _scrub_snaps_multi: ceph osd set nodeep-scrub 2026-02-17T04:49:02.850 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:49:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:750: _scrub_snaps_multi: create_pool test 1 1 2026-02-17T04:49:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:49:03.053 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:49:03.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:49:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:751: _scrub_snaps_multi: wait_for_clean 2026-02-17T04:49:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:49:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:49:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:49:04.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:49:04.063 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:49:04.063 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:49:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:49:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:49:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:49:04.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:49:04.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:49:04.322 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:49:04.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:49:04.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:04.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:49:04.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-17T04:49:04.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-17T04:49:04.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-17T04:49:04.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:04.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-17T04:49:04.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:04.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:49:04.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-17T04:49:04.459 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:04.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-17T04:49:04.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-17T04:49:04.460 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836482 2026-02-17T04:49:04.460 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:04.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-17T04:49:04.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:04.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T04:49:04.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:04.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:49:04.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T04:49:04.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:04.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T04:49:04.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T04:49:04.635 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T04:49:04.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:49:04.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672961 -lt 42949672962 2026-02-17T04:49:04.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:49:05.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:49:05.808 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:49:05.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672961 -lt 42949672962 2026-02-17T04:49:05.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:49:06.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:49:06.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:49:07.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-17T04:49:07.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:49:07.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:49:07.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:49:07.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:49:07.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:49:07.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:49:07.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:49:07.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:49:07.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:49:07.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: ceph osd dump 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: grep '^pool.*['\'']test['\'']' 2026-02-17T04:49:07.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: awk '{ print $2 }' 2026-02-17T04:49:07.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: poolid=1 2026-02-17T04:49:07.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:754: _scrub_snaps_multi: dd if=/dev/urandom of=testdata.844249 bs=1032 count=1 2026-02-17T04:49:07.936 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:49:07.936 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:49:07.936 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.5636e-05 s, 29.0 MB/s 2026-02-17T04:49:07.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: seq 1 16 2026-02-17T04:49:07.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:07.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj1 testdata.844249 2026-02-17T04:49:07.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:07.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj2 testdata.844249 2026-02-17T04:49:07.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:07.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj3 testdata.844249 2026-02-17T04:49:08.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj4 testdata.844249 2026-02-17T04:49:08.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj5 testdata.844249 2026-02-17T04:49:08.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj6 testdata.844249 2026-02-17T04:49:08.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj7 testdata.844249 2026-02-17T04:49:08.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj8 testdata.844249 2026-02-17T04:49:08.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj9 testdata.844249 2026-02-17T04:49:08.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj10 testdata.844249 2026-02-17T04:49:08.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj11 testdata.844249 2026-02-17T04:49:08.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj12 testdata.844249 2026-02-17T04:49:08.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj13 testdata.844249 2026-02-17T04:49:08.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj14 testdata.844249 2026-02-17T04:49:08.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj15 testdata.844249 2026-02-17T04:49:08.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-17T04:49:08.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj16 testdata.844249 2026-02-17T04:49:08.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: get_primary test obj1 2026-02-17T04:49:08.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:49:08.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:49:08.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:49:08.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: local primary=1 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: get_not_primary test obj1 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-17T04:49:08.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:49:08.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:49:08.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:49:08.437 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:49:08.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T04:49:08.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-17T04:49:08.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T04:49:08.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: local replica=0 2026-02-17T04:49:08.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: eval create_scenario td/osd-scrub-snaps test testdata.844249 '$replica' 2026-02-17T04:49:08.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: create_scenario td/osd-scrub-snaps test testdata.844249 0 2026-02-17T04:49:08.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-17T04:49:08.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-17T04:49:08.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.844249 2026-02-17T04:49:08.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=0 2026-02-17T04:49:08.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-17T04:49:08.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-17T04:49:08.856 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap1 2026-02-17T04:49:08.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=1 2026-02-17T04:49:08.859 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:49:08.859 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:49:08.859 INFO:tasks.workunit.client.0.trial090.stderr:256 bytes copied, 6.1855e-05 s, 4.1 MB/s 2026-02-17T04:49:08.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.844249 2026-02-17T04:49:08.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:49:08.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:49:08.921 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-17T04:49:08.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:08.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.844249 2026-02-17T04:49:08.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:08.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.844249 2026-02-17T04:49:08.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:08.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.844249 2026-02-17T04:49:08.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:08.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.844249 2026-02-17T04:49:09.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:09.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.844249 2026-02-17T04:49:09.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:09.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.844249 2026-02-17T04:49:09.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:09.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.844249 2026-02-17T04:49:09.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:09.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.844249 2026-02-17T04:49:09.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-17T04:49:09.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.844249 2026-02-17T04:49:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-17T04:49:09.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-17T04:49:09.172 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap2 2026-02-17T04:49:09.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=2 2026-02-17T04:49:09.174 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records in 2026-02-17T04:49:09.174 INFO:tasks.workunit.client.0.trial090.stderr:2+0 records out 2026-02-17T04:49:09.175 INFO:tasks.workunit.client.0.trial090.stderr:512 bytes copied, 6.7576e-05 s, 7.6 MB/s 2026-02-17T04:49:09.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:49:09.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-17T04:49:09.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-17T04:49:09.273 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap3 2026-02-17T04:49:09.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=3 2026-02-17T04:49:09.277 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records in 2026-02-17T04:49:09.277 INFO:tasks.workunit.client.0.trial090.stderr:3+0 records out 2026-02-17T04:49:09.278 INFO:tasks.workunit.client.0.trial090.stderr:768 bytes copied, 5.967e-05 s, 12.9 MB/s 2026-02-17T04:49:09.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.844249 2026-02-17T04:49:09.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-17T04:49:09.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-17T04:49:09.375 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap4 2026-02-17T04:49:09.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=4 2026-02-17T04:49:09.380 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records in 2026-02-17T04:49:09.380 INFO:tasks.workunit.client.0.trial090.stderr:4+0 records out 2026-02-17T04:49:09.380 INFO:tasks.workunit.client.0.trial090.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 8.3435e-05 s, 12.3 MB/s 2026-02-17T04:49:09.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:49:09.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.844249 2026-02-17T04:49:09.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-17T04:49:09.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-17T04:49:09.477 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap5 2026-02-17T04:49:09.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-17T04:49:09.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-17T04:49:09.578 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap6 2026-02-17T04:49:09.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=6 2026-02-17T04:49:09.581 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records in 2026-02-17T04:49:09.581 INFO:tasks.workunit.client.0.trial090.stderr:6+0 records out 2026-02-17T04:49:09.581 INFO:tasks.workunit.client.0.trial090.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 8.6661e-05 s, 17.7 MB/s 2026-02-17T04:49:09.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.844249 2026-02-17T04:49:09.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-17T04:49:09.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-17T04:49:09.679 INFO:tasks.workunit.client.0.trial090.stdout:created pool test snap snap7 2026-02-17T04:49:09.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-17T04:49:09.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-17T04:49:09.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-17T04:49:09.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-17T04:49:09.744 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:49:09.744 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:49:09.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:49:09.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:49:09.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:49:09.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:49:09.849 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj1 2026-02-17T04:49:09.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:09.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-17T04:49:10.042 INFO:tasks.workunit.client.0.trial090.stdout:WARNING: only removing head with clones present 2026-02-17T04:49:10.042 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-17T04:49:10.081 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:49:10.081 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-17T04:49:10.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:10.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:49:10.256 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:2# 2026-02-17T04:49:10.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:49:10.292 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-17T04:49:10.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:10.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:10.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:49:10.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:49:10.483 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.483 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:49:10.483 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.483 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.484 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.485 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.486 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.487 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:49:10.488 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:10.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:49:10.588 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:c52c9666:::obj5:1# 2026-02-17T04:49:10.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:49:10.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:49:10.735 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:10.736 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:10.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:49:10.737 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:10.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:49:10.737 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-17T04:49:10.737 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-17T04:49:10.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:10.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=18 2026-02-17T04:49:10.822 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records in 2026-02-17T04:49:10.822 INFO:tasks.workunit.client.0.trial090.stderr:18+0 records out 2026-02-17T04:49:10.822 INFO:tasks.workunit.client.0.trial090.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 0.000112058 s, 41.1 MB/s 2026-02-17T04:49:10.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:49:10.951 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj3 2026-02-17T04:49:11.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:11.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=15 2026-02-17T04:49:11.044 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records in 2026-02-17T04:49:11.044 INFO:tasks.workunit.client.0.trial090.stderr:15+0 records out 2026-02-17T04:49:11.044 INFO:tasks.workunit.client.0.trial090.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 7.8416e-05 s, 49.0 MB/s 2026-02-17T04:49:11.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:49:11.182 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj4 2026-02-17T04:49:11.182 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-17T04:49:11.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:11.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:49:11.355 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-17T04:49:11.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:49:11.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:49:11.504 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:49:11.504 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.504 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:11.504 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:49:11.504 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.505 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.506 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.507 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:11.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:11.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.508 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:11.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.509 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:49:11.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.510 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.511 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-17T04:49:11.512 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj16 2026-02-17T04:49:11.512 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-17T04:49:11.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:11.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-17T04:49:11.689 INFO:tasks.workunit.client.0.trial090.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-17T04:49:11.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-17T04:49:11.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-17T04:49:11.829 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-17T04:49:11.829 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-17T04:49:11.829 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-17T04:49:11.829 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.830 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.831 INFO:tasks.workunit.client.0.trial090.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-17T04:49:11.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-17T04:49:11.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-17T04:49:11.832 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj2 2026-02-17T04:49:11.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:11.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-17T04:49:12.046 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.046 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-17T04:49:12.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.844249 bs=256 count=7 2026-02-17T04:49:12.048 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records in 2026-02-17T04:49:12.048 INFO:tasks.workunit.client.0.trial090.stderr:7+0 records out 2026-02-17T04:49:12.048 INFO:tasks.workunit.client.0.trial090.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 0.00010258 s, 17.5 MB/s 2026-02-17T04:49:12.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.844249 2026-02-17T04:49:12.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj6 2026-02-17T04:49:12.238 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:12.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:49:12.400 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj7 2026-02-17T04:49:12.455 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:12.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-17T04:49:12.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj8 2026-02-17T04:49:12.673 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:12.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-17T04:49:12.847 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj9 2026-02-17T04:49:12.893 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:12.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:12.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-17T04:49:13.062 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj10 2026-02-17T04:49:13.104 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-17T04:49:13.281 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj11 2026-02-17T04:49:13.326 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:13.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:13.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-17T04:49:13.488 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj13 2026-02-17T04:49:13.537 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:13.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:13.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-17T04:49:13.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj14 2026-02-17T04:49:13.749 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:13.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:13.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-17T04:49:13.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-17T04:49:13.925 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj15 2026-02-17T04:49:13.972 INFO:tasks.workunit.client.0.trial090.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-17T04:49:14.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T04:49:14.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-17T04:49:14.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-17T04:49:14.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-17T04:49:14.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:765: _scrub_snaps_multi: rm -f testdata.844249 2026-02-17T04:49:14.159 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: expr 2 - 1 2026-02-17T04:49:14.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: seq 0 1 2026-02-17T04:49:14.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:49:14.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 0 2026-02-17T04:49:14.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:49:14.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:49:14.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:49:14.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T04:49:14.167 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:49:14.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:49:14.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-17T04:49:14.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T04:49:14.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:49:14.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:49:14.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:49:14.184 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:14.181+0000 7f2fcd023780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:14.185 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:14.183+0000 7f2fcd023780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:14.186 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:14.184+0000 7f2fcd023780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:14.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:49:14.343 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:14.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:14.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:49:14.405 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:14.403+0000 7f2fcd023780 -1 Falling back to public interface 2026-02-17T04:49:14.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:49:14.701 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:14.699+0000 7f2fcd023780 -1 osd.0 22 log_to_monitors true 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:15.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:49:15.695 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 25 up_thru 25 down_at 23 last_clean_interval [5,22) [v2:127.0.0.1:6800/2605024121,v1:127.0.0.1:6801/2605024121] [v2:127.0.0.1:6802/2605024121,v1:127.0.0.1:6803/2605024121] exists,up 91ebf34c-8b52-4ba0-a58b-6fa28e777ce8 2026-02-17T04:49:15.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 1 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T04:49:15.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T04:49:15.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:49:15.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:49:15.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T04:49:15.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T04:49:15.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-17T04:49:15.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T04:49:15.701 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:49:15.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.844249/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T04:49:15.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/1/whoami 2026-02-17T04:49:15.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T04:49:15.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T04:49:15.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T04:49:15.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T04:49:15.717 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:15.715+0000 7f7092c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:15.719 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:15.717+0000 7f7092c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:15.720 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:15.718+0000 7f7092c39780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:15.837 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:15.834+0000 7f7092c39780 -1 Falling back to public interface 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:49:15.869 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:15.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:15.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:49:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:49:16.115 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:16.113+0000 7f7092c39780 -1 osd.1 22 log_to_monitors true 2026-02-17T04:49:17.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:49:17.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:49:17.042 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:17.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:49:17.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:49:17.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:49:17.216 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 23 last_clean_interval [10,22) [v2:127.0.0.1:6810/2236959492,v1:127.0.0.1:6811/2236959492] [v2:127.0.0.1:6812/2236959492,v1:127.0.0.1:6813/2236959492] exists,up e7add0e9-a250-4472-9014-0773a0ba207f 2026-02-17T04:49:17.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:49:17.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:49:17.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:49:17.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:772: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-17T04:49:17.277 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:17.278 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:49:17.278 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.286 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:17.286 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-17T04:49:17.286 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:773: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 3 2026-02-17T04:49:17.351 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:17.351 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-17T04:49:17.351 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.359 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:17.360 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-17T04:49:17.360 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:774: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_scrub_chunk_min 3 2026-02-17T04:49:17.424 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:17.424 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-17T04:49:17.424 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.431 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:17.432 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-17T04:49:17.432 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:775: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-17T04:49:17.496 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:17.496 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-17T04:49:17.497 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.505 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:17.505 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-17T04:49:17.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:776: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-17T04:49:17.569 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:17.569 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-17T04:49:17.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.576 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:17.577 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-17T04:49:17.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:777: _scrub_snaps_multi: wait_for_clean 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:49:17.583 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:49:17.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:49:17.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:49:17.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:49:17.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:49:17.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:49:17.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:49:17.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:49:17.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:49:17.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:49:17.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:49:17.840 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:49:17.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:49:17.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:17.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:49:17.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182402 2026-02-17T04:49:17.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182402 2026-02-17T04:49:17.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182402' 2026-02-17T04:49:17.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:17.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:49:17.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T04:49:17.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T04:49:17.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182402 1-120259084290' 2026-02-17T04:49:17.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:17.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-107374182402 2026-02-17T04:49:17.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:17.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:49:17.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-107374182402 2026-02-17T04:49:17.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:17.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182402 2026-02-17T04:49:17.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 107374182402' 2026-02-17T04:49:17.972 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 107374182402 2026-02-17T04:49:17.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:18.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 107374182402 2026-02-17T04:49:18.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:49:19.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:49:19.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:19.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182402 -lt 107374182402 2026-02-17T04:49:19.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:19.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-17T04:49:19.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:19.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:49:19.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-17T04:49:19.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:19.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T04:49:19.323 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 120259084290 2026-02-17T04:49:19.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-17T04:49:19.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:49:19.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T04:49:19.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:49:19.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:49:19.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:49:19.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:49:19.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:49:19.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:49:19.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:49:19.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:49:19.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:779: _scrub_snaps_multi: local pgid=1.0 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:780: _scrub_snaps_multi: pg_scrub 1.0 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-17T04:49:20.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:49:20.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:49:20.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T04:49:20.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T04:49:20.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T04:49:20.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T04:49:20.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:49:20.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:49:20.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:49:20.475 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:49:20.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:49:20.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:20.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:49:20.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182404 2026-02-17T04:49:20.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182404 2026-02-17T04:49:20.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182404' 2026-02-17T04:49:20.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:49:20.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:49:20.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-17T04:49:20.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-17T04:49:20.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182404 1-120259084291' 2026-02-17T04:49:20.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:20.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-107374182404 2026-02-17T04:49:20.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:20.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:49:20.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-107374182404 2026-02-17T04:49:20.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:20.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182404 2026-02-17T04:49:20.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 107374182404' 2026-02-17T04:49:20.609 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 107374182404 2026-02-17T04:49:20.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:20.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182403 -lt 107374182404 2026-02-17T04:49:20.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:49:21.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:49:21.787 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:21.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182403 -lt 107374182404 2026-02-17T04:49:21.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:49:22.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:49:22.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:49:23.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182404 -lt 107374182404 2026-02-17T04:49:23.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:49:23.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084291 2026-02-17T04:49:23.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:49:23.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:49:23.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084291 2026-02-17T04:49:23.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:49:23.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-17T04:49:23.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084291' 2026-02-17T04:49:23.136 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 120259084291 2026-02-17T04:49:23.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:49:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084291 2026-02-17T04:49:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T04:49:23.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T04:49:23.310 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T04:49:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T04:49:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T04:49:23.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T04:49:23.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T04:49:23.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T04:49:23.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T04:49:23.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T04:49:23.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:49:23.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:49:23.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:23.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-17T04:49:23.712 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:49:23.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:49:23.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:49:03.050319+0000 '>' 2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:23.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:49:24.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:49:24.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:49:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:49:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:49:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:49:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:49:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:49:25.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:49:03.050319+0000 '>' 2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:25.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:49:26.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:49:26.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:49:26.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:49:26.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:49:26.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:49:26.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:49:26.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:49:26.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:49:03.050319+0000 '>' 2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:26.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:49:27.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:49:27.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-17T04:49:27.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:49:27.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:49:27.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:49:27.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:49:27.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:49:27.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:49:24.152850+0000 '>' 2026-02-17T04:49:03.050319+0000 2026-02-17T04:49:27.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:49:27.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:27.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: wc -l 2026-02-17T04:49:27.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: test 16 -gt 3 2026-02-17T04:49:27.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:49:27.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: wc -l 2026-02-17T04:49:27.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: test 16 -gt 3 2026-02-17T04:49:27.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:787: _scrub_snaps_multi: rados list-inconsistent-pg test 2026-02-17T04:49:27.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: jq '. | length' td/osd-scrub-snaps/json 2026-02-17T04:49:27.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: test 1 = 1 2026-02-17T04:49:27.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-17T04:49:27.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: test 1.0 = 1.0 2026-02-17T04:49:27.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:793: _scrub_snaps_multi: rados list-inconsistent-obj 1.0 --format=json-pretty 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "epoch": 28, 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "inconsistents": [ 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj1", 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.460 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "version": 18 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "missing" 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.461 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj1", 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1828249343, 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'18", 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'1", 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4220.0:1", 2026-02-17T04:49:27.462 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 18, 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:08.877464+0000", 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:08.877822+0000", 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.463 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.464 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "missing" 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.465 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj10", 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.466 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "version": 32 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj10", 2026-02-17T04:49:27.467 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 718195851, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'32", 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'10", 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4241.0:1", 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 32, 2026-02-17T04:49:27.468 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.020277+0000", 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.020598+0000", 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.469 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.470 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.471 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "????", 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.472 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.473 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj11", 2026-02-17T04:49:27.474 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "version": 34 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj11", 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.475 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 693400951, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'34", 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'11", 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4244.0:1", 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 34, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.040092+0000", 2026-02-17T04:49:27.476 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.040397+0000", 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.477 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.478 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.479 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.480 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj13", 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "version": 38 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj13", 2026-02-17T04:49:27.481 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2087409765, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'38", 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'13", 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4250.0:1", 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 38, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.482 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.079994+0000", 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.080309+0000", 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.483 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.484 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]" 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.485 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.486 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj14", 2026-02-17T04:49:27.487 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "version": 40 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj14", 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.488 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2484217095, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'40", 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'14", 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4253.0:1", 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 40, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.099803+0000", 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.100091+0000", 2026-02-17T04:49:27.489 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.490 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.491 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1033, 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.492 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.493 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj15", 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "version": 15 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_corrupted" 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.494 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj15", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 612772309, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "version": "15'15", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "0'0", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4205.0:1", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 15, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:08.236286+0000", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:08.236605+0000", 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.495 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xbd2d9638", 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.496 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_corrupted" 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": "Z2FyYmFnZQo=" 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.497 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj2", 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: "version": 56 2026-02-17T04:49:27.498 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_missing" 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj2", 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1058988552, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "version": "22'56", 2026-02-17T04:49:27.499 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "19'48", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4295.0:1", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 56, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.740579+0000", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.740872+0000", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "whiteout", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "dirty" 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0xffffffff", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.500 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_missing" 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.501 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "size": 0, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 7, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 4, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: 4, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: 3, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: 2, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.502 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 7, 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1024, 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: 7, 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: 6, 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: 5 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj3", 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.503 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "version": 44 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch" 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [ 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch_info", 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "obj_size_info_mismatch" 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj3", 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1643547569, 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.504 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "version": "18'44", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "16'22", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4265.0:1", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 44, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.295296+0000", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.295578+0000", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x14d1833b", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.505 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "size_mismatch_info", 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "obj_size_info_mismatch" 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "size": 3840, 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "object_info": { 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj3", 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.506 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1643547569, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "version": "18'44", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "16'22", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4265.0:1", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 44, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.295296+0000", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.295578+0000", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x14d1833b", 2026-02-17T04:49:27.507 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "size": 768 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.508 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj6", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "version": 24 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj6", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2202164420, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'24", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'6", 2026-02-17T04:49:27.509 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4229.0:1", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 24, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:08.941184+0000", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:08.941504+0000", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.510 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.511 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj7", 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "version": 26 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj7", 2026-02-17T04:49:27.512 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 1552453721, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'26", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'7", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4232.0:1", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 26, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:08.961168+0000", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:08.961492+0000", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.513 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [] 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.514 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj8", 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "version": 28 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.515 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj8", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 2381834917, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'28", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'8", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4235.0:1", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 28, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:08.980458+0000", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:08.980730+0000", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.516 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 0, 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.517 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.518 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "object": { 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "name": "obj9", 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "nspace": "", 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "locator": "", 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "snap": "head", 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "version": 30 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [ 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "snapset_inconsistency" 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "union_shard_errors": [], 2026-02-17T04:49:27.519 INFO:tasks.workunit.client.0.trial090.stdout: "selected_object_info": { 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "oid": { 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "oid": "obj9", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "key": "", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "snapid": -2, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "hash": 3833113727, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "max": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "pool": 1, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "namespace": "" 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "version": "16'30", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "prior_version": "15'9", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "last_reqid": "client.4238.0:1", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "user_version": 30, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "mtime": "2026-02-17T04:49:09.000675+0000", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "local_mtime": "2026-02-17T04:49:09.001050+0000", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "lost": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "flags": [ 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "dirty", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest" 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_seq": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "truncate_size": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "data_digest": "0x5a07602d", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "omap_digest": "0xffffffff", 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "expected_object_size": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "expected_write_size": 0, 2026-02-17T04:49:27.520 INFO:tasks.workunit.client.0.trial090.stdout: "alloc_hint_flags": 0, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "manifest": { 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "type": 0 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "watchers": {}, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "shard_versions": [] 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "shards": [ 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 0, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "primary": false, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "size": "????", 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.521 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "osd": 1, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "primary": true, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "errors": [], 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "size": 256, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "snapset": { 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "seq": 1, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "clones": [ 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "snap": 1, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "size": 1032, 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "overlap": "[]", 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: "snaps": [ 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: 1 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:49:27.522 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:27.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:795: _scrub_snaps_multi: rados list-inconsistent-snapset 1.0 2026-02-17T04:49:27.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:798: _scrub_snaps_multi: '[' replica = replica ']' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:800: _scrub_snaps_multi: scruberrors=20 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:801: _scrub_snaps_multi: jq .inconsistents 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:801: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: jq .inconsistents td/osd-scrub-snaps/json 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1065: _scrub_snaps_multi: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1066: _scrub_snaps_multi: test no = yes 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1071: _scrub_snaps_multi: test '' = yes 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: find td/osd-scrub-snaps 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: grep 'osd[^/]*\.pid' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: pidfiles='td/osd-scrub-snaps/osd.1.pid 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:td/osd-scrub-snaps/osd.0.pid' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1077: _scrub_snaps_multi: pids= 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.1.pid 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='895925 ' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.0.pid 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='895384 ' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1083: _scrub_snaps_multi: ERRORS=0 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1087: _scrub_snaps_multi: '[' replica = primary ']' 2026-02-17T04:49:27.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1109: _scrub_snaps_multi: ceph pg dump pgs 2026-02-17T04:49:27.669 INFO:tasks.workunit.client.0.trial090.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:49:27.669 INFO:tasks.workunit.client.0.trial090.stdout:1.0 36 0 0 0 0 24448 0 0 56 0 56 active+clean+inconsistent 2026-02-17T04:49:24.152886+0000 22'56 30:105 [1,0] 1 [1,0] 1 22'56 2026-02-17T04:49:24.152850+0000 0'0 2026-02-17T04:49:03.050319+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:35:54.513142+0000 36 0 2026-02-17T04:49:27.669 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:49:27.669 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:49:27.669 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:49:27.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 895925 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 895384 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1120: _scrub_snaps_multi: kill_daemons td/osd-scrub-snaps 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:49:27.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:49:32.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1122: _scrub_snaps_multi: declare -a err_strings 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1123: _scrub_snaps_multi: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1124: _scrub_snaps_multi: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1125: _scrub_snaps_multi: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1126: _scrub_snaps_multi: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1127: _scrub_snaps_multi: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1128: _scrub_snaps_multi: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1129: _scrub_snaps_multi: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1130: _scrub_snaps_multi: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:32.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:32.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:32.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:32.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:32.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:32.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:32.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:32.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:33.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:33.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-17T04:49:33.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' td/osd-scrub-snaps/osd.1.log 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1142: _scrub_snaps_multi: declare -a rep_err_strings 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: eval echo '$replica' 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: echo 0 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: osd=0 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1144: _scrub_snaps_multi: rep_err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1145: _scrub_snaps_multi: for err_string in "${rep_err_strings[@]}" 2026-02-17T04:49:33.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1147: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.0.log 2026-02-17T04:49:33.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1154: _scrub_snaps_multi: '[' 0 '!=' 0 ']' 2026-02-17T04:49:33.007 INFO:tasks.workunit.client.0.trial090.stdout:TEST PASSED 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1160: _scrub_snaps_multi: echo 'TEST PASSED' 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1161: _scrub_snaps_multi: return 0 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1169: TEST_scrub_snaps_replica: err=0 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1170: TEST_scrub_snaps_replica: CEPH_ARGS='--fsid=6da1d947-421f-42bc-a85e-a7418d3a9491 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1171: TEST_scrub_snaps_replica: return 0 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:49:33.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:49:33.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:49:33.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:49:33.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:49:33.014 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:49:33.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:49:33.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:49:33.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:49:33.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:49:33.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:49:33.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:49:33.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:49:33.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:49:33.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:49:33.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:33.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:49:33.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-snaps 0 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-17T04:49:33.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:49:33.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:49:33.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:49:33.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:49:33.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:49:33.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:49:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:49:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:49:33.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:49:33.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:49:33.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:49:33.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:49:33.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T04:49:33.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-17T04:49:33.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:49:33.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:33.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.844249 2026-02-17T04:49:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.844249 2026-02-17T04:49:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:49:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:49:33.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T04:49:33.039 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T04:49:33.039 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T04:49:33.064 INFO:tasks.workunit:Running workunit scrub/osd-scrub-test.sh... 2026-02-17T04:49:33.064 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-scrub-test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh 2026-02-17T04:49:33.126 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T04:49:33.131 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T04:49:33.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-test 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:21: run: local dir=td/osd-scrub-test 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:22: run: shift 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:24: run: export CEPH_MON=127.0.0.1:7138 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:24: run: CEPH_MON=127.0.0.1:7138 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:25: run: export CEPH_ARGS 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:26: run: uuidgen 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:26: run: CEPH_ARGS+='--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none ' 2026-02-17T04:49:33.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7138 ' 2026-02-17T04:49:33.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:29: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: set 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: local 'funcs=TEST_abort_periodic_for_operator 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_deep_scrub_abort 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_dump_scrub_schedule 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_interval_changes 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_just_deep_scrubs 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_pg_dump_objects_scrubbed 2026-02-17T04:49:33.135 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_abort 2026-02-17T04:49:33.136 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_permit_time 2026-02-17T04:49:33.136 INFO:tasks.workunit.client.0.trial090.stderr:TEST_scrub_test' 2026-02-17T04:49:33.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T04:49:33.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_abort_periodic_for_operator -------------------' 2026-02-17T04:49:33.136 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_abort_periodic_for_operator ------------------- 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:49:33.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:49:33.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:49:33.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:49:33.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:49:33.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:49:33.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:49:33.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:33.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:49:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:49:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:49:33.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:49:33.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T04:49:33.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:49:33.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:49:33.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:49:33.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T04:49:33.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:49:33.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T04:49:33.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T04:49:33.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:49:33.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T04:49:33.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_abort_periodic_for_operator -----------------------' 2026-02-17T04:49:33.147 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_abort_periodic_for_operator ----------------------- 2026-02-17T04:49:33.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_abort_periodic_for_operator td/osd-scrub-test 2026-02-17T04:49:33.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:748: TEST_abort_periodic_for_operator: local dir=td/osd-scrub-test 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:749: TEST_abort_periodic_for_operator: cluster_conf=(['osds_num']='5' ['pgs_in_pool']='16' ['pool_name']='test') 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:749: TEST_abort_periodic_for_operator: local -A cluster_conf 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:754: TEST_abort_periodic_for_operator: local extr_dbg=1 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:756: TEST_abort_periodic_for_operator: standard_scrub_wpq_cluster td/osd-scrub-test cluster_conf 2 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:302: standard_scrub_wpq_cluster: local dir=td/osd-scrub-test 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:303: standard_scrub_wpq_cluster: local -n conf=cluster_conf 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:304: standard_scrub_wpq_cluster: local osd_sleep=2 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:306: standard_scrub_wpq_cluster: conf['extras']=' --osd_op_queue=wpq --osd_scrub_sleep=2 ' 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:308: standard_scrub_wpq_cluster: standard_scrub_cluster td/osd-scrub-test conf 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-test 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=conf 2026-02-17T04:49:33.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=5 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=16 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_op_queue=wpq --osd_scrub_sleep=2 ' 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T04:49:33.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T04:49:33.385 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 843405b2-24a3-4c45-9e5a-3641dd0ba637 2026-02-17T04:49:33.474 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:33.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:33.500+0000 7ff793253780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:33.503 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:33.501+0000 7ff793253780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:33.503 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:33.502+0000 7ff793253780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:33.504 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:33.502+0000 7ff793253780 -1 bdev(0x25e2c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:33.504 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:33.502+0000 7ff793253780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T04:49:33.948 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:49:34.031 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:49:34.051 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:34.049+0000 7fcfad7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:34.053 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:34.051+0000 7fcfad7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:34.053 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:34.052+0000 7fcfad7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:34.111 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:34.256 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:34.255+0000 7fcfad7fd780 -1 Falling back to public interface 2026-02-17T04:49:34.656 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:34.654+0000 7fcfad7fd780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:49:35.194 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:35.272 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3017180166,v1:127.0.0.1:6801/3017180166] [v2:127.0.0.1:6802/3017180166,v1:127.0.0.1:6803/3017180166] exists,up 843405b2-24a3-4c45-9e5a-3641dd0ba637 2026-02-17T04:49:35.276 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 73b3e601-fca5-4abc-b48c-4d68ea8cd134 2026-02-17T04:49:35.364 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:35.390 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.388+0000 7f875303d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:35.391 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.390+0000 7f875303d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:35.392 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.390+0000 7f875303d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:35.392 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.391+0000 7f875303d780 -1 bdev(0x2dc0c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:35.392 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.391+0000 7f875303d780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T04:49:35.764 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:49:35.975 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:49:36.001 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:35.999+0000 7fa4bbc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:36.002 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:36.000+0000 7fa4bbc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:36.003 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:36.001+0000 7fa4bbc32780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:36.135 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:36.133+0000 7fa4bbc32780 -1 Falling back to public interface 2026-02-17T04:49:36.142 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:36.428 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:36.426+0000 7fa4bbc32780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:49:37.308 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:37.471 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/787286498,v1:127.0.0.1:6811/787286498] [v2:127.0.0.1:6812/787286498,v1:127.0.0.1:6813/787286498] exists,up 73b3e601-fca5-4abc-b48c-4d68ea8cd134 2026-02-17T04:49:37.476 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 b68b87d7-9899-4120-9f3e-707e9fee2982 2026-02-17T04:49:37.650 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:49:37.679 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:37.677+0000 7fed12a6a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:37.680 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:37.678+0000 7fed12a6a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:37.681 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:37.679+0000 7fed12a6a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:37.681 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:37.679+0000 7fed12a6a780 -1 bdev(0x3012c00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:37.681 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:37.680+0000 7fed12a6a780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T04:49:38.005 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:49:38.220 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:49:38.239 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:38.238+0000 7fccc5c65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:38.241 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:38.239+0000 7fccc5c65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:38.242 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:38.240+0000 7fccc5c65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:38.386 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:38.432 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:38.430+0000 7fccc5c65780 -1 Falling back to public interface 2026-02-17T04:49:38.738 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:38.736+0000 7fccc5c65780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:49:39.550 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:39.713 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1987231786,v1:127.0.0.1:6819/1987231786] [v2:127.0.0.1:6820/1987231786,v1:127.0.0.1:6821/1987231786] exists,up b68b87d7-9899-4120-9f3e-707e9fee2982 2026-02-17T04:49:39.718 INFO:tasks.workunit.client.0.trial090.stdout:add osd3 fd74ad72-f329-46d0-bb4f-eee7a305d732 2026-02-17T04:49:39.891 INFO:tasks.workunit.client.0.trial090.stdout:3 2026-02-17T04:49:39.920 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:39.919+0000 7f9b9601d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:39.922 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:39.921+0000 7f9b9601d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:39.923 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:39.922+0000 7f9b9601d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:39.923 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:39.922+0000 7f9b9601d780 -1 bdev(0x3e9ec00 td/osd-scrub-test/3/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:39.924 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:39.922+0000 7f9b9601d780 -1 bluestore(td/osd-scrub-test/3) _read_fsid unparsable uuid 2026-02-17T04:49:40.260 INFO:tasks.workunit.client.0.trial090.stdout:adding osd3 key to auth repository 2026-02-17T04:49:40.471 INFO:tasks.workunit.client.0.trial090.stdout:start osd.3 2026-02-17T04:49:40.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:40.490+0000 7fa589873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:40.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:40.492+0000 7fa589873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:40.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:40.493+0000 7fa589873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:40.624 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:40.623+0000 7fa589873780 -1 Falling back to public interface 2026-02-17T04:49:40.635 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:40.891 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:40.890+0000 7fa589873780 -1 osd.3 0 log_to_monitors true 2026-02-17T04:49:41.804 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:41.971 INFO:tasks.workunit.client.0.trial090.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3846860108,v1:127.0.0.1:6827/3846860108] [v2:127.0.0.1:6828/3846860108,v1:127.0.0.1:6829/3846860108] exists,up fd74ad72-f329-46d0-bb4f-eee7a305d732 2026-02-17T04:49:41.975 INFO:tasks.workunit.client.0.trial090.stdout:add osd4 2c525af1-80dc-470e-aca5-d4db94b1c73f 2026-02-17T04:49:42.147 INFO:tasks.workunit.client.0.trial090.stdout:4 2026-02-17T04:49:42.176 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.175+0000 7f165d05f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.177 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.176+0000 7f165d05f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.177+0000 7f165d05f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.178+0000 7f165d05f780 -1 bdev(0x2b26c00 td/osd-scrub-test/4/block) open stat got: (1) Operation not permitted 2026-02-17T04:49:42.178 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.178+0000 7f165d05f780 -1 bluestore(td/osd-scrub-test/4) _read_fsid unparsable uuid 2026-02-17T04:49:42.505 INFO:tasks.workunit.client.0.trial090.stdout:adding osd4 key to auth repository 2026-02-17T04:49:42.717 INFO:tasks.workunit.client.0.trial090.stdout:start osd.4 2026-02-17T04:49:42.736 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.735+0000 7f2778862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.737 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.737+0000 7f2778862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.738 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.738+0000 7f2778862780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:49:42.871 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:42.870+0000 7f2778862780 -1 Falling back to public interface 2026-02-17T04:49:42.882 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:49:43.194 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:49:43.193+0000 7f2778862780 -1 osd.4 0 log_to_monitors true 2026-02-17T04:49:44.047 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:49:44.216 INFO:tasks.workunit.client.0.trial090.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1287363053,v1:127.0.0.1:6835/1287363053] [v2:127.0.0.1:6836/1287363053,v1:127.0.0.1:6837/1287363053] exists,up 2c525af1-80dc-470e-aca5-d4db94b1c73f 2026-02-17T04:49:44.405 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:49:45.958 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836492 2026-02-17T04:49:48.465 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672971 2026-02-17T04:49:48.632 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509447 2026-02-17T04:49:48.802 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.3 seq 85899345925 2026-02-17T04:49:48.974 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.4 seq 107374182403 2026-02-17T04:49:50.901 INFO:tasks.workunit.client.0.trial090.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-17T04:49:50.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:757: TEST_abort_periodic_for_operator: local poolid=1 2026-02-17T04:49:50.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:758: TEST_abort_periodic_for_operator: local poolname=test 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:759: TEST_abort_periodic_for_operator: echo 'Pool: test : 1' 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:762: TEST_abort_periodic_for_operator: local saved_echo_flag=x 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:763: TEST_abort_periodic_for_operator: set +x 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:49:50.903 INFO:tasks.workunit.client.0.trial090.stderr:320 bytes copied, 3.9613e-05 s, 8.1 MB/s 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:776: TEST_abort_periodic_for_operator: declare -A pg_pr 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:777: TEST_abort_periodic_for_operator: declare -A pg_ac 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:778: TEST_abort_periodic_for_operator: declare -A pg_po 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:779: TEST_abort_periodic_for_operator: build_pg_dicts td/osd-scrub-test pg_pr pg_ac pg_po - 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-test 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-17T04:49:54.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-17T04:49:55.133 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:49:55.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:780: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:49:55.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:49:55.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:785: TEST_abort_periodic_for_operator: wait_initial_scrubs pg_pr 2026-02-17T04:49:55.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:691: wait_initial_scrubs: local -n pg_to_prim_dict=pg_pr 2026-02-17T04:49:55.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:692: wait_initial_scrubs: local extr_dbg=1 2026-02-17T04:49:55.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:696: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_min_interval 7200 2026-02-17T04:49:55.199 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.200 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:49:55.200 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.208 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.208 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:49:55.208 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.216 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.216 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:49:55.216 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.224 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.224 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:49:55.224 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.232 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.232 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:49:55.232 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:697: wait_initial_scrubs: ceph tell 'osd.*' config set osd_deep_scrub_interval 14400 2026-02-17T04:49:55.291 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.291 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-17T04:49:55.291 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.299 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.299 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-17T04:49:55.299 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.307 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.307 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-17T04:49:55.307 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.315 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.315 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-17T04:49:55.315 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.322 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.323 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-17T04:49:55.323 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:698: wait_initial_scrubs: ceph tell 'osd.*' config set osd_max_scrubs 32 2026-02-17T04:49:55.381 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.381 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:49:55.382 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.389 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.389 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:49:55.389 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.396 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.396 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:49:55.397 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.404 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.404 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:49:55.404 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.411 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.411 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:49:55.411 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:699: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_sleep 1 2026-02-17T04:49:55.471 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.471 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:49:55.471 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.479 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.480 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:49:55.480 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.487 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.487 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:49:55.487 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.494 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.494 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:49:55.494 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.502 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.502 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:49:55.502 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:700: wait_initial_scrubs: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 10 2026-02-17T04:49:55.561 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.561 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:49:55.562 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.569 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.570 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:49:55.570 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.577 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.577 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:49:55.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.584 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.585 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:49:55.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.592 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.592 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:49:55.592 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:701: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_chunk_max 10 2026-02-17T04:49:55.652 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:49:55.652 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:49:55.652 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.660 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:49:55.661 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:49:55.661 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.668 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:49:55.668 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:49:55.668 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.675 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:49:55.675 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:49:55.676 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.683 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:49:55.683 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:49:55.683 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.8' 2026-02-17T04:49:55.689 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.8 2026-02-17T04:49:55.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.8 scrub 2026-02-17T04:49:55.744 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:55.744 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:55.744 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:55.744 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:55.744 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.9' 2026-02-17T04:49:55.749 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.9 2026-02-17T04:49:55.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.9 scrub 2026-02-17T04:49:55.802 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:55.802 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:55.802 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:55.802 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:55.802 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.4' 2026-02-17T04:49:55.807 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.4 2026-02-17T04:49:55.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.4 scrub 2026-02-17T04:49:55.860 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:55.861 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:55.861 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.5' 2026-02-17T04:49:55.866 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.5 2026-02-17T04:49:55.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.5 scrub 2026-02-17T04:49:55.920 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:55.920 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:55.920 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:55.920 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:55.920 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.6' 2026-02-17T04:49:55.925 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.6 2026-02-17T04:49:55.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.6 scrub 2026-02-17T04:49:55.978 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:55.978 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:55.978 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:55.979 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:55.979 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:55.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:55.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:55.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.7' 2026-02-17T04:49:55.984 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.7 2026-02-17T04:49:55.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.7 scrub 2026-02-17T04:49:56.035 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.035 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.035 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.035 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.035 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.0' 2026-02-17T04:49:56.039 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.0 2026-02-17T04:49:56.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.0 scrub 2026-02-17T04:49:56.094 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.095 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.095 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.095 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.095 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.1' 2026-02-17T04:49:56.100 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.1 2026-02-17T04:49:56.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.1 scrub 2026-02-17T04:49:56.155 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.155 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.155 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.155 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.155 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.2' 2026-02-17T04:49:56.160 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.2 2026-02-17T04:49:56.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.2 scrub 2026-02-17T04:49:56.214 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.214 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.214 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.214 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.214 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.3' 2026-02-17T04:49:56.219 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.3 2026-02-17T04:49:56.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.3 scrub 2026-02-17T04:49:56.273 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.273 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.273 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.273 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.273 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.d' 2026-02-17T04:49:56.279 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.d 2026-02-17T04:49:56.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.d scrub 2026-02-17T04:49:56.330 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.331 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.331 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.331 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.331 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.e' 2026-02-17T04:49:56.336 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.e 2026-02-17T04:49:56.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.e scrub 2026-02-17T04:49:56.388 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.388 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.389 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.389 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.389 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.f' 2026-02-17T04:49:56.393 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.f 2026-02-17T04:49:56.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.f scrub 2026-02-17T04:49:56.447 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.447 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.447 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.447 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.448 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.a' 2026-02-17T04:49:56.452 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.a 2026-02-17T04:49:56.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.a scrub 2026-02-17T04:49:56.505 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.505 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.505 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.505 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.505 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.b' 2026-02-17T04:49:56.511 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.b 2026-02-17T04:49:56.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.b scrub 2026-02-17T04:49:56.566 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.566 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.566 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.566 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.566 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-17T04:49:56.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:56.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.c' 2026-02-17T04:49:56.570 INFO:tasks.workunit.client.0.trial090.stdout:Scheduling initial scrub for 1.c 2026-02-17T04:49:56.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.c scrub 2026-02-17T04:49:56.624 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:49:56.624 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:49:56.624 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:49:56.624 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:49:56.624 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:49:56.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:708: wait_initial_scrubs: sleep 1 2026-02-17T04:49:57.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:709: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:57.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:709: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:49:57.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:710: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:49:57.784 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.f", 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.e", 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.d", 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.1", 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.792 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.c", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.3", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.6", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.7", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.8", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.9", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.a", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:57.793 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:49:57.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:712: wait_initial_scrubs: tout=20 2026-02-17T04:49:57.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 20 -gt 0 ']' 2026-02-17T04:49:57.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:49:58.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:49:58.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:49:58.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:49:58.952 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.f", 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.960 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.e", 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.d", 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.961 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.1", 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.c", 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.962 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.3", 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.6", 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.7", 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.963 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.8", 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.9", 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.a", 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:49:58.964 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:49:58.965 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:49:58.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:49:58.965 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:49:58.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:49:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:49:58.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:49:59.113 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:49:59.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=58 2026-02-17T04:49:59.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 58 -le 1 ']' 2026-02-17T04:49:59.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=14 2026-02-17T04:49:59.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 14 PGs to finish initial scrubs (timeout 20)' 2026-02-17T04:49:59.122 INFO:tasks.workunit.client.0.trial090.stdout:Still waiting for 14 PGs to finish initial scrubs (timeout 20) 2026-02-17T04:49:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=19 2026-02-17T04:49:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 19 -gt 0 ']' 2026-02-17T04:49:59.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:50:00.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:50:00.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:00.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:00.282 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:00.289 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:50:00.289 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.289 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.e", 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.c", 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.290 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.7", 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.a", 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:00.291 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:00.292 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:50:00.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:00.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:00.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:50:00.444 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:00.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=26 2026-02-17T04:50:00.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 26 -le 1 ']' 2026-02-17T04:50:00.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=6 2026-02-17T04:50:00.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 6 PGs to finish initial scrubs (timeout 19)' 2026-02-17T04:50:00.454 INFO:tasks.workunit.client.0.trial090.stdout:Still waiting for 6 PGs to finish initial scrubs (timeout 19) 2026-02-17T04:50:00.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=18 2026-02-17T04:50:00.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 18 -gt 0 ']' 2026-02-17T04:50:00.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:50:01.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:50:01.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:01.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:01.614 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:01.622 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.e", 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.a", 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:50:01.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:01.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:01.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:50:01.780 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:01.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=14 2026-02-17T04:50:01.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 14 -le 1 ']' 2026-02-17T04:50:01.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=3 2026-02-17T04:50:01.789 INFO:tasks.workunit.client.0.trial090.stdout:Still waiting for 3 PGs to finish initial scrubs (timeout 18) 2026-02-17T04:50:01.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 3 PGs to finish initial scrubs (timeout 18)' 2026-02-17T04:50:01.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=17 2026-02-17T04:50:01.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 17 -gt 0 ']' 2026-02-17T04:50:01.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:50:02.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:50:02.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:02.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:02.950 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:02.958 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:50:02.958 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:02.958 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.e", 2026-02-17T04:50:02.958 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:02.958 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.a", 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:02.959 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:50:02.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:02.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:02.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:50:03.114 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:03.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=14 2026-02-17T04:50:03.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 14 -le 1 ']' 2026-02-17T04:50:03.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=3 2026-02-17T04:50:03.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 3 PGs to finish initial scrubs (timeout 17)' 2026-02-17T04:50:03.124 INFO:tasks.workunit.client.0.trial090.stdout:Still waiting for 3 PGs to finish initial scrubs (timeout 17) 2026-02-17T04:50:03.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=16 2026-02-17T04:50:03.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 16 -gt 0 ']' 2026-02-17T04:50:03.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:50:04.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:50:04.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:04.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:04.283 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout:[ 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.b", 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout: "last_scrub_duration": 0 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:04.291 INFO:tasks.workunit.client.0.trial090.stdout:] 2026-02-17T04:50:04.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:04.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:04.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:50:04.449 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:04.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=6 2026-02-17T04:50:04.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 6 -le 1 ']' 2026-02-17T04:50:04.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=1 2026-02-17T04:50:04.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 1 PGs to finish initial scrubs (timeout 16)' 2026-02-17T04:50:04.460 INFO:tasks.workunit.client.0.trial090.stdout:Still waiting for 1 PGs to finish initial scrubs (timeout 16) 2026-02-17T04:50:04.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=15 2026-02-17T04:50:04.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 15 -gt 0 ']' 2026-02-17T04:50:04.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-17T04:50:05.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-17T04:50:05.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:05.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:05.614 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:05.622 INFO:tasks.workunit.client.0.trial090.stdout:[] 2026-02-17T04:50:05.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:05.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:05.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-17T04:50:05.776 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=1 2026-02-17T04:50:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 1 -le 1 ']' 2026-02-17T04:50:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:721: wait_initial_scrubs: break 2026-02-17T04:50:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:727: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T04:50:05.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:728: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-17T04:50:05.938 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:05.946 INFO:tasks.workunit.client.0.trial090.stdout:[] 2026-02-17T04:50:05.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:729: wait_initial_scrubs: (( tout == 0 )) 2026-02-17T04:50:05.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:730: wait_initial_scrubs: return 0 2026-02-17T04:50:05.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:788: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_max_scrubs 1 2026-02-17T04:50:06.001 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:06.001 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.001 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.009 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:06.009 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.009 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.016 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:06.016 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.016 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.024 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:06.024 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.024 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.031 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:06.031 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.031 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:789: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_stats_update_period_not_scrubbing 1 2026-02-17T04:50:06.093 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:06.094 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:50:06.094 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.101 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:06.101 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:50:06.102 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.109 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:06.109 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:50:06.109 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.116 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:06.116 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:50:06.116 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.124 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:06.124 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-17T04:50:06.124 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:792: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_scrub_sleep 3 2026-02-17T04:50:06.183 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:06.183 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:50:06.183 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.192 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:06.192 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:50:06.192 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.200 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:06.200 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:50:06.200 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.207 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:06.207 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:50:06.207 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.214 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:06.215 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:50:06.215 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:793: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 2 2026-02-17T04:50:06.274 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:06.274 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:50:06.274 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.282 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:06.282 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:50:06.282 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.289 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:06.290 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:50:06.290 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.297 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:06.297 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:50:06.297 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.304 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:06.304 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:50:06.305 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:794: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_scrub_chunk_max 2 2026-02-17T04:50:06.363 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:06.363 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:50:06.364 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.372 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:06.372 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:50:06.372 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.380 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:06.380 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:50:06.380 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.387 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:06.387 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:50:06.387 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.395 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:06.395 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-17T04:50:06.395 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:795: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:798: TEST_abort_periodic_for_operator: local pg2= 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:799: TEST_abort_periodic_for_operator: for pg1 in "${!pg_pr[@]}" 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:800: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:801: TEST_abort_periodic_for_operator: [[ 1.8 == \1\.\8 ]] 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:802: TEST_abort_periodic_for_operator: continue 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:800: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-17T04:50:06.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:801: TEST_abort_periodic_for_operator: [[ 1.9 == \1\.\8 ]] 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:804: TEST_abort_periodic_for_operator: [[ 1 == \1 ]] 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:805: TEST_abort_periodic_for_operator: count_common_active 1.9 1.8 pg_ac 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:371: count_common_active: local pg1=1.9 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:372: count_common_active: local pg2=1.8 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:373: count_common_active: local -n pg_acting_dict=pg_ac 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:375: count_common_active: a1=('1' '4' '2') 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:375: count_common_active: local -a a1 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:376: count_common_active: a2=('1' '4' '3') 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:376: count_common_active: local -a a2 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:378: count_common_active: local -i cnt=0 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-17T04:50:06.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 1 ]] 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:382: count_common_active: cnt=1 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 4 ]] 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 3 ]] 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 1 ]] 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 4 ]] 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:382: count_common_active: cnt=2 2026-02-17T04:50:06.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 3 ]] 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 1 ]] 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 4 ]] 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 3 ]] 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:387: count_common_active: printf %d 2 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:805: TEST_abort_periodic_for_operator: local -i common=2 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:806: TEST_abort_periodic_for_operator: [[ 2 -gt 1 ]] 2026-02-17T04:50:06.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:807: TEST_abort_periodic_for_operator: pg2=1.9 2026-02-17T04:50:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:808: TEST_abort_periodic_for_operator: break 2 2026-02-17T04:50:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:814: TEST_abort_periodic_for_operator: [[ -z 1.9 ]] 2026-02-17T04:50:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:820: TEST_abort_periodic_for_operator: ceph tell osd.1 config set osd_max_scrubs 2 2026-02-17T04:50:06.453 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:50:06.453 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_max_scrubs = '' " 2026-02-17T04:50:06.453 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:06.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:821: TEST_abort_periodic_for_operator: echo 'The two PGs to manipulate are 1.8 and 1.9' 2026-02-17T04:50:06.457 INFO:tasks.workunit.client.0.trial090.stdout:The two PGs to manipulate are 1.8 and 1.9 2026-02-17T04:50:06.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:823: TEST_abort_periodic_for_operator: set_query_debug 1.8 2026-02-17T04:50:06.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.8 2026-02-17T04:50:06.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-17T04:50:06.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.8' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-17T04:50:06.615 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:50:06.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-17T04:50:06.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.8 is 1' 2026-02-17T04:50:06.624 INFO:tasks.workunit.client.0.trial090.stdout:Setting scrub debug data. Primary for 1.8 is 1 2026-02-17T04:50:06.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-17T04:50:06.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:50:06.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:50:06.625 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:50:06.626 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:06.626 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:06.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:50:06.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-17T04:50:06.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.897552/ceph-osd.1.asok scrubdebug 1.8 set sessions 2026-02-17T04:50:06.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:826: TEST_abort_periodic_for_operator: local is_act 2026-02-17T04:50:06.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:827: TEST_abort_periodic_for_operator: seq 1 3 2026-02-17T04:50:06.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:827: TEST_abort_periodic_for_operator: for i in $( seq 1 3 ) 2026-02-17T04:50:06.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: ceph pg 1.8 query 2026-02-17T04:50:06.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: jq .scrubber.active 2026-02-17T04:50:06.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: is_act=false 2026-02-17T04:50:06.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:830: TEST_abort_periodic_for_operator: [[ false = \f\a\l\s\e ]] 2026-02-17T04:50:06.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:831: TEST_abort_periodic_for_operator: break 2026-02-17T04:50:06.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:836: TEST_abort_periodic_for_operator: ceph pg dump pgs 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:{"success":true}PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.f 19 0 0 0 0 6080 0 0 19 0 19 active+clean 2026-02-17T04:49:58.923241+0000 31'19 31:48 [3,0,4] 3 [3,0,4] 3 31'19 2026-02-17T04:49:58.923193+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:58.923193+0000 19 0 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.e 20 0 0 0 0 6400 0 0 20 0 20 active+clean 2026-02-17T04:50:01.395045+0000 31'20 31:48 [1,4,2] 1 [1,4,2] 1 31'20 2026-02-17T04:50:01.395007+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:50:01.395007+0000 20 0 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.d 14 0 0 0 0 4480 0 0 14 0 14 active+clean 2026-02-17T04:49:57.814929+0000 31'14 31:42 [2,4,1] 2 [2,4,1] 2 31'14 2026-02-17T04:49:57.814889+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.814889+0000 14 0 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.0 22 0 0 0 0 7040 0 0 22 0 22 active+clean 2026-02-17T04:50:00.408143+0000 31'22 31:55 [1,0,2] 1 [1,0,2] 1 31'22 2026-02-17T04:50:00.408102+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:50:00.408102+0000 22 0 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.1 12 0 0 0 0 3840 0 0 12 0 12 active+clean 2026-02-17T04:49:58.163773+0000 31'12 31:44 [4,3,0] 4 [4,3,0] 4 31'12 2026-02-17T04:49:58.163738+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:58.163738+0000 12 0 2026-02-17T04:50:06.891 INFO:tasks.workunit.client.0.trial090.stdout:1.c 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-17T04:49:59.883452+0000 31'15 31:44 [3,0,4] 3 [3,0,4] 3 31'15 2026-02-17T04:49:59.883395+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:59.883395+0000 15 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.2 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-17T04:49:57.751001+0000 31'15 31:47 [0,4,1] 0 [0,4,1] 0 31'15 2026-02-17T04:49:57.750967+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.750967+0000 15 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.3 19 0 0 0 0 6080 0 0 19 0 19 active+clean 2026-02-17T04:49:59.143650+0000 31'19 31:49 [4,1,2] 4 [4,1,2] 4 31'19 2026-02-17T04:49:59.143603+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:59.143603+0000 19 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.4 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-17T04:49:57.019310+0000 31'15 31:46 [3,0,1] 3 [3,0,1] 3 31'15 2026-02-17T04:49:57.019269+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.019269+0000 15 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.5 26 0 0 0 0 8320 0 0 26 0 26 active+clean 2026-02-17T04:49:57.209299+0000 31'26 31:56 [4,2,3] 4 [4,2,3] 4 31'26 2026-02-17T04:49:57.209258+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.209258+0000 26 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.6 12 0 0 0 0 3840 0 0 12 0 12 active+clean 2026-02-17T04:49:57.969566+0000 31'12 31:42 [3,4,2] 3 [3,4,2] 3 31'12 2026-02-17T04:49:57.969525+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.969525+0000 12 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.7 11 0 0 0 0 3520 0 0 11 0 11 active+clean 2026-02-17T04:49:59.407949+0000 31'11 31:40 [1,3,0] 1 [1,3,0] 1 31'11 2026-02-17T04:49:59.407905+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:59.407905+0000 11 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.8 28 0 0 0 0 8960 0 0 28 0 28 active+clean 2026-02-17T04:49:57.457146+0000 31'28 31:56 [1,4,3] 1 [1,4,3] 1 31'28 2026-02-17T04:49:57.457116+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:57.457116+0000 28 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.9 8 0 0 0 0 2560 0 0 8 0 8 active+clean 2026-02-17T04:49:58.423273+0000 31'8 31:36 [1,4,2] 1 [1,4,2] 1 31'8 2026-02-17T04:49:58.423245+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:49:58.423245+0000 8 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.a 9 0 0 0 0 2880 0 0 9 0 9 active+clean 2026-02-17T04:50:02.375795+0000 31'9 31:38 [1,2,4] 1 [1,2,4] 1 31'9 2026-02-17T04:50:02.375706+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:50:02.375706+0000 9 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout:1.b 11 0 0 0 0 3520 0 0 11 0 11 active+clean 2026-02-17T04:50:03.417234+0000 31'11 31:40 [1,0,2] 1 [1,0,2] 1 31'11 2026-02-17T04:50:03.417167+0000 0'0 2026-02-17T04:49:44.402574+0000 0 2 periodic scrub scheduled @ 2026-02-17T06:50:03.417167+0000 11 0 2026-02-17T04:50:06.892 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:06.893 INFO:tasks.workunit.client.0.trial090.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T04:50:06.893 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:06.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:837: TEST_abort_periodic_for_operator: [[ false != \f\a\l\s\e ]] 2026-02-17T04:50:06.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:842: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-17T04:50:07.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:844: TEST_abort_periodic_for_operator: echo 'Initiating a periodic scrub of 1.8' 2026-02-17T04:50:07.399 INFO:tasks.workunit.client.0.trial090.stdout:Initiating a periodic scrub of 1.8 2026-02-17T04:50:07.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:845: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:07.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:846: TEST_abort_periodic_for_operator: ceph tell 1.8 schedule-deep-scrub 2026-02-17T04:50:07.455 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:50:07.455 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:50:07.455 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:50:07.455 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-16T22:25:57.454837+0000" 2026-02-17T04:50:07.455 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:07.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:847: TEST_abort_periodic_for_operator: sleep 1 2026-02-17T04:50:08.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:848: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:08.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:850: TEST_abort_periodic_for_operator: seq 1 14 2026-02-17T04:50:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:850: TEST_abort_periodic_for_operator: for i in $( seq 1 14 ) 2026-02-17T04:50:08.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:852: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-17T04:50:08.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: ceph pg 1.8 query 2026-02-17T04:50:08.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-17T04:50:09.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: stt='{ 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "active": true, 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "epoch_start": "27", 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "start": "1:10000000::::0", 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "end": "MIN", 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "max_end": "MIN", 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "subset_last_update": "0'\''0", 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "deep": true, 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "req_scrub": false, 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "auto_repair": false, 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "check_repair": false, 2026-02-17T04:50:09.023 INFO:tasks.workunit.client.0.trial090.stderr: "deep_scrub_on_error": false, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "priority": 5, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "shallow_errors": 0, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "deep_errors": 0, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "fixed": 0, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "waiting_on_whom": [], 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "schedule": "scrubbing", 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "is_reserving_replicas": false, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "test_sequence": 12062724, 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "shallow-target": { 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.8", 2026-02-17T04:50:09.024 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-17T06:49:57.457116+0000", 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-17T06:49:57.457116+0000", 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "deep-target": { 2026-02-17T04:50:09.025 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.8", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: "active": true 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:50:09.026 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:50:09.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"27",' '"start":' '"1:10000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"periodic-regular",' '"test_sequence":' 12062724, '"shallow-target":' '{' '"pgid":' '"1.8",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-17T06:49:57.457116+0000",' '"orig_sched_time":' '"2026-02-17T06:49:57.457116+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.8",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: jq .active 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: is_active=true 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"27",' '"start":' '"1:10000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"periodic-regular",' '"test_sequence":' 12062724, '"shallow-target":' '{' '"pgid":' '"1.8",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-17T06:49:57.457116+0000",' '"orig_sched_time":' '"2026-02-17T06:49:57.457116+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.8",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: is_reserving_replicas=false 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:856: TEST_abort_periodic_for_operator: [[ true = \t\r\u\e ]] 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:856: TEST_abort_periodic_for_operator: [[ false = \f\a\l\s\e ]] 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:857: TEST_abort_periodic_for_operator: break 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:861: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:861: TEST_abort_periodic_for_operator: [[ false != \f\a\l\s\e ]] 2026-02-17T04:50:09.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:866: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:09.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:873: TEST_abort_periodic_for_operator: (( extr_dbg >= 1 )) 2026-02-17T04:50:09.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:873: TEST_abort_periodic_for_operator: ceph tell 'osd.*' dump_scrub_reservations --format=json-pretty 2026-02-17T04:50:09.079 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:09.079 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:50:09.079 INFO:tasks.workunit.client.0.trial090.stdout: "scrubs_local": 0, 2026-02-17T04:50:09.079 INFO:tasks.workunit.client.0.trial090.stdout: "osd_max_scrubs": 1, 2026-02-17T04:50:09.079 INFO:tasks.workunit.client.0.trial090.stdout: "remote_scrub_reservations": { 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout: "max_allowed": 1, 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout: "min_priority": 0, 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout: "queues": [], 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout: "in_progress": [] 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.080 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.087 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:09.087 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "scrubs_local": 1, 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "osd_max_scrubs": 2, 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "remote_scrub_reservations": { 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "max_allowed": 2, 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "min_priority": 0, 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "queues": [], 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: "in_progress": [] 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.088 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.095 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:09.095 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:50:09.095 INFO:tasks.workunit.client.0.trial090.stdout: "scrubs_local": 0, 2026-02-17T04:50:09.095 INFO:tasks.workunit.client.0.trial090.stdout: "osd_max_scrubs": 1, 2026-02-17T04:50:09.095 INFO:tasks.workunit.client.0.trial090.stdout: "remote_scrub_reservations": { 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout: "max_allowed": 1, 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout: "min_priority": 0, 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout: "queues": [], 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout: "in_progress": [] 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.096 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.103 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:09.103 INFO:tasks.workunit.client.0.trial090.stdout:osd.3: { 2026-02-17T04:50:09.103 INFO:tasks.workunit.client.0.trial090.stdout: "scrubs_local": 0, 2026-02-17T04:50:09.103 INFO:tasks.workunit.client.0.trial090.stdout: "osd_max_scrubs": 1, 2026-02-17T04:50:09.103 INFO:tasks.workunit.client.0.trial090.stdout: "remote_scrub_reservations": { 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "max_allowed": 1, 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "min_priority": 0, 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "queues": [], 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "in_progress": [ 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "item": "1.8", 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "prio": 0, 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: "can_preempt": false 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.104 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:50:09.105 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.105 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout:osd.4: { 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: "scrubs_local": 0, 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: "osd_max_scrubs": 1, 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: "remote_scrub_reservations": { 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: "max_allowed": 1, 2026-02-17T04:50:09.111 INFO:tasks.workunit.client.0.trial090.stdout: "min_priority": 0, 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: "queues": [], 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: "in_progress": [ 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: "item": "1.8", 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: "prio": 0, 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: "can_preempt": false 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:50:09.112 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:876: TEST_abort_periodic_for_operator: set_query_debug 1.9 2026-02-17T04:50:09.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.9 2026-02-17T04:50:09.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-17T04:50:09.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.9' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-17T04:50:09.271 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T04:50:09.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-17T04:50:09.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.9 is 1' 2026-02-17T04:50:09.281 INFO:tasks.workunit.client.0.trial090.stdout:Setting scrub debug data. Primary for 1.9 is 1 2026-02-17T04:50:09.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-17T04:50:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.897552/ceph-osd.1.asok scrubdebug 1.9 set sessions 2026-02-17T04:50:09.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:877: TEST_abort_periodic_for_operator: ceph tell 1.9 schedule-deep-scrub 2026-02-17T04:50:09.384 INFO:tasks.workunit.client.0.trial090.stdout:{"success":true}{ 2026-02-17T04:50:09.384 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:50:09.385 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:50:09.385 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-16T22:25:59.383857+0000" 2026-02-17T04:50:09.385 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:09.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:878: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-17T04:50:09.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:879: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:09.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:880: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:09.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:881: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:09.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:882: TEST_abort_periodic_for_operator: sleep 1 2026-02-17T04:50:10.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:883: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:10.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:884: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:10.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:885: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-17T04:50:10.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: ceph pg 1.9 query 2026-02-17T04:50:10.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-17T04:50:10.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: local 'stt2={ 2026-02-17T04:50:10.951 INFO:tasks.workunit.client.0.trial090.stderr: "active": true, 2026-02-17T04:50:10.951 INFO:tasks.workunit.client.0.trial090.stderr: "epoch_start": "27", 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "start": "MIN", 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "end": "MIN", 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "max_end": "MIN", 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "subset_last_update": "0'\''0", 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "deep": true, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "req_scrub": false, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "auto_repair": false, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "check_repair": false, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "deep_scrub_on_error": false, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "priority": 5, 2026-02-17T04:50:10.952 INFO:tasks.workunit.client.0.trial090.stderr: "shallow_errors": 0, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "deep_errors": 0, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "fixed": 0, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "waiting_on_whom": [], 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "schedule": "scrubbing", 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "is_reserving_replicas": true, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "osd_to_respond": 4, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "duration_seconds": 1, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "requested_in_order": 2, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "num_to_reserve": 2, 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:10.953 INFO:tasks.workunit.client.0.trial090.stderr: "test_sequence": 10420227, 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "shallow-target": { 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.9", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-17T06:49:58.423245+0000", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-17T06:49:58.423245+0000", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:50:10.954 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "deep-target": { 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.9", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: "active": true 2026-02-17T04:50:10.955 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:50:10.956 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:50:10.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:889: TEST_abort_periodic_for_operator: local pg2_is_reserving 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"27",' '"start":' '"MIN",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' true, '"osd_to_respond":' 4, '"duration_seconds":' 1, '"requested_in_order":' 2, '"num_to_reserve":' 2, '"urgency":' '"periodic-regular",' '"test_sequence":' 10420227, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-17T06:49:58.423245+0000",' '"orig_sched_time":' '"2026-02-17T06:49:58.423245+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: pg2_is_reserving=true 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:891: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:899: TEST_abort_periodic_for_operator: echo 'Instructing 1.9 to perform a high-priority scrub' 2026-02-17T04:50:10.957 INFO:tasks.workunit.client.0.trial090.stdout:Instructing 1.9 to perform a high-priority scrub 2026-02-17T04:50:10.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:900: TEST_abort_periodic_for_operator: ceph tell 1.9 scrub 2026-02-17T04:50:11.008 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:50:11.008 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:50:11.009 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:50:11.009 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:50:11.009 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:11.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:901: TEST_abort_periodic_for_operator: seq 1 10 2026-02-17T04:50:11.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:901: TEST_abort_periodic_for_operator: for i in $( seq 1 10 ) 2026-02-17T04:50:11.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:903: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-17T04:50:11.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: ceph pg 1.9 query 2026-02-17T04:50:11.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-17T04:50:11.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: stt2='{ 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "active": true, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "epoch_start": "27", 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "start": "1:90000000::::0", 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "end": "MIN", 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "max_end": "MIN", 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "subset_last_update": "0'\''0", 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "deep": false, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "req_scrub": true, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "auto_repair": false, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "check_repair": false, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "deep_scrub_on_error": false, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "priority": 5, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "shallow_errors": 0, 2026-02-17T04:50:11.574 INFO:tasks.workunit.client.0.trial090.stderr: "deep_errors": 0, 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "fixed": 0, 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "waiting_on_whom": [], 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "schedule": "scrubbing", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "is_reserving_replicas": false, 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "operator-requested", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "test_sequence": 10420229, 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "shallow-target": { 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.9", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:11.575 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "active": true 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "deep-target": { 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.9", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "queued": false, 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:50:11.576 INFO:tasks.workunit.client.0.trial090.stderr:}' 2026-02-17T04:50:11.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"27",' '"start":' '"1:90000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' false, '"req_scrub":' true, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"operator-requested",' '"test_sequence":' 10420229, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '}' '}' 2026-02-17T04:50:11.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: jq .active 2026-02-17T04:50:11.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: pg2_is_active=true 2026-02-17T04:50:11.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"27",' '"start":' '"1:90000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' false, '"req_scrub":' true, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"operator-requested",' '"test_sequence":' 10420229, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '}' '}' 2026-02-17T04:50:11.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-17T04:50:11.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: pg2_is_reserving=false 2026-02-17T04:50:11.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:907: TEST_abort_periodic_for_operator: [[ true = \t\r\u\e ]] 2026-02-17T04:50:11.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:907: TEST_abort_periodic_for_operator: [[ false != \t\r\u\e ]] 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:908: TEST_abort_periodic_for_operator: break 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:913: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:913: TEST_abort_periodic_for_operator: [[ false = \t\r\u\e ]] 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:917: TEST_abort_periodic_for_operator: echo Done 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stdout:Done 2026-02-17T04:50:11.580 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_abort_periodic_for_operator ------------------ 2026-02-17T04:50:11.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_abort_periodic_for_operator ------------------' 2026-02-17T04:50:11.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T04:50:11.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:50:11.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:50:11.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:50:11.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:50:11.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:50:11.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:50:11.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:50:11.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:50:11.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:50:11.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:50:11.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:50:11.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:50:11.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:50:11.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:50:11.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:50:11.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:50:11.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:50:11.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:50:11.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:50:11.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:50:11.716 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_abort_periodic_for_operator ------------------ 2026-02-17T04:50:11.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_abort_periodic_for_operator ------------------' 2026-02-17T04:50:11.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T04:50:11.717 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_deep_scrub_abort ------------------- 2026-02-17T04:50:11.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_deep_scrub_abort -------------------' 2026-02-17T04:50:11.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T04:50:11.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:50:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:50:11.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:50:11.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:50:11.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:50:11.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:50:11.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:50:11.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:50:11.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:50:11.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:50:11.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:50:11.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:50:11.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T04:50:11.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:50:11.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T04:50:11.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:50:11.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:50:11.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:50:11.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T04:50:11.730 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_deep_scrub_abort ----------------------- 2026-02-17T04:50:11.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_deep_scrub_abort -----------------------' 2026-02-17T04:50:11.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_deep_scrub_abort td/osd-scrub-test 2026-02-17T04:50:11.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:409: TEST_deep_scrub_abort: local dir=td/osd-scrub-test 2026-02-17T04:50:11.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:410: TEST_deep_scrub_abort: _scrub_abort td/osd-scrub-test deep-scrub 2026-02-17T04:50:11.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:293: _scrub_abort: local dir=td/osd-scrub-test 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:294: _scrub_abort: local poolname=test 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:295: _scrub_abort: local OSDS=3 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:296: _scrub_abort: local objects=1000 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:297: _scrub_abort: local type=deep-scrub 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:299: _scrub_abort: TESTDATA=testdata.897552 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:300: _scrub_abort: test deep-scrub = scrub 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:305: _scrub_abort: stopscrub=nodeep-scrub 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:306: _scrub_abort: check=nodeep_scrub 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:309: _scrub_abort: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:50:11.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:50:11.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:50:11.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T04:50:11.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:11.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T04:50:11.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:50:11.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:50:11.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:50:11.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:50:11.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T04:50:11.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:50:11.819 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.820 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.820 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:50:11.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:50:11.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:310: _scrub_abort: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T04:50:11.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:50:11.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:50:11.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:50:11.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:50:11.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:50:11.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.942 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:11.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:50:11.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T04:50:11.958 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: expr 3 - 1 2026-02-17T04:50:11.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: seq 0 2 2026-02-17T04:50:11.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:50:11.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 0 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:11.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:50:11.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:50:11.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=59236de5-042f-4883-b465-3aee9fd85bca 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 59236de5-042f-4883-b465-3aee9fd85bca' 2026-02-17T04:50:11.965 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 59236de5-042f-4883-b465-3aee9fd85bca 2026-02-17T04:50:11.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:50:11.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCD85NpmbbmORAA433DSLWVMgBbyo/44kOcQA== 2026-02-17T04:50:11.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCD85NpmbbmORAA433DSLWVMgBbyo/44kOcQA=="}' 2026-02-17T04:50:11.973 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 59236de5-042f-4883-b465-3aee9fd85bca -i td/osd-scrub-test/0/new.json 2026-02-17T04:50:12.051 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:50:12.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T04:50:12.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQCD85NpmbbmORAA433DSLWVMgBbyo/44kOcQA== --osd-uuid 59236de5-042f-4883-b465-3aee9fd85bca 2026-02-17T04:50:12.077 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.076+0000 7f816904c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.079 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.077+0000 7f816904c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.078+0000 7f816904c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.079+0000 7f816904c780 -1 bdev(0x2b24c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:50:12.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.079+0000 7f816904c780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T04:50:12.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T04:50:12.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:50:12.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:50:12.516 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:50:12.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:50:12.599 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:50:12.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:50:12.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:12.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:50:12.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:50:12.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:50:12.616 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.614+0000 7f36c4837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.617 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.615+0000 7f36c4837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.618 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.616+0000 7f36c4837780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:12.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:50:12.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:50:12.680 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:50:12.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:12.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:50:12.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:50:12.812 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:12.811+0000 7f36c4837780 -1 Falling back to public interface 2026-02-17T04:50:13.190 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.188+0000 7f36c4837780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:50:13.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:50:13.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:13.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:50:13.760 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:50:13.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:13.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:50:13.838 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1283264643,v1:127.0.0.1:6801/1283264643] [v2:127.0.0.1:6802/1283264643,v1:127.0.0.1:6803/1283264643] exists,up 59236de5-042f-4883-b465-3aee9fd85bca 2026-02-17T04:50:13.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:50:13.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:50:13.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 1 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:50:13.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:13.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:50:13.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6ab30ad3-c24f-4aa7-8006-615545f48290 2026-02-17T04:50:13.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6ab30ad3-c24f-4aa7-8006-615545f48290' 2026-02-17T04:50:13.847 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 6ab30ad3-c24f-4aa7-8006-615545f48290 2026-02-17T04:50:13.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:50:13.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCF85Npo4KkMhAAJmcdYnptgOBOO4LCgPkerg== 2026-02-17T04:50:13.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCF85Npo4KkMhAAJmcdYnptgOBOO4LCgPkerg=="}' 2026-02-17T04:50:13.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6ab30ad3-c24f-4aa7-8006-615545f48290 -i td/osd-scrub-test/1/new.json 2026-02-17T04:50:13.929 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:50:13.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T04:50:13.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQCF85Npo4KkMhAAJmcdYnptgOBOO4LCgPkerg== --osd-uuid 6ab30ad3-c24f-4aa7-8006-615545f48290 2026-02-17T04:50:13.955 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.953+0000 7f5a31e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:13.956 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.954+0000 7f5a31e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:13.957 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.955+0000 7f5a31e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:13.958 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.956+0000 7f5a31e15780 -1 bdev(0x23fcc00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:50:13.958 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:13.956+0000 7f5a31e15780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T04:50:14.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T04:50:14.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:50:14.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:50:14.311 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:50:14.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:50:14.528 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:50:14.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:50:14.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:14.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:50:14.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:50:14.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:50:14.542 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:14.540+0000 7fc69b841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:14.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:14.542+0000 7fc69b841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:14.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:14.543+0000 7fc69b841780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:14.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:50:14.696 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:50:14.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:14.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:50:14.705 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:14.704+0000 7fc69b841780 -1 Falling back to public interface 2026-02-17T04:50:14.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:50:15.032 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:15.030+0000 7fc69b841780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:50:15.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:50:15.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:15.862 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:50:15.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:50:15.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:15.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:50:16.027 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/379399445,v1:127.0.0.1:6811/379399445] [v2:127.0.0.1:6812/379399445,v1:127.0.0.1:6813/379399445] exists,up 6ab30ad3-c24f-4aa7-8006-615545f48290 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 2 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:50:16.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:50:16.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:50:16.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=684d20ab-9dad-44bb-9657-1be3f383d3af 2026-02-17T04:50:16.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 684d20ab-9dad-44bb-9657-1be3f383d3af' 2026-02-17T04:50:16.035 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 684d20ab-9dad-44bb-9657-1be3f383d3af 2026-02-17T04:50:16.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:50:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCI85Np6PROAhAAPn+ny7Qf3LP8Juv8X8OMmg== 2026-02-17T04:50:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCI85Np6PROAhAAPn+ny7Qf3LP8Juv8X8OMmg=="}' 2026-02-17T04:50:16.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 684d20ab-9dad-44bb-9657-1be3f383d3af -i td/osd-scrub-test/2/new.json 2026-02-17T04:50:16.203 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:50:16.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T04:50:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQCI85Np6PROAhAAPn+ny7Qf3LP8Juv8X8OMmg== --osd-uuid 684d20ab-9dad-44bb-9657-1be3f383d3af 2026-02-17T04:50:16.230 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.228+0000 7f6f1502c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.231 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.229+0000 7f6f1502c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.230+0000 7f6f1502c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.230+0000 7f6f1502c780 -1 bdev(0x36d2c00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:50:16.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.230+0000 7f6f1502c780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T04:50:16.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T04:50:16.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:50:16.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:50:16.551 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:50:16.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:50:16.762 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:50:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:50:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T04:50:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:50:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:50:16.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:50:16.777 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.776+0000 7f231923b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.779 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.777+0000 7f231923b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.778+0000 7f231923b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:50:16.923 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:16.921+0000 7f231923b780 -1 Falling back to public interface 2026-02-17T04:50:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:50:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:50:16.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:50:16.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:50:16.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:50:16.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:16.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:50:16.929 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:50:16.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:16.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:50:17.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:50:17.266 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:50:17.264+0000 7f231923b780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:50:18.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:50:18.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T04:50:18.091 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:50:18.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:50:18.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:50:18.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:50:18.257 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1996440674,v1:127.0.0.1:6819/1996440674] [v2:127.0.0.1:6820/1996440674,v1:127.0.0.1:6821/1996440674] exists,up 684d20ab-9dad-44bb-9657-1be3f383d3af 2026-02-17T04:50:18.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:50:18.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:50:18.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:50:18.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:325: _scrub_abort: create_pool test 1 1 2026-02-17T04:50:18.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:50:18.476 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:50:18.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:50:19.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:326: _scrub_abort: wait_for_clean 2026-02-17T04:50:19.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:50:19.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:50:19.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:50:19.489 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:50:19.490 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:50:19.490 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:50:19.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:50:19.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:50:19.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:19.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:19.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:19.743 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:19.743 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:19.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:19.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:19.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:19.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:50:19.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:50:19.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:50:19.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:19.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:19.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:50:19.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:50:19.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T04:50:19.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:19.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T04:50:19.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T04:50:19.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-55834574851' 2026-02-17T04:50:19.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:19.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:50:19.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:19.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:19.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:50:19.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:19.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:50:19.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:50:19.924 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:50:19.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:50:20.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:20.088 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:50:20.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:20.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:20.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:50:20.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:50:20.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:50:20.092 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:50:20.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T04:50:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:20.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-17T04:50:20.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:20.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:20.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-17T04:50:20.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:20.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T04:50:20.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T04:50:20.262 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574851 2026-02-17T04:50:20.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:20.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T04:50:20.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:50:20.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:50:20.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:50:20.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:50:20.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:50:20.643 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:50:20.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:50:20.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:50:20.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:50:20.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:50:21.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:50:21.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:50:21.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:50:21.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: ceph osd dump 2026-02-17T04:50:21.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: grep '^pool.*['\'']test['\'']' 2026-02-17T04:50:21.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: awk '{ print $2 }' 2026-02-17T04:50:21.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: poolid=1 2026-02-17T04:50:21.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:329: _scrub_abort: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T04:50:21.180 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:50:21.181 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:50:21.181 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.6127e-05 s, 28.6 MB/s 2026-02-17T04:50:21.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: seq 1 1000 2026-02-17T04:50:21.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1 testdata.897552 2026-02-17T04:50:21.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj2 testdata.897552 2026-02-17T04:50:21.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj3 testdata.897552 2026-02-17T04:50:21.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj4 testdata.897552 2026-02-17T04:50:21.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj5 testdata.897552 2026-02-17T04:50:21.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj6 testdata.897552 2026-02-17T04:50:21.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj7 testdata.897552 2026-02-17T04:50:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj8 testdata.897552 2026-02-17T04:50:21.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj9 testdata.897552 2026-02-17T04:50:21.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj10 testdata.897552 2026-02-17T04:50:21.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj11 testdata.897552 2026-02-17T04:50:21.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj12 testdata.897552 2026-02-17T04:50:21.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj13 testdata.897552 2026-02-17T04:50:21.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj14 testdata.897552 2026-02-17T04:50:21.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj15 testdata.897552 2026-02-17T04:50:21.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj16 testdata.897552 2026-02-17T04:50:21.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj17 testdata.897552 2026-02-17T04:50:21.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj18 testdata.897552 2026-02-17T04:50:21.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj19 testdata.897552 2026-02-17T04:50:21.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj20 testdata.897552 2026-02-17T04:50:21.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj21 testdata.897552 2026-02-17T04:50:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj22 testdata.897552 2026-02-17T04:50:21.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj23 testdata.897552 2026-02-17T04:50:21.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj24 testdata.897552 2026-02-17T04:50:21.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj25 testdata.897552 2026-02-17T04:50:21.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj26 testdata.897552 2026-02-17T04:50:21.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj27 testdata.897552 2026-02-17T04:50:21.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj28 testdata.897552 2026-02-17T04:50:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj29 testdata.897552 2026-02-17T04:50:21.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj30 testdata.897552 2026-02-17T04:50:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj31 testdata.897552 2026-02-17T04:50:21.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj32 testdata.897552 2026-02-17T04:50:21.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj33 testdata.897552 2026-02-17T04:50:21.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj34 testdata.897552 2026-02-17T04:50:21.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj35 testdata.897552 2026-02-17T04:50:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj36 testdata.897552 2026-02-17T04:50:21.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj37 testdata.897552 2026-02-17T04:50:21.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj38 testdata.897552 2026-02-17T04:50:21.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj39 testdata.897552 2026-02-17T04:50:21.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj40 testdata.897552 2026-02-17T04:50:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj41 testdata.897552 2026-02-17T04:50:21.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj42 testdata.897552 2026-02-17T04:50:21.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj43 testdata.897552 2026-02-17T04:50:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj44 testdata.897552 2026-02-17T04:50:21.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj45 testdata.897552 2026-02-17T04:50:21.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj46 testdata.897552 2026-02-17T04:50:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj47 testdata.897552 2026-02-17T04:50:21.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj48 testdata.897552 2026-02-17T04:50:21.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj49 testdata.897552 2026-02-17T04:50:21.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj50 testdata.897552 2026-02-17T04:50:21.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj51 testdata.897552 2026-02-17T04:50:21.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj52 testdata.897552 2026-02-17T04:50:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj53 testdata.897552 2026-02-17T04:50:21.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:21.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj54 testdata.897552 2026-02-17T04:50:22.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj55 testdata.897552 2026-02-17T04:50:22.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj56 testdata.897552 2026-02-17T04:50:22.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj57 testdata.897552 2026-02-17T04:50:22.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj58 testdata.897552 2026-02-17T04:50:22.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj59 testdata.897552 2026-02-17T04:50:22.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj60 testdata.897552 2026-02-17T04:50:22.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj61 testdata.897552 2026-02-17T04:50:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj62 testdata.897552 2026-02-17T04:50:22.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj63 testdata.897552 2026-02-17T04:50:22.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj64 testdata.897552 2026-02-17T04:50:22.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj65 testdata.897552 2026-02-17T04:50:22.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj66 testdata.897552 2026-02-17T04:50:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj67 testdata.897552 2026-02-17T04:50:22.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj68 testdata.897552 2026-02-17T04:50:22.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj69 testdata.897552 2026-02-17T04:50:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj70 testdata.897552 2026-02-17T04:50:22.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj71 testdata.897552 2026-02-17T04:50:22.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj72 testdata.897552 2026-02-17T04:50:22.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj73 testdata.897552 2026-02-17T04:50:22.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj74 testdata.897552 2026-02-17T04:50:22.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj75 testdata.897552 2026-02-17T04:50:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj76 testdata.897552 2026-02-17T04:50:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj77 testdata.897552 2026-02-17T04:50:22.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj78 testdata.897552 2026-02-17T04:50:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj79 testdata.897552 2026-02-17T04:50:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj80 testdata.897552 2026-02-17T04:50:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj81 testdata.897552 2026-02-17T04:50:22.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj82 testdata.897552 2026-02-17T04:50:22.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj83 testdata.897552 2026-02-17T04:50:22.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj84 testdata.897552 2026-02-17T04:50:22.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj85 testdata.897552 2026-02-17T04:50:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj86 testdata.897552 2026-02-17T04:50:22.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj87 testdata.897552 2026-02-17T04:50:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj88 testdata.897552 2026-02-17T04:50:22.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj89 testdata.897552 2026-02-17T04:50:22.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj90 testdata.897552 2026-02-17T04:50:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj91 testdata.897552 2026-02-17T04:50:22.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj92 testdata.897552 2026-02-17T04:50:22.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj93 testdata.897552 2026-02-17T04:50:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj94 testdata.897552 2026-02-17T04:50:22.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj95 testdata.897552 2026-02-17T04:50:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj96 testdata.897552 2026-02-17T04:50:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj97 testdata.897552 2026-02-17T04:50:22.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj98 testdata.897552 2026-02-17T04:50:22.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj99 testdata.897552 2026-02-17T04:50:22.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj100 testdata.897552 2026-02-17T04:50:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj101 testdata.897552 2026-02-17T04:50:22.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj102 testdata.897552 2026-02-17T04:50:22.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj103 testdata.897552 2026-02-17T04:50:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj104 testdata.897552 2026-02-17T04:50:22.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj105 testdata.897552 2026-02-17T04:50:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj106 testdata.897552 2026-02-17T04:50:22.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj107 testdata.897552 2026-02-17T04:50:22.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj108 testdata.897552 2026-02-17T04:50:22.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj109 testdata.897552 2026-02-17T04:50:22.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj110 testdata.897552 2026-02-17T04:50:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj111 testdata.897552 2026-02-17T04:50:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj112 testdata.897552 2026-02-17T04:50:22.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj113 testdata.897552 2026-02-17T04:50:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj114 testdata.897552 2026-02-17T04:50:22.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj115 testdata.897552 2026-02-17T04:50:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj116 testdata.897552 2026-02-17T04:50:22.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj117 testdata.897552 2026-02-17T04:50:22.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:22.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj118 testdata.897552 2026-02-17T04:50:23.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj119 testdata.897552 2026-02-17T04:50:23.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj120 testdata.897552 2026-02-17T04:50:23.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj121 testdata.897552 2026-02-17T04:50:23.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj122 testdata.897552 2026-02-17T04:50:23.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj123 testdata.897552 2026-02-17T04:50:23.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj124 testdata.897552 2026-02-17T04:50:23.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj125 testdata.897552 2026-02-17T04:50:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj126 testdata.897552 2026-02-17T04:50:23.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj127 testdata.897552 2026-02-17T04:50:23.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj128 testdata.897552 2026-02-17T04:50:23.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj129 testdata.897552 2026-02-17T04:50:23.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj130 testdata.897552 2026-02-17T04:50:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj131 testdata.897552 2026-02-17T04:50:23.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj132 testdata.897552 2026-02-17T04:50:23.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj133 testdata.897552 2026-02-17T04:50:23.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj134 testdata.897552 2026-02-17T04:50:23.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj135 testdata.897552 2026-02-17T04:50:23.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj136 testdata.897552 2026-02-17T04:50:23.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj137 testdata.897552 2026-02-17T04:50:23.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj138 testdata.897552 2026-02-17T04:50:23.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj139 testdata.897552 2026-02-17T04:50:23.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj140 testdata.897552 2026-02-17T04:50:23.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj141 testdata.897552 2026-02-17T04:50:23.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj142 testdata.897552 2026-02-17T04:50:23.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj143 testdata.897552 2026-02-17T04:50:23.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj144 testdata.897552 2026-02-17T04:50:23.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj145 testdata.897552 2026-02-17T04:50:23.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj146 testdata.897552 2026-02-17T04:50:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj147 testdata.897552 2026-02-17T04:50:23.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj148 testdata.897552 2026-02-17T04:50:23.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj149 testdata.897552 2026-02-17T04:50:23.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj150 testdata.897552 2026-02-17T04:50:23.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj151 testdata.897552 2026-02-17T04:50:23.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj152 testdata.897552 2026-02-17T04:50:23.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj153 testdata.897552 2026-02-17T04:50:23.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj154 testdata.897552 2026-02-17T04:50:23.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj155 testdata.897552 2026-02-17T04:50:23.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj156 testdata.897552 2026-02-17T04:50:23.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj157 testdata.897552 2026-02-17T04:50:23.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj158 testdata.897552 2026-02-17T04:50:23.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj159 testdata.897552 2026-02-17T04:50:23.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj160 testdata.897552 2026-02-17T04:50:23.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj161 testdata.897552 2026-02-17T04:50:23.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj162 testdata.897552 2026-02-17T04:50:23.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj163 testdata.897552 2026-02-17T04:50:23.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj164 testdata.897552 2026-02-17T04:50:23.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj165 testdata.897552 2026-02-17T04:50:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj166 testdata.897552 2026-02-17T04:50:23.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj167 testdata.897552 2026-02-17T04:50:23.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj168 testdata.897552 2026-02-17T04:50:23.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj169 testdata.897552 2026-02-17T04:50:23.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj170 testdata.897552 2026-02-17T04:50:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj171 testdata.897552 2026-02-17T04:50:23.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj172 testdata.897552 2026-02-17T04:50:23.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj173 testdata.897552 2026-02-17T04:50:23.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj174 testdata.897552 2026-02-17T04:50:23.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj175 testdata.897552 2026-02-17T04:50:23.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj176 testdata.897552 2026-02-17T04:50:23.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj177 testdata.897552 2026-02-17T04:50:23.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj178 testdata.897552 2026-02-17T04:50:23.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj179 testdata.897552 2026-02-17T04:50:23.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj180 testdata.897552 2026-02-17T04:50:23.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj181 testdata.897552 2026-02-17T04:50:23.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:23.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj182 testdata.897552 2026-02-17T04:50:24.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj183 testdata.897552 2026-02-17T04:50:24.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj184 testdata.897552 2026-02-17T04:50:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj185 testdata.897552 2026-02-17T04:50:24.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj186 testdata.897552 2026-02-17T04:50:24.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj187 testdata.897552 2026-02-17T04:50:24.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj188 testdata.897552 2026-02-17T04:50:24.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj189 testdata.897552 2026-02-17T04:50:24.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj190 testdata.897552 2026-02-17T04:50:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj191 testdata.897552 2026-02-17T04:50:24.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj192 testdata.897552 2026-02-17T04:50:24.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj193 testdata.897552 2026-02-17T04:50:24.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj194 testdata.897552 2026-02-17T04:50:24.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj195 testdata.897552 2026-02-17T04:50:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj196 testdata.897552 2026-02-17T04:50:24.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj197 testdata.897552 2026-02-17T04:50:24.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj198 testdata.897552 2026-02-17T04:50:24.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj199 testdata.897552 2026-02-17T04:50:24.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj200 testdata.897552 2026-02-17T04:50:24.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj201 testdata.897552 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj202 testdata.897552 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj203 testdata.897552 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj204 testdata.897552 2026-02-17T04:50:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj205 testdata.897552 2026-02-17T04:50:24.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj206 testdata.897552 2026-02-17T04:50:24.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj207 testdata.897552 2026-02-17T04:50:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj208 testdata.897552 2026-02-17T04:50:24.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj209 testdata.897552 2026-02-17T04:50:24.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj210 testdata.897552 2026-02-17T04:50:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj211 testdata.897552 2026-02-17T04:50:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj212 testdata.897552 2026-02-17T04:50:24.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj213 testdata.897552 2026-02-17T04:50:24.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj214 testdata.897552 2026-02-17T04:50:24.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj215 testdata.897552 2026-02-17T04:50:24.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj216 testdata.897552 2026-02-17T04:50:24.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj217 testdata.897552 2026-02-17T04:50:24.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj218 testdata.897552 2026-02-17T04:50:24.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj219 testdata.897552 2026-02-17T04:50:24.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj220 testdata.897552 2026-02-17T04:50:24.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj221 testdata.897552 2026-02-17T04:50:24.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj222 testdata.897552 2026-02-17T04:50:24.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj223 testdata.897552 2026-02-17T04:50:24.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj224 testdata.897552 2026-02-17T04:50:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj225 testdata.897552 2026-02-17T04:50:24.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj226 testdata.897552 2026-02-17T04:50:24.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj227 testdata.897552 2026-02-17T04:50:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj228 testdata.897552 2026-02-17T04:50:24.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj229 testdata.897552 2026-02-17T04:50:24.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj230 testdata.897552 2026-02-17T04:50:24.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj231 testdata.897552 2026-02-17T04:50:24.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj232 testdata.897552 2026-02-17T04:50:24.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj233 testdata.897552 2026-02-17T04:50:24.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj234 testdata.897552 2026-02-17T04:50:24.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj235 testdata.897552 2026-02-17T04:50:24.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj236 testdata.897552 2026-02-17T04:50:24.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj237 testdata.897552 2026-02-17T04:50:24.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj238 testdata.897552 2026-02-17T04:50:24.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj239 testdata.897552 2026-02-17T04:50:24.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj240 testdata.897552 2026-02-17T04:50:24.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj241 testdata.897552 2026-02-17T04:50:24.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj242 testdata.897552 2026-02-17T04:50:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj243 testdata.897552 2026-02-17T04:50:24.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj244 testdata.897552 2026-02-17T04:50:24.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj245 testdata.897552 2026-02-17T04:50:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:24.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj246 testdata.897552 2026-02-17T04:50:25.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj247 testdata.897552 2026-02-17T04:50:25.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj248 testdata.897552 2026-02-17T04:50:25.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj249 testdata.897552 2026-02-17T04:50:25.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj250 testdata.897552 2026-02-17T04:50:25.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj251 testdata.897552 2026-02-17T04:50:25.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj252 testdata.897552 2026-02-17T04:50:25.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj253 testdata.897552 2026-02-17T04:50:25.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj254 testdata.897552 2026-02-17T04:50:25.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj255 testdata.897552 2026-02-17T04:50:25.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj256 testdata.897552 2026-02-17T04:50:25.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj257 testdata.897552 2026-02-17T04:50:25.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj258 testdata.897552 2026-02-17T04:50:25.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj259 testdata.897552 2026-02-17T04:50:25.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj260 testdata.897552 2026-02-17T04:50:25.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj261 testdata.897552 2026-02-17T04:50:25.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj262 testdata.897552 2026-02-17T04:50:25.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj263 testdata.897552 2026-02-17T04:50:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj264 testdata.897552 2026-02-17T04:50:25.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj265 testdata.897552 2026-02-17T04:50:25.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj266 testdata.897552 2026-02-17T04:50:25.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj267 testdata.897552 2026-02-17T04:50:25.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj268 testdata.897552 2026-02-17T04:50:25.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj269 testdata.897552 2026-02-17T04:50:25.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj270 testdata.897552 2026-02-17T04:50:25.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj271 testdata.897552 2026-02-17T04:50:25.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj272 testdata.897552 2026-02-17T04:50:25.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj273 testdata.897552 2026-02-17T04:50:25.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj274 testdata.897552 2026-02-17T04:50:25.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj275 testdata.897552 2026-02-17T04:50:25.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj276 testdata.897552 2026-02-17T04:50:25.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj277 testdata.897552 2026-02-17T04:50:25.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj278 testdata.897552 2026-02-17T04:50:25.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj279 testdata.897552 2026-02-17T04:50:25.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj280 testdata.897552 2026-02-17T04:50:25.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj281 testdata.897552 2026-02-17T04:50:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj282 testdata.897552 2026-02-17T04:50:25.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj283 testdata.897552 2026-02-17T04:50:25.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj284 testdata.897552 2026-02-17T04:50:25.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj285 testdata.897552 2026-02-17T04:50:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj286 testdata.897552 2026-02-17T04:50:25.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj287 testdata.897552 2026-02-17T04:50:25.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj288 testdata.897552 2026-02-17T04:50:25.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj289 testdata.897552 2026-02-17T04:50:25.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj290 testdata.897552 2026-02-17T04:50:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj291 testdata.897552 2026-02-17T04:50:25.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj292 testdata.897552 2026-02-17T04:50:25.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj293 testdata.897552 2026-02-17T04:50:25.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj294 testdata.897552 2026-02-17T04:50:25.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj295 testdata.897552 2026-02-17T04:50:25.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj296 testdata.897552 2026-02-17T04:50:25.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj297 testdata.897552 2026-02-17T04:50:25.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj298 testdata.897552 2026-02-17T04:50:25.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj299 testdata.897552 2026-02-17T04:50:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj300 testdata.897552 2026-02-17T04:50:25.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj301 testdata.897552 2026-02-17T04:50:25.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj302 testdata.897552 2026-02-17T04:50:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj303 testdata.897552 2026-02-17T04:50:25.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj304 testdata.897552 2026-02-17T04:50:25.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj305 testdata.897552 2026-02-17T04:50:25.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj306 testdata.897552 2026-02-17T04:50:25.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj307 testdata.897552 2026-02-17T04:50:25.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj308 testdata.897552 2026-02-17T04:50:25.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:25.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj309 testdata.897552 2026-02-17T04:50:26.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj310 testdata.897552 2026-02-17T04:50:26.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj311 testdata.897552 2026-02-17T04:50:26.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj312 testdata.897552 2026-02-17T04:50:26.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj313 testdata.897552 2026-02-17T04:50:26.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj314 testdata.897552 2026-02-17T04:50:26.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj315 testdata.897552 2026-02-17T04:50:26.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj316 testdata.897552 2026-02-17T04:50:26.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj317 testdata.897552 2026-02-17T04:50:26.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj318 testdata.897552 2026-02-17T04:50:26.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj319 testdata.897552 2026-02-17T04:50:26.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj320 testdata.897552 2026-02-17T04:50:26.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj321 testdata.897552 2026-02-17T04:50:26.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj322 testdata.897552 2026-02-17T04:50:26.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj323 testdata.897552 2026-02-17T04:50:26.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj324 testdata.897552 2026-02-17T04:50:26.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj325 testdata.897552 2026-02-17T04:50:26.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj326 testdata.897552 2026-02-17T04:50:26.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj327 testdata.897552 2026-02-17T04:50:26.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj328 testdata.897552 2026-02-17T04:50:26.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj329 testdata.897552 2026-02-17T04:50:26.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj330 testdata.897552 2026-02-17T04:50:26.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj331 testdata.897552 2026-02-17T04:50:26.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj332 testdata.897552 2026-02-17T04:50:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj333 testdata.897552 2026-02-17T04:50:26.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj334 testdata.897552 2026-02-17T04:50:26.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj335 testdata.897552 2026-02-17T04:50:26.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj336 testdata.897552 2026-02-17T04:50:26.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj337 testdata.897552 2026-02-17T04:50:26.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj338 testdata.897552 2026-02-17T04:50:26.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.460 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj339 testdata.897552 2026-02-17T04:50:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj340 testdata.897552 2026-02-17T04:50:26.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj341 testdata.897552 2026-02-17T04:50:26.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj342 testdata.897552 2026-02-17T04:50:26.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj343 testdata.897552 2026-02-17T04:50:26.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj344 testdata.897552 2026-02-17T04:50:26.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj345 testdata.897552 2026-02-17T04:50:26.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj346 testdata.897552 2026-02-17T04:50:26.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj347 testdata.897552 2026-02-17T04:50:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj348 testdata.897552 2026-02-17T04:50:26.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj349 testdata.897552 2026-02-17T04:50:26.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj350 testdata.897552 2026-02-17T04:50:26.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj351 testdata.897552 2026-02-17T04:50:26.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj352 testdata.897552 2026-02-17T04:50:26.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj353 testdata.897552 2026-02-17T04:50:26.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj354 testdata.897552 2026-02-17T04:50:26.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj355 testdata.897552 2026-02-17T04:50:26.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj356 testdata.897552 2026-02-17T04:50:26.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj357 testdata.897552 2026-02-17T04:50:26.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj358 testdata.897552 2026-02-17T04:50:26.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj359 testdata.897552 2026-02-17T04:50:26.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj360 testdata.897552 2026-02-17T04:50:26.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj361 testdata.897552 2026-02-17T04:50:26.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj362 testdata.897552 2026-02-17T04:50:26.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj363 testdata.897552 2026-02-17T04:50:26.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj364 testdata.897552 2026-02-17T04:50:26.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj365 testdata.897552 2026-02-17T04:50:26.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj366 testdata.897552 2026-02-17T04:50:26.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj367 testdata.897552 2026-02-17T04:50:26.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj368 testdata.897552 2026-02-17T04:50:26.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj369 testdata.897552 2026-02-17T04:50:26.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj370 testdata.897552 2026-02-17T04:50:26.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj371 testdata.897552 2026-02-17T04:50:26.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj372 testdata.897552 2026-02-17T04:50:26.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:26.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj373 testdata.897552 2026-02-17T04:50:27.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj374 testdata.897552 2026-02-17T04:50:27.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj375 testdata.897552 2026-02-17T04:50:27.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj376 testdata.897552 2026-02-17T04:50:27.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj377 testdata.897552 2026-02-17T04:50:27.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj378 testdata.897552 2026-02-17T04:50:27.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj379 testdata.897552 2026-02-17T04:50:27.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj380 testdata.897552 2026-02-17T04:50:27.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj381 testdata.897552 2026-02-17T04:50:27.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj382 testdata.897552 2026-02-17T04:50:27.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj383 testdata.897552 2026-02-17T04:50:27.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj384 testdata.897552 2026-02-17T04:50:27.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj385 testdata.897552 2026-02-17T04:50:27.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj386 testdata.897552 2026-02-17T04:50:27.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj387 testdata.897552 2026-02-17T04:50:27.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj388 testdata.897552 2026-02-17T04:50:27.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj389 testdata.897552 2026-02-17T04:50:27.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj390 testdata.897552 2026-02-17T04:50:27.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj391 testdata.897552 2026-02-17T04:50:27.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj392 testdata.897552 2026-02-17T04:50:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj393 testdata.897552 2026-02-17T04:50:27.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj394 testdata.897552 2026-02-17T04:50:27.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj395 testdata.897552 2026-02-17T04:50:27.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj396 testdata.897552 2026-02-17T04:50:27.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj397 testdata.897552 2026-02-17T04:50:27.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj398 testdata.897552 2026-02-17T04:50:27.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj399 testdata.897552 2026-02-17T04:50:27.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj400 testdata.897552 2026-02-17T04:50:27.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj401 testdata.897552 2026-02-17T04:50:27.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj402 testdata.897552 2026-02-17T04:50:27.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj403 testdata.897552 2026-02-17T04:50:27.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj404 testdata.897552 2026-02-17T04:50:27.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj405 testdata.897552 2026-02-17T04:50:27.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj406 testdata.897552 2026-02-17T04:50:27.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj407 testdata.897552 2026-02-17T04:50:27.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj408 testdata.897552 2026-02-17T04:50:27.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj409 testdata.897552 2026-02-17T04:50:27.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj410 testdata.897552 2026-02-17T04:50:27.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj411 testdata.897552 2026-02-17T04:50:27.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj412 testdata.897552 2026-02-17T04:50:27.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj413 testdata.897552 2026-02-17T04:50:27.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj414 testdata.897552 2026-02-17T04:50:27.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj415 testdata.897552 2026-02-17T04:50:27.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj416 testdata.897552 2026-02-17T04:50:27.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj417 testdata.897552 2026-02-17T04:50:27.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj418 testdata.897552 2026-02-17T04:50:27.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj419 testdata.897552 2026-02-17T04:50:27.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj420 testdata.897552 2026-02-17T04:50:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj421 testdata.897552 2026-02-17T04:50:27.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj422 testdata.897552 2026-02-17T04:50:27.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj423 testdata.897552 2026-02-17T04:50:27.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj424 testdata.897552 2026-02-17T04:50:27.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj425 testdata.897552 2026-02-17T04:50:27.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj426 testdata.897552 2026-02-17T04:50:27.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj427 testdata.897552 2026-02-17T04:50:27.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj428 testdata.897552 2026-02-17T04:50:27.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj429 testdata.897552 2026-02-17T04:50:27.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj430 testdata.897552 2026-02-17T04:50:27.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj431 testdata.897552 2026-02-17T04:50:27.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj432 testdata.897552 2026-02-17T04:50:27.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj433 testdata.897552 2026-02-17T04:50:27.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj434 testdata.897552 2026-02-17T04:50:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj435 testdata.897552 2026-02-17T04:50:27.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj436 testdata.897552 2026-02-17T04:50:27.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:27.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj437 testdata.897552 2026-02-17T04:50:28.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj438 testdata.897552 2026-02-17T04:50:28.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj439 testdata.897552 2026-02-17T04:50:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj440 testdata.897552 2026-02-17T04:50:28.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj441 testdata.897552 2026-02-17T04:50:28.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj442 testdata.897552 2026-02-17T04:50:28.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj443 testdata.897552 2026-02-17T04:50:28.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj444 testdata.897552 2026-02-17T04:50:28.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj445 testdata.897552 2026-02-17T04:50:28.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj446 testdata.897552 2026-02-17T04:50:28.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj447 testdata.897552 2026-02-17T04:50:28.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj448 testdata.897552 2026-02-17T04:50:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj449 testdata.897552 2026-02-17T04:50:28.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj450 testdata.897552 2026-02-17T04:50:28.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj451 testdata.897552 2026-02-17T04:50:28.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj452 testdata.897552 2026-02-17T04:50:28.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj453 testdata.897552 2026-02-17T04:50:28.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj454 testdata.897552 2026-02-17T04:50:28.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj455 testdata.897552 2026-02-17T04:50:28.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj456 testdata.897552 2026-02-17T04:50:28.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj457 testdata.897552 2026-02-17T04:50:28.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj458 testdata.897552 2026-02-17T04:50:28.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj459 testdata.897552 2026-02-17T04:50:28.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj460 testdata.897552 2026-02-17T04:50:28.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj461 testdata.897552 2026-02-17T04:50:28.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj462 testdata.897552 2026-02-17T04:50:28.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj463 testdata.897552 2026-02-17T04:50:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj464 testdata.897552 2026-02-17T04:50:28.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj465 testdata.897552 2026-02-17T04:50:28.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj466 testdata.897552 2026-02-17T04:50:28.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj467 testdata.897552 2026-02-17T04:50:28.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj468 testdata.897552 2026-02-17T04:50:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj469 testdata.897552 2026-02-17T04:50:28.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj470 testdata.897552 2026-02-17T04:50:28.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj471 testdata.897552 2026-02-17T04:50:28.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj472 testdata.897552 2026-02-17T04:50:28.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj473 testdata.897552 2026-02-17T04:50:28.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj474 testdata.897552 2026-02-17T04:50:28.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj475 testdata.897552 2026-02-17T04:50:28.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj476 testdata.897552 2026-02-17T04:50:28.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj477 testdata.897552 2026-02-17T04:50:28.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj478 testdata.897552 2026-02-17T04:50:28.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj479 testdata.897552 2026-02-17T04:50:28.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj480 testdata.897552 2026-02-17T04:50:28.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj481 testdata.897552 2026-02-17T04:50:28.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj482 testdata.897552 2026-02-17T04:50:28.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj483 testdata.897552 2026-02-17T04:50:28.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj484 testdata.897552 2026-02-17T04:50:28.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj485 testdata.897552 2026-02-17T04:50:28.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj486 testdata.897552 2026-02-17T04:50:28.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj487 testdata.897552 2026-02-17T04:50:28.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj488 testdata.897552 2026-02-17T04:50:28.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj489 testdata.897552 2026-02-17T04:50:28.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj490 testdata.897552 2026-02-17T04:50:28.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj491 testdata.897552 2026-02-17T04:50:28.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj492 testdata.897552 2026-02-17T04:50:28.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj493 testdata.897552 2026-02-17T04:50:28.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj494 testdata.897552 2026-02-17T04:50:28.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj495 testdata.897552 2026-02-17T04:50:28.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj496 testdata.897552 2026-02-17T04:50:28.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj497 testdata.897552 2026-02-17T04:50:28.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj498 testdata.897552 2026-02-17T04:50:28.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj499 testdata.897552 2026-02-17T04:50:28.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:28.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj500 testdata.897552 2026-02-17T04:50:29.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj501 testdata.897552 2026-02-17T04:50:29.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj502 testdata.897552 2026-02-17T04:50:29.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj503 testdata.897552 2026-02-17T04:50:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj504 testdata.897552 2026-02-17T04:50:29.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj505 testdata.897552 2026-02-17T04:50:29.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj506 testdata.897552 2026-02-17T04:50:29.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj507 testdata.897552 2026-02-17T04:50:29.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj508 testdata.897552 2026-02-17T04:50:29.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj509 testdata.897552 2026-02-17T04:50:29.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj510 testdata.897552 2026-02-17T04:50:29.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj511 testdata.897552 2026-02-17T04:50:29.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj512 testdata.897552 2026-02-17T04:50:29.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj513 testdata.897552 2026-02-17T04:50:29.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj514 testdata.897552 2026-02-17T04:50:29.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj515 testdata.897552 2026-02-17T04:50:29.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj516 testdata.897552 2026-02-17T04:50:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj517 testdata.897552 2026-02-17T04:50:29.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj518 testdata.897552 2026-02-17T04:50:29.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj519 testdata.897552 2026-02-17T04:50:29.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj520 testdata.897552 2026-02-17T04:50:29.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj521 testdata.897552 2026-02-17T04:50:29.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj522 testdata.897552 2026-02-17T04:50:29.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj523 testdata.897552 2026-02-17T04:50:29.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj524 testdata.897552 2026-02-17T04:50:29.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj525 testdata.897552 2026-02-17T04:50:29.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj526 testdata.897552 2026-02-17T04:50:29.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj527 testdata.897552 2026-02-17T04:50:29.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj528 testdata.897552 2026-02-17T04:50:29.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj529 testdata.897552 2026-02-17T04:50:29.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj530 testdata.897552 2026-02-17T04:50:29.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj531 testdata.897552 2026-02-17T04:50:29.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj532 testdata.897552 2026-02-17T04:50:29.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj533 testdata.897552 2026-02-17T04:50:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj534 testdata.897552 2026-02-17T04:50:29.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj535 testdata.897552 2026-02-17T04:50:29.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj536 testdata.897552 2026-02-17T04:50:29.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj537 testdata.897552 2026-02-17T04:50:29.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj538 testdata.897552 2026-02-17T04:50:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj539 testdata.897552 2026-02-17T04:50:29.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj540 testdata.897552 2026-02-17T04:50:29.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj541 testdata.897552 2026-02-17T04:50:29.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj542 testdata.897552 2026-02-17T04:50:29.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj543 testdata.897552 2026-02-17T04:50:29.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj544 testdata.897552 2026-02-17T04:50:29.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj545 testdata.897552 2026-02-17T04:50:29.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj546 testdata.897552 2026-02-17T04:50:29.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj547 testdata.897552 2026-02-17T04:50:29.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj548 testdata.897552 2026-02-17T04:50:29.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj549 testdata.897552 2026-02-17T04:50:29.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj550 testdata.897552 2026-02-17T04:50:29.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj551 testdata.897552 2026-02-17T04:50:29.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj552 testdata.897552 2026-02-17T04:50:29.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj553 testdata.897552 2026-02-17T04:50:29.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj554 testdata.897552 2026-02-17T04:50:29.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj555 testdata.897552 2026-02-17T04:50:29.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj556 testdata.897552 2026-02-17T04:50:29.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj557 testdata.897552 2026-02-17T04:50:29.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj558 testdata.897552 2026-02-17T04:50:29.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj559 testdata.897552 2026-02-17T04:50:29.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj560 testdata.897552 2026-02-17T04:50:29.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj561 testdata.897552 2026-02-17T04:50:29.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj562 testdata.897552 2026-02-17T04:50:29.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj563 testdata.897552 2026-02-17T04:50:29.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:29.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj564 testdata.897552 2026-02-17T04:50:30.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj565 testdata.897552 2026-02-17T04:50:30.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj566 testdata.897552 2026-02-17T04:50:30.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj567 testdata.897552 2026-02-17T04:50:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj568 testdata.897552 2026-02-17T04:50:30.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj569 testdata.897552 2026-02-17T04:50:30.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj570 testdata.897552 2026-02-17T04:50:30.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj571 testdata.897552 2026-02-17T04:50:30.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj572 testdata.897552 2026-02-17T04:50:30.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj573 testdata.897552 2026-02-17T04:50:30.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj574 testdata.897552 2026-02-17T04:50:30.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj575 testdata.897552 2026-02-17T04:50:30.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj576 testdata.897552 2026-02-17T04:50:30.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj577 testdata.897552 2026-02-17T04:50:30.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj578 testdata.897552 2026-02-17T04:50:30.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj579 testdata.897552 2026-02-17T04:50:30.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj580 testdata.897552 2026-02-17T04:50:30.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj581 testdata.897552 2026-02-17T04:50:30.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj582 testdata.897552 2026-02-17T04:50:30.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj583 testdata.897552 2026-02-17T04:50:30.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj584 testdata.897552 2026-02-17T04:50:30.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj585 testdata.897552 2026-02-17T04:50:30.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj586 testdata.897552 2026-02-17T04:50:30.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj587 testdata.897552 2026-02-17T04:50:30.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj588 testdata.897552 2026-02-17T04:50:30.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj589 testdata.897552 2026-02-17T04:50:30.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj590 testdata.897552 2026-02-17T04:50:30.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj591 testdata.897552 2026-02-17T04:50:30.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj592 testdata.897552 2026-02-17T04:50:30.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj593 testdata.897552 2026-02-17T04:50:30.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj594 testdata.897552 2026-02-17T04:50:30.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj595 testdata.897552 2026-02-17T04:50:30.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj596 testdata.897552 2026-02-17T04:50:30.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj597 testdata.897552 2026-02-17T04:50:30.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj598 testdata.897552 2026-02-17T04:50:30.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj599 testdata.897552 2026-02-17T04:50:30.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj600 testdata.897552 2026-02-17T04:50:30.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj601 testdata.897552 2026-02-17T04:50:30.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj602 testdata.897552 2026-02-17T04:50:30.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj603 testdata.897552 2026-02-17T04:50:30.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj604 testdata.897552 2026-02-17T04:50:30.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj605 testdata.897552 2026-02-17T04:50:30.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj606 testdata.897552 2026-02-17T04:50:30.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj607 testdata.897552 2026-02-17T04:50:30.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj608 testdata.897552 2026-02-17T04:50:30.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj609 testdata.897552 2026-02-17T04:50:30.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj610 testdata.897552 2026-02-17T04:50:30.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj611 testdata.897552 2026-02-17T04:50:30.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj612 testdata.897552 2026-02-17T04:50:30.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj613 testdata.897552 2026-02-17T04:50:30.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj614 testdata.897552 2026-02-17T04:50:30.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj615 testdata.897552 2026-02-17T04:50:30.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj616 testdata.897552 2026-02-17T04:50:30.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj617 testdata.897552 2026-02-17T04:50:30.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj618 testdata.897552 2026-02-17T04:50:30.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj619 testdata.897552 2026-02-17T04:50:30.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj620 testdata.897552 2026-02-17T04:50:30.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj621 testdata.897552 2026-02-17T04:50:30.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj622 testdata.897552 2026-02-17T04:50:30.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj623 testdata.897552 2026-02-17T04:50:30.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj624 testdata.897552 2026-02-17T04:50:30.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj625 testdata.897552 2026-02-17T04:50:30.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj626 testdata.897552 2026-02-17T04:50:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:30.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj627 testdata.897552 2026-02-17T04:50:31.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj628 testdata.897552 2026-02-17T04:50:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj629 testdata.897552 2026-02-17T04:50:31.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj630 testdata.897552 2026-02-17T04:50:31.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj631 testdata.897552 2026-02-17T04:50:31.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj632 testdata.897552 2026-02-17T04:50:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj633 testdata.897552 2026-02-17T04:50:31.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj634 testdata.897552 2026-02-17T04:50:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj635 testdata.897552 2026-02-17T04:50:31.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj636 testdata.897552 2026-02-17T04:50:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj637 testdata.897552 2026-02-17T04:50:31.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj638 testdata.897552 2026-02-17T04:50:31.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj639 testdata.897552 2026-02-17T04:50:31.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj640 testdata.897552 2026-02-17T04:50:31.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj641 testdata.897552 2026-02-17T04:50:31.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj642 testdata.897552 2026-02-17T04:50:31.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj643 testdata.897552 2026-02-17T04:50:31.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj644 testdata.897552 2026-02-17T04:50:31.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj645 testdata.897552 2026-02-17T04:50:31.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj646 testdata.897552 2026-02-17T04:50:31.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj647 testdata.897552 2026-02-17T04:50:31.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj648 testdata.897552 2026-02-17T04:50:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj649 testdata.897552 2026-02-17T04:50:31.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj650 testdata.897552 2026-02-17T04:50:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj651 testdata.897552 2026-02-17T04:50:31.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj652 testdata.897552 2026-02-17T04:50:31.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj653 testdata.897552 2026-02-17T04:50:31.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj654 testdata.897552 2026-02-17T04:50:31.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj655 testdata.897552 2026-02-17T04:50:31.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj656 testdata.897552 2026-02-17T04:50:31.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj657 testdata.897552 2026-02-17T04:50:31.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj658 testdata.897552 2026-02-17T04:50:31.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj659 testdata.897552 2026-02-17T04:50:31.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj660 testdata.897552 2026-02-17T04:50:31.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj661 testdata.897552 2026-02-17T04:50:31.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj662 testdata.897552 2026-02-17T04:50:31.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj663 testdata.897552 2026-02-17T04:50:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj664 testdata.897552 2026-02-17T04:50:31.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj665 testdata.897552 2026-02-17T04:50:31.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj666 testdata.897552 2026-02-17T04:50:31.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj667 testdata.897552 2026-02-17T04:50:31.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj668 testdata.897552 2026-02-17T04:50:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj669 testdata.897552 2026-02-17T04:50:31.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj670 testdata.897552 2026-02-17T04:50:31.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj671 testdata.897552 2026-02-17T04:50:31.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj672 testdata.897552 2026-02-17T04:50:31.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj673 testdata.897552 2026-02-17T04:50:31.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj674 testdata.897552 2026-02-17T04:50:31.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj675 testdata.897552 2026-02-17T04:50:31.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj676 testdata.897552 2026-02-17T04:50:31.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj677 testdata.897552 2026-02-17T04:50:31.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj678 testdata.897552 2026-02-17T04:50:31.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj679 testdata.897552 2026-02-17T04:50:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj680 testdata.897552 2026-02-17T04:50:31.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj681 testdata.897552 2026-02-17T04:50:31.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj682 testdata.897552 2026-02-17T04:50:31.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj683 testdata.897552 2026-02-17T04:50:31.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj684 testdata.897552 2026-02-17T04:50:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj685 testdata.897552 2026-02-17T04:50:31.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj686 testdata.897552 2026-02-17T04:50:31.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj687 testdata.897552 2026-02-17T04:50:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj688 testdata.897552 2026-02-17T04:50:31.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj689 testdata.897552 2026-02-17T04:50:31.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj690 testdata.897552 2026-02-17T04:50:31.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:31.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj691 testdata.897552 2026-02-17T04:50:32.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj692 testdata.897552 2026-02-17T04:50:32.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj693 testdata.897552 2026-02-17T04:50:32.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj694 testdata.897552 2026-02-17T04:50:32.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj695 testdata.897552 2026-02-17T04:50:32.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj696 testdata.897552 2026-02-17T04:50:32.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj697 testdata.897552 2026-02-17T04:50:32.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj698 testdata.897552 2026-02-17T04:50:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj699 testdata.897552 2026-02-17T04:50:32.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj700 testdata.897552 2026-02-17T04:50:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj701 testdata.897552 2026-02-17T04:50:32.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj702 testdata.897552 2026-02-17T04:50:32.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj703 testdata.897552 2026-02-17T04:50:32.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj704 testdata.897552 2026-02-17T04:50:32.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj705 testdata.897552 2026-02-17T04:50:32.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj706 testdata.897552 2026-02-17T04:50:32.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj707 testdata.897552 2026-02-17T04:50:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj708 testdata.897552 2026-02-17T04:50:32.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj709 testdata.897552 2026-02-17T04:50:32.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj710 testdata.897552 2026-02-17T04:50:32.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj711 testdata.897552 2026-02-17T04:50:32.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj712 testdata.897552 2026-02-17T04:50:32.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj713 testdata.897552 2026-02-17T04:50:32.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj714 testdata.897552 2026-02-17T04:50:32.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj715 testdata.897552 2026-02-17T04:50:32.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj716 testdata.897552 2026-02-17T04:50:32.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj717 testdata.897552 2026-02-17T04:50:32.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj718 testdata.897552 2026-02-17T04:50:32.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj719 testdata.897552 2026-02-17T04:50:32.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj720 testdata.897552 2026-02-17T04:50:32.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj721 testdata.897552 2026-02-17T04:50:32.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj722 testdata.897552 2026-02-17T04:50:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj723 testdata.897552 2026-02-17T04:50:32.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj724 testdata.897552 2026-02-17T04:50:32.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.522 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj725 testdata.897552 2026-02-17T04:50:32.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj726 testdata.897552 2026-02-17T04:50:32.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj727 testdata.897552 2026-02-17T04:50:32.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj728 testdata.897552 2026-02-17T04:50:32.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj729 testdata.897552 2026-02-17T04:50:32.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj730 testdata.897552 2026-02-17T04:50:32.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj731 testdata.897552 2026-02-17T04:50:32.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj732 testdata.897552 2026-02-17T04:50:32.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj733 testdata.897552 2026-02-17T04:50:32.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj734 testdata.897552 2026-02-17T04:50:32.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj735 testdata.897552 2026-02-17T04:50:32.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj736 testdata.897552 2026-02-17T04:50:32.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj737 testdata.897552 2026-02-17T04:50:32.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj738 testdata.897552 2026-02-17T04:50:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj739 testdata.897552 2026-02-17T04:50:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj740 testdata.897552 2026-02-17T04:50:32.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj741 testdata.897552 2026-02-17T04:50:32.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj742 testdata.897552 2026-02-17T04:50:32.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj743 testdata.897552 2026-02-17T04:50:32.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj744 testdata.897552 2026-02-17T04:50:32.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj745 testdata.897552 2026-02-17T04:50:32.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj746 testdata.897552 2026-02-17T04:50:32.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj747 testdata.897552 2026-02-17T04:50:32.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj748 testdata.897552 2026-02-17T04:50:32.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj749 testdata.897552 2026-02-17T04:50:32.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj750 testdata.897552 2026-02-17T04:50:32.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj751 testdata.897552 2026-02-17T04:50:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj752 testdata.897552 2026-02-17T04:50:32.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj753 testdata.897552 2026-02-17T04:50:32.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj754 testdata.897552 2026-02-17T04:50:32.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:32.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj755 testdata.897552 2026-02-17T04:50:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj756 testdata.897552 2026-02-17T04:50:33.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj757 testdata.897552 2026-02-17T04:50:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj758 testdata.897552 2026-02-17T04:50:33.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj759 testdata.897552 2026-02-17T04:50:33.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj760 testdata.897552 2026-02-17T04:50:33.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj761 testdata.897552 2026-02-17T04:50:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj762 testdata.897552 2026-02-17T04:50:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj763 testdata.897552 2026-02-17T04:50:33.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj764 testdata.897552 2026-02-17T04:50:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj765 testdata.897552 2026-02-17T04:50:33.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj766 testdata.897552 2026-02-17T04:50:33.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj767 testdata.897552 2026-02-17T04:50:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj768 testdata.897552 2026-02-17T04:50:33.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj769 testdata.897552 2026-02-17T04:50:33.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj770 testdata.897552 2026-02-17T04:50:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj771 testdata.897552 2026-02-17T04:50:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj772 testdata.897552 2026-02-17T04:50:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj773 testdata.897552 2026-02-17T04:50:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj774 testdata.897552 2026-02-17T04:50:33.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj775 testdata.897552 2026-02-17T04:50:33.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj776 testdata.897552 2026-02-17T04:50:33.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj777 testdata.897552 2026-02-17T04:50:33.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj778 testdata.897552 2026-02-17T04:50:33.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj779 testdata.897552 2026-02-17T04:50:33.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj780 testdata.897552 2026-02-17T04:50:33.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj781 testdata.897552 2026-02-17T04:50:33.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj782 testdata.897552 2026-02-17T04:50:33.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj783 testdata.897552 2026-02-17T04:50:33.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj784 testdata.897552 2026-02-17T04:50:33.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj785 testdata.897552 2026-02-17T04:50:33.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj786 testdata.897552 2026-02-17T04:50:33.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj787 testdata.897552 2026-02-17T04:50:33.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj788 testdata.897552 2026-02-17T04:50:33.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj789 testdata.897552 2026-02-17T04:50:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj790 testdata.897552 2026-02-17T04:50:33.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj791 testdata.897552 2026-02-17T04:50:33.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj792 testdata.897552 2026-02-17T04:50:33.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj793 testdata.897552 2026-02-17T04:50:33.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj794 testdata.897552 2026-02-17T04:50:33.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj795 testdata.897552 2026-02-17T04:50:33.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj796 testdata.897552 2026-02-17T04:50:33.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj797 testdata.897552 2026-02-17T04:50:33.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj798 testdata.897552 2026-02-17T04:50:33.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj799 testdata.897552 2026-02-17T04:50:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj800 testdata.897552 2026-02-17T04:50:33.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj801 testdata.897552 2026-02-17T04:50:33.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj802 testdata.897552 2026-02-17T04:50:33.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj803 testdata.897552 2026-02-17T04:50:33.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj804 testdata.897552 2026-02-17T04:50:33.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj805 testdata.897552 2026-02-17T04:50:33.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj806 testdata.897552 2026-02-17T04:50:33.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj807 testdata.897552 2026-02-17T04:50:33.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj808 testdata.897552 2026-02-17T04:50:33.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj809 testdata.897552 2026-02-17T04:50:33.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj810 testdata.897552 2026-02-17T04:50:33.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj811 testdata.897552 2026-02-17T04:50:33.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj812 testdata.897552 2026-02-17T04:50:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj813 testdata.897552 2026-02-17T04:50:33.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj814 testdata.897552 2026-02-17T04:50:33.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj815 testdata.897552 2026-02-17T04:50:33.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj816 testdata.897552 2026-02-17T04:50:33.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj817 testdata.897552 2026-02-17T04:50:33.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj818 testdata.897552 2026-02-17T04:50:33.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:33.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj819 testdata.897552 2026-02-17T04:50:34.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj820 testdata.897552 2026-02-17T04:50:34.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj821 testdata.897552 2026-02-17T04:50:34.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj822 testdata.897552 2026-02-17T04:50:34.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj823 testdata.897552 2026-02-17T04:50:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj824 testdata.897552 2026-02-17T04:50:34.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj825 testdata.897552 2026-02-17T04:50:34.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj826 testdata.897552 2026-02-17T04:50:34.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj827 testdata.897552 2026-02-17T04:50:34.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj828 testdata.897552 2026-02-17T04:50:34.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj829 testdata.897552 2026-02-17T04:50:34.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj830 testdata.897552 2026-02-17T04:50:34.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj831 testdata.897552 2026-02-17T04:50:34.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj832 testdata.897552 2026-02-17T04:50:34.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj833 testdata.897552 2026-02-17T04:50:34.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj834 testdata.897552 2026-02-17T04:50:34.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj835 testdata.897552 2026-02-17T04:50:34.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj836 testdata.897552 2026-02-17T04:50:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj837 testdata.897552 2026-02-17T04:50:34.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj838 testdata.897552 2026-02-17T04:50:34.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj839 testdata.897552 2026-02-17T04:50:34.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj840 testdata.897552 2026-02-17T04:50:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj841 testdata.897552 2026-02-17T04:50:34.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj842 testdata.897552 2026-02-17T04:50:34.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj843 testdata.897552 2026-02-17T04:50:34.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj844 testdata.897552 2026-02-17T04:50:34.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj845 testdata.897552 2026-02-17T04:50:34.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj846 testdata.897552 2026-02-17T04:50:34.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj847 testdata.897552 2026-02-17T04:50:34.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj848 testdata.897552 2026-02-17T04:50:34.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj849 testdata.897552 2026-02-17T04:50:34.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj850 testdata.897552 2026-02-17T04:50:34.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj851 testdata.897552 2026-02-17T04:50:34.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj852 testdata.897552 2026-02-17T04:50:34.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj853 testdata.897552 2026-02-17T04:50:34.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj854 testdata.897552 2026-02-17T04:50:34.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj855 testdata.897552 2026-02-17T04:50:34.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj856 testdata.897552 2026-02-17T04:50:34.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj857 testdata.897552 2026-02-17T04:50:34.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj858 testdata.897552 2026-02-17T04:50:34.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj859 testdata.897552 2026-02-17T04:50:34.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj860 testdata.897552 2026-02-17T04:50:34.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj861 testdata.897552 2026-02-17T04:50:34.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj862 testdata.897552 2026-02-17T04:50:34.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj863 testdata.897552 2026-02-17T04:50:34.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj864 testdata.897552 2026-02-17T04:50:34.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj865 testdata.897552 2026-02-17T04:50:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj866 testdata.897552 2026-02-17T04:50:34.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj867 testdata.897552 2026-02-17T04:50:34.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj868 testdata.897552 2026-02-17T04:50:34.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj869 testdata.897552 2026-02-17T04:50:34.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj870 testdata.897552 2026-02-17T04:50:34.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj871 testdata.897552 2026-02-17T04:50:34.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj872 testdata.897552 2026-02-17T04:50:34.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj873 testdata.897552 2026-02-17T04:50:34.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj874 testdata.897552 2026-02-17T04:50:34.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj875 testdata.897552 2026-02-17T04:50:34.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj876 testdata.897552 2026-02-17T04:50:34.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj877 testdata.897552 2026-02-17T04:50:34.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj878 testdata.897552 2026-02-17T04:50:34.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj879 testdata.897552 2026-02-17T04:50:34.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj880 testdata.897552 2026-02-17T04:50:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj881 testdata.897552 2026-02-17T04:50:34.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj882 testdata.897552 2026-02-17T04:50:34.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:34.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj883 testdata.897552 2026-02-17T04:50:35.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj884 testdata.897552 2026-02-17T04:50:35.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj885 testdata.897552 2026-02-17T04:50:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj886 testdata.897552 2026-02-17T04:50:35.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj887 testdata.897552 2026-02-17T04:50:35.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj888 testdata.897552 2026-02-17T04:50:35.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj889 testdata.897552 2026-02-17T04:50:35.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj890 testdata.897552 2026-02-17T04:50:35.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj891 testdata.897552 2026-02-17T04:50:35.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj892 testdata.897552 2026-02-17T04:50:35.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj893 testdata.897552 2026-02-17T04:50:35.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj894 testdata.897552 2026-02-17T04:50:35.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj895 testdata.897552 2026-02-17T04:50:35.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj896 testdata.897552 2026-02-17T04:50:35.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj897 testdata.897552 2026-02-17T04:50:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj898 testdata.897552 2026-02-17T04:50:35.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj899 testdata.897552 2026-02-17T04:50:35.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj900 testdata.897552 2026-02-17T04:50:35.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj901 testdata.897552 2026-02-17T04:50:35.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj902 testdata.897552 2026-02-17T04:50:35.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj903 testdata.897552 2026-02-17T04:50:35.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj904 testdata.897552 2026-02-17T04:50:35.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj905 testdata.897552 2026-02-17T04:50:35.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj906 testdata.897552 2026-02-17T04:50:35.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj907 testdata.897552 2026-02-17T04:50:35.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj908 testdata.897552 2026-02-17T04:50:35.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj909 testdata.897552 2026-02-17T04:50:35.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj910 testdata.897552 2026-02-17T04:50:35.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj911 testdata.897552 2026-02-17T04:50:35.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj912 testdata.897552 2026-02-17T04:50:35.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj913 testdata.897552 2026-02-17T04:50:35.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj914 testdata.897552 2026-02-17T04:50:35.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj915 testdata.897552 2026-02-17T04:50:35.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj916 testdata.897552 2026-02-17T04:50:35.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj917 testdata.897552 2026-02-17T04:50:35.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj918 testdata.897552 2026-02-17T04:50:35.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj919 testdata.897552 2026-02-17T04:50:35.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj920 testdata.897552 2026-02-17T04:50:35.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj921 testdata.897552 2026-02-17T04:50:35.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj922 testdata.897552 2026-02-17T04:50:35.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj923 testdata.897552 2026-02-17T04:50:35.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj924 testdata.897552 2026-02-17T04:50:35.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj925 testdata.897552 2026-02-17T04:50:35.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj926 testdata.897552 2026-02-17T04:50:35.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj927 testdata.897552 2026-02-17T04:50:35.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj928 testdata.897552 2026-02-17T04:50:35.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj929 testdata.897552 2026-02-17T04:50:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj930 testdata.897552 2026-02-17T04:50:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj931 testdata.897552 2026-02-17T04:50:35.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj932 testdata.897552 2026-02-17T04:50:35.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj933 testdata.897552 2026-02-17T04:50:35.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj934 testdata.897552 2026-02-17T04:50:35.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj935 testdata.897552 2026-02-17T04:50:35.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj936 testdata.897552 2026-02-17T04:50:35.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj937 testdata.897552 2026-02-17T04:50:35.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj938 testdata.897552 2026-02-17T04:50:35.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj939 testdata.897552 2026-02-17T04:50:35.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj940 testdata.897552 2026-02-17T04:50:35.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj941 testdata.897552 2026-02-17T04:50:35.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj942 testdata.897552 2026-02-17T04:50:35.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj943 testdata.897552 2026-02-17T04:50:35.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj944 testdata.897552 2026-02-17T04:50:35.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj945 testdata.897552 2026-02-17T04:50:35.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj946 testdata.897552 2026-02-17T04:50:35.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:35.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj947 testdata.897552 2026-02-17T04:50:36.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj948 testdata.897552 2026-02-17T04:50:36.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj949 testdata.897552 2026-02-17T04:50:36.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj950 testdata.897552 2026-02-17T04:50:36.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj951 testdata.897552 2026-02-17T04:50:36.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj952 testdata.897552 2026-02-17T04:50:36.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj953 testdata.897552 2026-02-17T04:50:36.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj954 testdata.897552 2026-02-17T04:50:36.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj955 testdata.897552 2026-02-17T04:50:36.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj956 testdata.897552 2026-02-17T04:50:36.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj957 testdata.897552 2026-02-17T04:50:36.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj958 testdata.897552 2026-02-17T04:50:36.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj959 testdata.897552 2026-02-17T04:50:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj960 testdata.897552 2026-02-17T04:50:36.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj961 testdata.897552 2026-02-17T04:50:36.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj962 testdata.897552 2026-02-17T04:50:36.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj963 testdata.897552 2026-02-17T04:50:36.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj964 testdata.897552 2026-02-17T04:50:36.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj965 testdata.897552 2026-02-17T04:50:36.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj966 testdata.897552 2026-02-17T04:50:36.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj967 testdata.897552 2026-02-17T04:50:36.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj968 testdata.897552 2026-02-17T04:50:36.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj969 testdata.897552 2026-02-17T04:50:36.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj970 testdata.897552 2026-02-17T04:50:36.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj971 testdata.897552 2026-02-17T04:50:36.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj972 testdata.897552 2026-02-17T04:50:36.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj973 testdata.897552 2026-02-17T04:50:36.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj974 testdata.897552 2026-02-17T04:50:36.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj975 testdata.897552 2026-02-17T04:50:36.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj976 testdata.897552 2026-02-17T04:50:36.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj977 testdata.897552 2026-02-17T04:50:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj978 testdata.897552 2026-02-17T04:50:36.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj979 testdata.897552 2026-02-17T04:50:36.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj980 testdata.897552 2026-02-17T04:50:36.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj981 testdata.897552 2026-02-17T04:50:36.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj982 testdata.897552 2026-02-17T04:50:36.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj983 testdata.897552 2026-02-17T04:50:36.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj984 testdata.897552 2026-02-17T04:50:36.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj985 testdata.897552 2026-02-17T04:50:36.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj986 testdata.897552 2026-02-17T04:50:36.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj987 testdata.897552 2026-02-17T04:50:36.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj988 testdata.897552 2026-02-17T04:50:36.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj989 testdata.897552 2026-02-17T04:50:36.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj990 testdata.897552 2026-02-17T04:50:36.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj991 testdata.897552 2026-02-17T04:50:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj992 testdata.897552 2026-02-17T04:50:36.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj993 testdata.897552 2026-02-17T04:50:36.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj994 testdata.897552 2026-02-17T04:50:36.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj995 testdata.897552 2026-02-17T04:50:36.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj996 testdata.897552 2026-02-17T04:50:36.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj997 testdata.897552 2026-02-17T04:50:36.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj998 testdata.897552 2026-02-17T04:50:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj999 testdata.897552 2026-02-17T04:50:36.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T04:50:36.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1000 testdata.897552 2026-02-17T04:50:36.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:334: _scrub_abort: rm -f testdata.897552 2026-02-17T04:50:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: get_primary test obj1 2026-02-17T04:50:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:50:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:50:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:50:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:50:37.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: local primary=1 2026-02-17T04:50:37.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:337: _scrub_abort: local pgid=1.0 2026-02-17T04:50:37.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:339: _scrub_abort: ceph tell 1.0 schedule-deep-scrub 2026-02-17T04:50:37.066 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:50:37.066 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:50:37.066 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:50:37.066 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-06T00:02:27.065656+0000" 2026-02-17T04:50:37.067 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:50:37.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:342: _scrub_abort: set -o pipefail 2026-02-17T04:50:37.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:343: _scrub_abort: found=no 2026-02-17T04:50:37.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: seq 0 200 2026-02-17T04:50:37.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:37.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-17T04:50:37.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:37.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:37.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:37.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-17T04:50:37.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-17T04:50:37.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T04:50:37.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:37.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:37.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705688 2026-02-17T04:50:37.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705688 2026-02-17T04:50:37.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688' 2026-02-17T04:50:37.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:37.350 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:37.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574869 2026-02-17T04:50:37.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574869 2026-02-17T04:50:37.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688 2-55834574869' 2026-02-17T04:50:37.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836506 2026-02-17T04:50:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:37.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:37.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-17T04:50:37.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:37.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-17T04:50:37.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T04:50:37.411 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836506 2026-02-17T04:50:37.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:37.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836506 2026-02-17T04:50:37.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:38.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:38.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:38.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-17T04:50:38.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:38.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705688 2026-02-17T04:50:38.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:38.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:38.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705688 2026-02-17T04:50:38.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:38.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705688 2026-02-17T04:50:38.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705688' 2026-02-17T04:50:38.751 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705688 2026-02-17T04:50:38.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:38.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705688 -lt 38654705688 2026-02-17T04:50:38.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:38.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574869 2026-02-17T04:50:38.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:38.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:38.917 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574869 2026-02-17T04:50:38.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:38.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574869 2026-02-17T04:50:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574869' 2026-02-17T04:50:38.919 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574869 2026-02-17T04:50:38.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:39.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574870 -lt 55834574869 2026-02-17T04:50:39.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:39.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-17T04:50:39.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:39.238 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-17T04:50:39.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:39.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:39.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:39.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836509 2026-02-17T04:50:39.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836509 2026-02-17T04:50:39.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509' 2026-02-17T04:50:39.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:39.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:39.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-17T04:50:39.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-17T04:50:39.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-38654705691' 2026-02-17T04:50:39.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:39.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:39.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574873 2026-02-17T04:50:39.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574873 2026-02-17T04:50:39.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-38654705691 2-55834574873' 2026-02-17T04:50:39.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:39.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836509 2026-02-17T04:50:39.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:39.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:39.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836509 2026-02-17T04:50:39.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:39.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836509 2026-02-17T04:50:39.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-17T04:50:39.590 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836509 2026-02-17T04:50:39.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:39.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836509 2026-02-17T04:50:39.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:40.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:40.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836509 2026-02-17T04:50:40.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:40.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705691 2026-02-17T04:50:40.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:40.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:40.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-17T04:50:40.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:40.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705691 2026-02-17T04:50:40.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-17T04:50:40.930 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705691 2026-02-17T04:50:40.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:41.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-17T04:50:41.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:41.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574873 2026-02-17T04:50:41.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:41.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:41.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574873 2026-02-17T04:50:41.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:41.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574873 2026-02-17T04:50:41.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574873' 2026-02-17T04:50:41.107 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574873 2026-02-17T04:50:41.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:41.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574873 -lt 55834574873 2026-02-17T04:50:41.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:41.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-17T04:50:41.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:41.428 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:349: _scrub_abort: found=yes 2026-02-17T04:50:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:351: _scrub_abort: break 2026-02-17T04:50:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:354: _scrub_abort: set +o pipefail 2026-02-17T04:50:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:356: _scrub_abort: test yes = no 2026-02-17T04:50:41.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:362: _scrub_abort: ceph osd set nodeep-scrub 2026-02-17T04:50:41.646 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T04:50:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:363: _scrub_abort: '[' deep-scrub = deep-scrub ']' 2026-02-17T04:50:41.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:365: _scrub_abort: ceph osd set noscrub 2026-02-17T04:50:41.852 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:50:41.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:369: _scrub_abort: set -o pipefail 2026-02-17T04:50:41.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: seq 0 200 2026-02-17T04:50:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:41.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:41.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:41.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:42.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:42.025 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:42.025 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:42.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:42.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:42.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:42.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836512 2026-02-17T04:50:42.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836512 2026-02-17T04:50:42.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512' 2026-02-17T04:50:42.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:42.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-17T04:50:42.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-17T04:50:42.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694' 2026-02-17T04:50:42.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:42.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:42.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574876 2026-02-17T04:50:42.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574876 2026-02-17T04:50:42.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-38654705694 2-55834574876' 2026-02-17T04:50:42.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:42.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836512 2026-02-17T04:50:42.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:42.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:42.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836512 2026-02-17T04:50:42.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:42.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836512 2026-02-17T04:50:42.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836512' 2026-02-17T04:50:42.203 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836512 2026-02-17T04:50:42.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:42.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836512 2026-02-17T04:50:42.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:43.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:43.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:43.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836512 2026-02-17T04:50:43.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:44.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:50:44.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:44.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836512 2026-02-17T04:50:44.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:44.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-17T04:50:44.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:44.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:44.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-17T04:50:44.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:44.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-17T04:50:44.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-17T04:50:44.703 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705694 2026-02-17T04:50:44.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:44.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705696 -lt 38654705694 2026-02-17T04:50:44.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:44.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574876 2026-02-17T04:50:44.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:44.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:44.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574876 2026-02-17T04:50:44.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:44.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574876 2026-02-17T04:50:44.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574876' 2026-02-17T04:50:44.870 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574876 2026-02-17T04:50:44.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:45.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574878 -lt 55834574876 2026-02-17T04:50:45.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:45.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:45.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:45.192 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:45.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:45.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:45.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:45.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:45.201 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:45.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:45.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-17T04:50:45.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-17T04:50:45.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517' 2026-02-17T04:50:45.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:45.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:45.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705699 2026-02-17T04:50:45.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705699 2026-02-17T04:50:45.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-38654705699' 2026-02-17T04:50:45.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:45.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574881 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574881 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-38654705699 2-55834574881' 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836517 2026-02-17T04:50:45.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:45.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:45.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-17T04:50:45.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:45.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836517 2026-02-17T04:50:45.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-17T04:50:45.549 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836517 2026-02-17T04:50:45.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:45.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836517 2026-02-17T04:50:45.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:46.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:46.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:46.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836517 -lt 21474836517 2026-02-17T04:50:46.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:46.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705699 2026-02-17T04:50:46.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:46.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:46.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705699 2026-02-17T04:50:46.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705699 2026-02-17T04:50:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705699' 2026-02-17T04:50:46.887 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705699 2026-02-17T04:50:46.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705699 2026-02-17T04:50:47.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:47.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574881 2026-02-17T04:50:47.053 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:47.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:47.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574881 2026-02-17T04:50:47.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:47.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574881 2026-02-17T04:50:47.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-17T04:50:47.056 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574881 2026-02-17T04:50:47.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:47.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574881 -lt 55834574881 2026-02-17T04:50:47.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:47.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:47.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:47.376 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:47.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:47.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:47.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:47.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:47.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:47.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836520 2026-02-17T04:50:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836520 2026-02-17T04:50:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520' 2026-02-17T04:50:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:47.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:47.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705702 2026-02-17T04:50:47.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705702 2026-02-17T04:50:47.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520 1-38654705702' 2026-02-17T04:50:47.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:47.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:47.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574884 2026-02-17T04:50:47.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574884 2026-02-17T04:50:47.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520 1-38654705702 2-55834574884' 2026-02-17T04:50:47.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:47.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836520 2026-02-17T04:50:47.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:47.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:47.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836520 2026-02-17T04:50:47.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:47.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836520 2026-02-17T04:50:47.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2026-02-17T04:50:47.726 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836520 2026-02-17T04:50:47.726 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:47.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836517 -lt 21474836520 2026-02-17T04:50:47.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:48.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:48.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:49.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836520 -lt 21474836520 2026-02-17T04:50:49.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:49.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705702 2026-02-17T04:50:49.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:49.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:49.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705702 2026-02-17T04:50:49.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:49.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705702 2026-02-17T04:50:49.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705702' 2026-02-17T04:50:49.070 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705702 2026-02-17T04:50:49.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:49.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705702 -lt 38654705702 2026-02-17T04:50:49.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:49.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574884 2026-02-17T04:50:49.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:49.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:49.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574884 2026-02-17T04:50:49.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:49.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574884 2026-02-17T04:50:49.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574884' 2026-02-17T04:50:49.239 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574884 2026-02-17T04:50:49.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:49.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574884 -lt 55834574884 2026-02-17T04:50:49.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:49.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:49.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:49.563 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:49.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:49.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:49.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:49.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:49.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:49.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:49.736 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:49.736 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:49.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:49.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:49.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:49.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836523 2026-02-17T04:50:49.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836523 2026-02-17T04:50:49.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836523' 2026-02-17T04:50:49.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:49.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:49.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705705 2026-02-17T04:50:49.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705705 2026-02-17T04:50:49.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836523 1-38654705705' 2026-02-17T04:50:49.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:49.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574887 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574887 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836523 1-38654705705 2-55834574887' 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836523 2026-02-17T04:50:49.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:49.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:49.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836523 2026-02-17T04:50:49.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:49.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836523 2026-02-17T04:50:49.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836523' 2026-02-17T04:50:49.914 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836523 2026-02-17T04:50:49.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:50.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836520 -lt 21474836523 2026-02-17T04:50:50.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:51.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:51.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:51.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836523 -lt 21474836523 2026-02-17T04:50:51.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:51.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705705 2026-02-17T04:50:51.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:51.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:51.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705705 2026-02-17T04:50:51.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:51.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705705 2026-02-17T04:50:51.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705705' 2026-02-17T04:50:51.252 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705705 2026-02-17T04:50:51.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:51.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705705 -lt 38654705705 2026-02-17T04:50:51.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:51.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574887 2026-02-17T04:50:51.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:51.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:51.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574887 2026-02-17T04:50:51.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:51.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574887 2026-02-17T04:50:51.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574887' 2026-02-17T04:50:51.421 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574887 2026-02-17T04:50:51.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:51.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574887 -lt 55834574887 2026-02-17T04:50:51.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:51.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:51.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:51.742 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:51.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:51.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:51.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:51.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:51.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:51.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:51.918 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:51.918 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:51.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:51.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:51.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:51.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836526 2026-02-17T04:50:51.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836526 2026-02-17T04:50:51.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836526' 2026-02-17T04:50:51.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:51.975 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705708 2026-02-17T04:50:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705708 2026-02-17T04:50:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836526 1-38654705708' 2026-02-17T04:50:52.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:52.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574890 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574890 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836526 1-38654705708 2-55834574890' 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836526 2026-02-17T04:50:52.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:52.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:52.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836526 2026-02-17T04:50:52.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:52.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836526 2026-02-17T04:50:52.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2026-02-17T04:50:52.097 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836526 2026-02-17T04:50:52.097 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:52.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836526 -lt 21474836526 2026-02-17T04:50:52.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:52.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705708 2026-02-17T04:50:52.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:52.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:52.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705708 2026-02-17T04:50:52.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:52.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705708 2026-02-17T04:50:52.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705708' 2026-02-17T04:50:52.268 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705708 2026-02-17T04:50:52.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:52.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705708 -lt 38654705708 2026-02-17T04:50:52.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:52.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574890 2026-02-17T04:50:52.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:52.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:52.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574890 2026-02-17T04:50:52.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:52.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574890 2026-02-17T04:50:52.433 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574890 2026-02-17T04:50:52.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574890' 2026-02-17T04:50:52.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:52.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574889 -lt 55834574890 2026-02-17T04:50:52.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:53.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:53.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:53.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574889 -lt 55834574890 2026-02-17T04:50:53.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:54.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:50:54.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:54.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574892 -lt 55834574890 2026-02-17T04:50:54.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:55.102 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:55.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:55.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:55.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:55.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:55.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:55.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:55.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836531 2026-02-17T04:50:55.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836531 2026-02-17T04:50:55.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531' 2026-02-17T04:50:55.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:55.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:55.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705713 2026-02-17T04:50:55.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705713 2026-02-17T04:50:55.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531 1-38654705713' 2026-02-17T04:50:55.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:55.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:55.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574895 2026-02-17T04:50:55.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574895 2026-02-17T04:50:55.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574895' 2026-02-17T04:50:55.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:55.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836531 2026-02-17T04:50:55.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:55.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:55.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836531 2026-02-17T04:50:55.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:55.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836531 2026-02-17T04:50:55.454 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836531 2026-02-17T04:50:55.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2026-02-17T04:50:55.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:55.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836528 -lt 21474836531 2026-02-17T04:50:55.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:56.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:56.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:56.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836531 -lt 21474836531 2026-02-17T04:50:56.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:56.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705713 2026-02-17T04:50:56.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:56.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:56.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705713 2026-02-17T04:50:56.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:56.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705713 2026-02-17T04:50:56.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705713' 2026-02-17T04:50:56.793 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705713 2026-02-17T04:50:56.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:56.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705713 -lt 38654705713 2026-02-17T04:50:56.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:56.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574895 2026-02-17T04:50:56.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:56.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:56.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574895 2026-02-17T04:50:56.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:56.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574895 2026-02-17T04:50:56.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574895' 2026-02-17T04:50:56.963 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574895 2026-02-17T04:50:56.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:57.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574895 -lt 55834574895 2026-02-17T04:50:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:57.278 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:57.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:57.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:57.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:57.449 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:57.450 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:57.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:57.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:57.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:57.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836534 2026-02-17T04:50:57.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836534 2026-02-17T04:50:57.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836534' 2026-02-17T04:50:57.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:57.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:57.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705716 2026-02-17T04:50:57.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705716 2026-02-17T04:50:57.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836534 1-38654705716' 2026-02-17T04:50:57.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:57.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:57.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574898 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574898 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836534 1-38654705716 2-55834574898' 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836534 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:57.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:57.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836534 2026-02-17T04:50:57.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:57.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836534 2026-02-17T04:50:57.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836534' 2026-02-17T04:50:57.628 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836534 2026-02-17T04:50:57.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:57.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836531 -lt 21474836534 2026-02-17T04:50:57.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:50:58.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:50:58.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836534 -lt 21474836534 2026-02-17T04:50:58.961 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:58.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705716 2026-02-17T04:50:58.962 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:58.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:50:58.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705716 2026-02-17T04:50:58.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:58.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705716 2026-02-17T04:50:58.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705716' 2026-02-17T04:50:58.964 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705716 2026-02-17T04:50:58.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:50:59.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705716 -lt 38654705716 2026-02-17T04:50:59.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:59.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574898 2026-02-17T04:50:59.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:59.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:50:59.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574898 2026-02-17T04:50:59.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:59.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574898 2026-02-17T04:50:59.134 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574898 2026-02-17T04:50:59.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574898' 2026-02-17T04:50:59.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:50:59.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574898 -lt 55834574898 2026-02-17T04:50:59.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:50:59.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:50:59.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:50:59.453 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:50:59.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:50:59.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:50:59.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:50:59.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:50:59.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:50:59.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:50:59.628 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:50:59.628 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:50:59.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:50:59.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:59.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:50:59.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836537 2026-02-17T04:50:59.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836537 2026-02-17T04:50:59.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836537' 2026-02-17T04:50:59.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:59.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:50:59.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705719 2026-02-17T04:50:59.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705719 2026-02-17T04:50:59.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836537 1-38654705719' 2026-02-17T04:50:59.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:50:59.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:50:59.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574901 2026-02-17T04:50:59.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574901 2026-02-17T04:50:59.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836537 1-38654705719 2-55834574901' 2026-02-17T04:50:59.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:50:59.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836537 2026-02-17T04:50:59.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:50:59.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:50:59.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836537 2026-02-17T04:50:59.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:50:59.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836537 2026-02-17T04:50:59.806 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836537 2026-02-17T04:50:59.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2026-02-17T04:50:59.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:50:59.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836534 -lt 21474836537 2026-02-17T04:50:59.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:00.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:00.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:01.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836537 -lt 21474836537 2026-02-17T04:51:01.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:01.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705719 2026-02-17T04:51:01.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:01.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:01.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705719 2026-02-17T04:51:01.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:01.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705719 2026-02-17T04:51:01.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705719' 2026-02-17T04:51:01.141 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705719 2026-02-17T04:51:01.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:01.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705719 -lt 38654705719 2026-02-17T04:51:01.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:01.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574901 2026-02-17T04:51:01.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:01.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:01.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574901 2026-02-17T04:51:01.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:01.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574901 2026-02-17T04:51:01.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574901' 2026-02-17T04:51:01.313 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574901 2026-02-17T04:51:01.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:01.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574901 -lt 55834574901 2026-02-17T04:51:01.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:01.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:01.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:01.637 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:01.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:01.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:01.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:01.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:01.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:01.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:01.819 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:01.819 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:01.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:01.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:01.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:01.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836540 2026-02-17T04:51:01.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836540 2026-02-17T04:51:01.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836540' 2026-02-17T04:51:01.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:01.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:01.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705722 2026-02-17T04:51:01.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705722 2026-02-17T04:51:01.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836540 1-38654705722' 2026-02-17T04:51:01.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:01.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:01.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574904 2026-02-17T04:51:01.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574904 2026-02-17T04:51:01.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836540 1-38654705722 2-55834574904' 2026-02-17T04:51:01.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:01.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836540 2026-02-17T04:51:01.993 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:01.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:01.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836540 2026-02-17T04:51:01.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:01.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836540 2026-02-17T04:51:01.996 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836540 2026-02-17T04:51:01.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836540' 2026-02-17T04:51:01.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:02.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836540 -lt 21474836540 2026-02-17T04:51:02.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:02.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705722 2026-02-17T04:51:02.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:02.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:02.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705722 2026-02-17T04:51:02.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:02.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705722 2026-02-17T04:51:02.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705722' 2026-02-17T04:51:02.164 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705722 2026-02-17T04:51:02.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:02.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705722 -lt 38654705722 2026-02-17T04:51:02.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:02.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574904 2026-02-17T04:51:02.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:02.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:02.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574904 2026-02-17T04:51:02.335 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:02.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574904 2026-02-17T04:51:02.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574904' 2026-02-17T04:51:02.336 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574904 2026-02-17T04:51:02.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:02.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574904 -lt 55834574904 2026-02-17T04:51:02.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:02.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:02.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:02.658 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:02.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:02.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:02.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:02.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:02.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:02.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:02.832 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:02.832 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:02.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:02.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:02.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836542 2026-02-17T04:51:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836542 2026-02-17T04:51:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542' 2026-02-17T04:51:02.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:02.890 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705724 2026-02-17T04:51:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705724 2026-02-17T04:51:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542 1-38654705724' 2026-02-17T04:51:02.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:02.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574906 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574906 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542 1-38654705724 2-55834574906' 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836542 2026-02-17T04:51:03.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:03.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:03.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836542 2026-02-17T04:51:03.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:03.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836542 2026-02-17T04:51:03.008 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836542 2026-02-17T04:51:03.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836542' 2026-02-17T04:51:03.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:03.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836540 -lt 21474836542 2026-02-17T04:51:03.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:04.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:04.173 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836543 -lt 21474836542 2026-02-17T04:51:04.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:04.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705724 2026-02-17T04:51:04.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:04.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:04.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705724 2026-02-17T04:51:04.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:04.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705724 2026-02-17T04:51:04.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705724' 2026-02-17T04:51:04.346 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705724 2026-02-17T04:51:04.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705725 -lt 38654705724 2026-02-17T04:51:04.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:04.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574906 2026-02-17T04:51:04.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:04.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:04.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574906 2026-02-17T04:51:04.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:04.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574906 2026-02-17T04:51:04.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574906' 2026-02-17T04:51:04.513 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574906 2026-02-17T04:51:04.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:04.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574907 -lt 55834574906 2026-02-17T04:51:04.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:04.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:04.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:04.838 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:04.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:04.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:04.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:04.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:04.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:05.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836545 2026-02-17T04:51:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836545 2026-02-17T04:51:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545' 2026-02-17T04:51:05.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:05.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:05.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705727 2026-02-17T04:51:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705727 2026-02-17T04:51:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545 1-38654705727' 2026-02-17T04:51:05.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:05.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:05.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574909 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574909 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545 1-38654705727 2-55834574909' 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836545 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:05.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:05.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836545 2026-02-17T04:51:05.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:05.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836545 2026-02-17T04:51:05.189 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836545 2026-02-17T04:51:05.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836545' 2026-02-17T04:51:05.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:05.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836543 -lt 21474836545 2026-02-17T04:51:05.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:06.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:06.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:06.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836546 -lt 21474836545 2026-02-17T04:51:06.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:06.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705727 2026-02-17T04:51:06.524 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:06.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:06.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705727 2026-02-17T04:51:06.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:06.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705727 2026-02-17T04:51:06.527 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705727 2026-02-17T04:51:06.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705727' 2026-02-17T04:51:06.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:06.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705728 -lt 38654705727 2026-02-17T04:51:06.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:06.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574909 2026-02-17T04:51:06.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:06.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:06.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574909 2026-02-17T04:51:06.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574909 2026-02-17T04:51:06.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574909' 2026-02-17T04:51:06.694 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574909 2026-02-17T04:51:06.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:06.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574910 -lt 55834574909 2026-02-17T04:51:06.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:06.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:06.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:07.016 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:07.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:07.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:07.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:07.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:07.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:07.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836549 2026-02-17T04:51:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836549 2026-02-17T04:51:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549' 2026-02-17T04:51:07.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:07.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:07.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705731 2026-02-17T04:51:07.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705731 2026-02-17T04:51:07.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549 1-38654705731' 2026-02-17T04:51:07.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:07.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:07.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574912 2026-02-17T04:51:07.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574912 2026-02-17T04:51:07.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549 1-38654705731 2-55834574912' 2026-02-17T04:51:07.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:07.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836549 2026-02-17T04:51:07.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:07.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:07.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836549 2026-02-17T04:51:07.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:07.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836549 2026-02-17T04:51:07.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836549' 2026-02-17T04:51:07.372 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836549 2026-02-17T04:51:07.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:07.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836546 -lt 21474836549 2026-02-17T04:51:07.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:08.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:08.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:08.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836549 -lt 21474836549 2026-02-17T04:51:08.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:08.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705731 2026-02-17T04:51:08.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:08.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:08.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705731 2026-02-17T04:51:08.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:08.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705731 2026-02-17T04:51:08.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705731' 2026-02-17T04:51:08.714 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705731 2026-02-17T04:51:08.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:08.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705731 -lt 38654705731 2026-02-17T04:51:08.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:08.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574912 2026-02-17T04:51:08.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:08.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:08.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574912 2026-02-17T04:51:08.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:08.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574912 2026-02-17T04:51:08.879 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574912 2026-02-17T04:51:08.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574912' 2026-02-17T04:51:08.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574913 -lt 55834574912 2026-02-17T04:51:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:09.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:09.202 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:09.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:09.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:09.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:09.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:09.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:09.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:09.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836552 2026-02-17T04:51:09.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836552 2026-02-17T04:51:09.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552' 2026-02-17T04:51:09.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:09.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:09.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705734 2026-02-17T04:51:09.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705734 2026-02-17T04:51:09.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552 1-38654705734' 2026-02-17T04:51:09.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:09.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574916 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574916 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552 1-38654705734 2-55834574916' 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836552 2026-02-17T04:51:09.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:09.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:09.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836552 2026-02-17T04:51:09.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:09.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836552 2026-02-17T04:51:09.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836552' 2026-02-17T04:51:09.555 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836552 2026-02-17T04:51:09.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:09.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836549 -lt 21474836552 2026-02-17T04:51:09.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:10.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:10.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:10.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836552 -lt 21474836552 2026-02-17T04:51:10.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:10.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705734 2026-02-17T04:51:10.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:10.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:10.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705734 2026-02-17T04:51:10.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:10.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705734 2026-02-17T04:51:10.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705734' 2026-02-17T04:51:10.901 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705734 2026-02-17T04:51:10.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:11.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705734 -lt 38654705734 2026-02-17T04:51:11.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574916 2026-02-17T04:51:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:11.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:11.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574916 2026-02-17T04:51:11.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:11.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574916 2026-02-17T04:51:11.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574916' 2026-02-17T04:51:11.068 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574916 2026-02-17T04:51:11.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:11.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574916 -lt 55834574916 2026-02-17T04:51:11.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:11.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:11.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:11.391 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:11.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:11.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:11.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:11.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:11.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:11.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:11.564 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:11.564 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:11.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:11.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:11.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:11.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836555 2026-02-17T04:51:11.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836555 2026-02-17T04:51:11.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836555' 2026-02-17T04:51:11.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:11.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:11.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705737 2026-02-17T04:51:11.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705737 2026-02-17T04:51:11.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836555 1-38654705737' 2026-02-17T04:51:11.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:11.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:11.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574919 2026-02-17T04:51:11.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574919 2026-02-17T04:51:11.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836555 1-38654705737 2-55834574919' 2026-02-17T04:51:11.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:11.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836555 2026-02-17T04:51:11.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:11.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:11.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836555 2026-02-17T04:51:11.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836555 2026-02-17T04:51:11.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836555' 2026-02-17T04:51:11.740 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836555 2026-02-17T04:51:11.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:11.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836552 -lt 21474836555 2026-02-17T04:51:11.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:12.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:12.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:13.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836555 -lt 21474836555 2026-02-17T04:51:13.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:13.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705737 2026-02-17T04:51:13.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:13.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:13.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705737 2026-02-17T04:51:13.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:13.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705737 2026-02-17T04:51:13.076 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705737 2026-02-17T04:51:13.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705737' 2026-02-17T04:51:13.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:13.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705737 -lt 38654705737 2026-02-17T04:51:13.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:13.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574919 2026-02-17T04:51:13.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:13.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:13.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574919 2026-02-17T04:51:13.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574919 2026-02-17T04:51:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574919' 2026-02-17T04:51:13.244 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574919 2026-02-17T04:51:13.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574919 -lt 55834574919 2026-02-17T04:51:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:13.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:13.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:13.565 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:13.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:13.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:13.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:13.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836558 2026-02-17T04:51:13.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836558 2026-02-17T04:51:13.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558' 2026-02-17T04:51:13.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:13.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:13.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705740 2026-02-17T04:51:13.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705740 2026-02-17T04:51:13.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558 1-38654705740' 2026-02-17T04:51:13.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:13.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:13.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574922 2026-02-17T04:51:13.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574922 2026-02-17T04:51:13.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558 1-38654705740 2-55834574922' 2026-02-17T04:51:13.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:13.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836558 2026-02-17T04:51:13.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:13.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:13.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836558 2026-02-17T04:51:13.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:13.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836558 2026-02-17T04:51:13.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836558' 2026-02-17T04:51:13.915 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836558 2026-02-17T04:51:13.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:14.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836555 -lt 21474836558 2026-02-17T04:51:14.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:15.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:15.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:15.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836558 -lt 21474836558 2026-02-17T04:51:15.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:15.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705740 2026-02-17T04:51:15.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:15.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:15.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705740 2026-02-17T04:51:15.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:15.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705740 2026-02-17T04:51:15.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705740' 2026-02-17T04:51:15.254 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705740 2026-02-17T04:51:15.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:15.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705740 -lt 38654705740 2026-02-17T04:51:15.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:15.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574922 2026-02-17T04:51:15.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:15.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:15.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574922 2026-02-17T04:51:15.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:15.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574922 2026-02-17T04:51:15.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574922' 2026-02-17T04:51:15.424 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574922 2026-02-17T04:51:15.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:15.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574922 -lt 55834574922 2026-02-17T04:51:15.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:15.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:15.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:15.746 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:15.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:15.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:15.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:15.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836561 2026-02-17T04:51:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836561 2026-02-17T04:51:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561' 2026-02-17T04:51:15.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:15.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:16.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705743 2026-02-17T04:51:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705743 2026-02-17T04:51:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561 1-38654705743' 2026-02-17T04:51:16.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:16.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:16.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574925 2026-02-17T04:51:16.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574925 2026-02-17T04:51:16.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561 1-38654705743 2-55834574925' 2026-02-17T04:51:16.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:16.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836561 2026-02-17T04:51:16.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:16.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:16.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836561 2026-02-17T04:51:16.096 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:16.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836561 2026-02-17T04:51:16.097 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836561 2026-02-17T04:51:16.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836561' 2026-02-17T04:51:16.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:16.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836561 -lt 21474836561 2026-02-17T04:51:16.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:16.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705743 2026-02-17T04:51:16.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:16.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:16.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705743 2026-02-17T04:51:16.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705743 2026-02-17T04:51:16.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705743' 2026-02-17T04:51:16.264 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705743 2026-02-17T04:51:16.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:16.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705743 -lt 38654705743 2026-02-17T04:51:16.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:16.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574925 2026-02-17T04:51:16.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:16.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:16.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:16.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574925 2026-02-17T04:51:16.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574925 2026-02-17T04:51:16.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574925' 2026-02-17T04:51:16.432 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574925 2026-02-17T04:51:16.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574924 -lt 55834574925 2026-02-17T04:51:16.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:17.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:17.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:17.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574924 -lt 55834574925 2026-02-17T04:51:17.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:18.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:51:18.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574927 -lt 55834574925 2026-02-17T04:51:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:18.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:18.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:19.084 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:19.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:19.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:19.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:19.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:19.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:19.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:19.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836566 2026-02-17T04:51:19.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836566 2026-02-17T04:51:19.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836566' 2026-02-17T04:51:19.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:19.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:19.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705748 2026-02-17T04:51:19.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705748 2026-02-17T04:51:19.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836566 1-38654705748' 2026-02-17T04:51:19.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:19.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:19.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574929 2026-02-17T04:51:19.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574929 2026-02-17T04:51:19.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836566 1-38654705748 2-55834574929' 2026-02-17T04:51:19.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:19.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836566 2026-02-17T04:51:19.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:19.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:19.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836566 2026-02-17T04:51:19.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:19.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836566 2026-02-17T04:51:19.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836566' 2026-02-17T04:51:19.435 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836566 2026-02-17T04:51:19.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:19.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836563 -lt 21474836566 2026-02-17T04:51:19.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:20.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:20.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:20.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836566 -lt 21474836566 2026-02-17T04:51:20.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:20.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705748 2026-02-17T04:51:20.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:20.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:20.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705748 2026-02-17T04:51:20.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:20.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705748 2026-02-17T04:51:20.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705748' 2026-02-17T04:51:20.768 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705748 2026-02-17T04:51:20.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:20.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705748 -lt 38654705748 2026-02-17T04:51:20.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:20.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574929 2026-02-17T04:51:20.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:20.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:20.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574929 2026-02-17T04:51:20.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:20.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574929 2026-02-17T04:51:20.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574929' 2026-02-17T04:51:20.937 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574929 2026-02-17T04:51:20.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:21.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574930 -lt 55834574929 2026-02-17T04:51:21.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:21.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:21.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:21.270 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:21.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:21.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:21.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:21.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:21.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:21.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836569 2026-02-17T04:51:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836569 2026-02-17T04:51:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836569' 2026-02-17T04:51:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:21.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:21.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705751 2026-02-17T04:51:21.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705751 2026-02-17T04:51:21.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836569 1-38654705751' 2026-02-17T04:51:21.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:21.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574933 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574933 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836569 1-38654705751 2-55834574933' 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836569 2026-02-17T04:51:21.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:21.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:21.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836569 2026-02-17T04:51:21.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:21.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836569 2026-02-17T04:51:21.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836569' 2026-02-17T04:51:21.617 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836569 2026-02-17T04:51:21.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836566 -lt 21474836569 2026-02-17T04:51:21.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:22.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:22.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836569 -lt 21474836569 2026-02-17T04:51:22.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:22.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705751 2026-02-17T04:51:22.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:22.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:22.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705751 2026-02-17T04:51:22.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:22.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705751 2026-02-17T04:51:22.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705751' 2026-02-17T04:51:22.950 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705751 2026-02-17T04:51:22.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:23.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705751 -lt 38654705751 2026-02-17T04:51:23.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:23.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574933 2026-02-17T04:51:23.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:23.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:23.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574933 2026-02-17T04:51:23.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574933 2026-02-17T04:51:23.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574933' 2026-02-17T04:51:23.119 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574933 2026-02-17T04:51:23.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:23.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574933 -lt 55834574933 2026-02-17T04:51:23.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:23.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:23.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:23.444 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:23.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:23.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:23.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:23.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:23.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:23.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:23.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836572 2026-02-17T04:51:23.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836572 2026-02-17T04:51:23.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836572' 2026-02-17T04:51:23.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:23.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:23.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705754 2026-02-17T04:51:23.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705754 2026-02-17T04:51:23.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836572 1-38654705754' 2026-02-17T04:51:23.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:23.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:23.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574936 2026-02-17T04:51:23.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574936 2026-02-17T04:51:23.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836572 1-38654705754 2-55834574936' 2026-02-17T04:51:23.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:23.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836572 2026-02-17T04:51:23.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:23.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:23.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836572 2026-02-17T04:51:23.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:23.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836572 2026-02-17T04:51:23.799 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836572' 2026-02-17T04:51:23.799 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836572 2026-02-17T04:51:23.800 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:23.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836569 -lt 21474836572 2026-02-17T04:51:23.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:24.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:24.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:25.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836572 -lt 21474836572 2026-02-17T04:51:25.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:25.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705754 2026-02-17T04:51:25.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:25.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:25.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705754 2026-02-17T04:51:25.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:25.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705754 2026-02-17T04:51:25.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705754' 2026-02-17T04:51:25.141 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705754 2026-02-17T04:51:25.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:25.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705754 -lt 38654705754 2026-02-17T04:51:25.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:25.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574936 2026-02-17T04:51:25.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:25.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:25.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574936 2026-02-17T04:51:25.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:25.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574936 2026-02-17T04:51:25.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574936' 2026-02-17T04:51:25.310 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574936 2026-02-17T04:51:25.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:25.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574936 -lt 55834574936 2026-02-17T04:51:25.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:25.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:25.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:25.635 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:25.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:25.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:25.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:25.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:25.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:25.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:25.809 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:25.809 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:25.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:25.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:25.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836575 2026-02-17T04:51:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836575 2026-02-17T04:51:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836575' 2026-02-17T04:51:25.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:25.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:25.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705757 2026-02-17T04:51:25.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705757 2026-02-17T04:51:25.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836575 1-38654705757' 2026-02-17T04:51:25.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:25.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:25.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574939 2026-02-17T04:51:25.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574939 2026-02-17T04:51:25.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836575 1-38654705757 2-55834574939' 2026-02-17T04:51:25.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:25.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836575 2026-02-17T04:51:25.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:25.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:25.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836575 2026-02-17T04:51:25.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:25.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836575 2026-02-17T04:51:25.990 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836575 2026-02-17T04:51:25.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836575' 2026-02-17T04:51:25.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:26.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836575 -lt 21474836575 2026-02-17T04:51:26.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:26.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705757 2026-02-17T04:51:26.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:26.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:26.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705757 2026-02-17T04:51:26.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:26.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705757 2026-02-17T04:51:26.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705757' 2026-02-17T04:51:26.159 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705757 2026-02-17T04:51:26.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:26.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705757 -lt 38654705757 2026-02-17T04:51:26.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:26.323 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574939 2026-02-17T04:51:26.324 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:26.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:26.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574939 2026-02-17T04:51:26.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:26.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574939 2026-02-17T04:51:26.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574939' 2026-02-17T04:51:26.327 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574939 2026-02-17T04:51:26.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574939 -lt 55834574939 2026-02-17T04:51:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:26.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:26.648 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:26.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:26.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:26.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:26.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:26.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:26.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:26.818 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:26.819 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:26.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:26.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:26.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:26.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836577 2026-02-17T04:51:26.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836577 2026-02-17T04:51:26.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836577' 2026-02-17T04:51:26.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:26.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705759 2026-02-17T04:51:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705759 2026-02-17T04:51:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836577 1-38654705759' 2026-02-17T04:51:26.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:26.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:26.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574941 2026-02-17T04:51:26.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574941 2026-02-17T04:51:26.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836577 1-38654705759 2-55834574941' 2026-02-17T04:51:26.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:26.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836577 2026-02-17T04:51:26.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:26.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:26.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836577 2026-02-17T04:51:26.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:26.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836577 2026-02-17T04:51:26.998 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836577 2026-02-17T04:51:26.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836577' 2026-02-17T04:51:26.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:27.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836575 -lt 21474836577 2026-02-17T04:51:27.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:28.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:28.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:28.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836578 -lt 21474836577 2026-02-17T04:51:28.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:28.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705759 2026-02-17T04:51:28.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:28.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:28.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705759 2026-02-17T04:51:28.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:28.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705759 2026-02-17T04:51:28.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705759' 2026-02-17T04:51:28.334 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705759 2026-02-17T04:51:28.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705760 -lt 38654705759 2026-02-17T04:51:28.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:28.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574941 2026-02-17T04:51:28.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:28.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:28.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574941 2026-02-17T04:51:28.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574941 2026-02-17T04:51:28.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574941' 2026-02-17T04:51:28.504 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574941 2026-02-17T04:51:28.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:28.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574942 -lt 55834574941 2026-02-17T04:51:28.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:28.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:28.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:28.825 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:28.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:28.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:28.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:28.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:28.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:28.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:28.995 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:28.995 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:28.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:28.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:28.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:29.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836580 2026-02-17T04:51:29.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836580 2026-02-17T04:51:29.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580' 2026-02-17T04:51:29.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:29.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:29.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705762 2026-02-17T04:51:29.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705762 2026-02-17T04:51:29.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580 1-38654705762' 2026-02-17T04:51:29.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:29.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:29.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574944 2026-02-17T04:51:29.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574944 2026-02-17T04:51:29.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580 1-38654705762 2-55834574944' 2026-02-17T04:51:29.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:29.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836580 2026-02-17T04:51:29.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:29.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:29.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836580 2026-02-17T04:51:29.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:29.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836580 2026-02-17T04:51:29.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836580' 2026-02-17T04:51:29.177 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836580 2026-02-17T04:51:29.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:29.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836578 -lt 21474836580 2026-02-17T04:51:29.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:30.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:30.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:30.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836581 -lt 21474836580 2026-02-17T04:51:30.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:30.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705762 2026-02-17T04:51:30.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:30.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:30.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705762 2026-02-17T04:51:30.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:30.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705762 2026-02-17T04:51:30.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705762' 2026-02-17T04:51:30.510 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705762 2026-02-17T04:51:30.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:30.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705763 -lt 38654705762 2026-02-17T04:51:30.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:30.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574944 2026-02-17T04:51:30.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:30.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:30.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574944 2026-02-17T04:51:30.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:30.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574944 2026-02-17T04:51:30.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574944' 2026-02-17T04:51:30.681 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574944 2026-02-17T04:51:30.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:30.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574945 -lt 55834574944 2026-02-17T04:51:30.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:30.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:30.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:31.009 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:31.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:31.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:31.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:31.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:31.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836584 2026-02-17T04:51:31.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836584 2026-02-17T04:51:31.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584' 2026-02-17T04:51:31.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:31.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:31.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705766 2026-02-17T04:51:31.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705766 2026-02-17T04:51:31.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584 1-38654705766' 2026-02-17T04:51:31.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:31.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574947 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574947 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584 1-38654705766 2-55834574947' 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836584 2026-02-17T04:51:31.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:31.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:31.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836584 2026-02-17T04:51:31.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836584 2026-02-17T04:51:31.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836584' 2026-02-17T04:51:31.364 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836584 2026-02-17T04:51:31.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:31.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836581 -lt 21474836584 2026-02-17T04:51:31.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:32.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:32.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:32.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836584 -lt 21474836584 2026-02-17T04:51:32.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:32.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705766 2026-02-17T04:51:32.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:32.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:32.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705766 2026-02-17T04:51:32.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:32.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705766 2026-02-17T04:51:32.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705766' 2026-02-17T04:51:32.699 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705766 2026-02-17T04:51:32.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:32.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705766 -lt 38654705766 2026-02-17T04:51:32.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:32.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574947 2026-02-17T04:51:32.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:32.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:32.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574947 2026-02-17T04:51:32.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:32.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574947 2026-02-17T04:51:32.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574947' 2026-02-17T04:51:32.873 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574947 2026-02-17T04:51:32.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:33.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574948 -lt 55834574947 2026-02-17T04:51:33.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:33.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:33.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:33.194 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:33.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:33.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:33.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:33.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:33.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:33.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:33.368 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:33.368 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:33.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:33.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:33.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:33.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836587 2026-02-17T04:51:33.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836587 2026-02-17T04:51:33.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587' 2026-02-17T04:51:33.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:33.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:33.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705769 2026-02-17T04:51:33.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705769 2026-02-17T04:51:33.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587 1-38654705769' 2026-02-17T04:51:33.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:33.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574951 2026-02-17T04:51:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574951 2026-02-17T04:51:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587 1-38654705769 2-55834574951' 2026-02-17T04:51:33.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:33.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836587 2026-02-17T04:51:33.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:33.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:33.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836587 2026-02-17T04:51:33.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:33.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836587 2026-02-17T04:51:33.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836587' 2026-02-17T04:51:33.547 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836587 2026-02-17T04:51:33.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:33.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836584 -lt 21474836587 2026-02-17T04:51:33.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:34.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:34.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:34.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836587 -lt 21474836587 2026-02-17T04:51:34.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:34.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705769 2026-02-17T04:51:34.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:34.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:34.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705769 2026-02-17T04:51:34.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:34.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705769 2026-02-17T04:51:34.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705769' 2026-02-17T04:51:34.883 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705769 2026-02-17T04:51:34.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:35.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705769 -lt 38654705769 2026-02-17T04:51:35.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:35.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574951 2026-02-17T04:51:35.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:35.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:35.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574951 2026-02-17T04:51:35.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:35.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574951 2026-02-17T04:51:35.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574951' 2026-02-17T04:51:35.050 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574951 2026-02-17T04:51:35.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:35.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574951 -lt 55834574951 2026-02-17T04:51:35.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:35.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:35.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:35.373 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:35.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:35.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:35.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:35.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:35.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:35.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836590 2026-02-17T04:51:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836590 2026-02-17T04:51:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836590' 2026-02-17T04:51:35.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:35.607 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:35.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705772 2026-02-17T04:51:35.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705772 2026-02-17T04:51:35.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836590 1-38654705772' 2026-02-17T04:51:35.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:35.664 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574954 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574954 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836590 1-38654705772 2-55834574954' 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836590 2026-02-17T04:51:35.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:35.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:35.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836590 2026-02-17T04:51:35.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:35.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836590 2026-02-17T04:51:35.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836590' 2026-02-17T04:51:35.727 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836590 2026-02-17T04:51:35.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:35.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836587 -lt 21474836590 2026-02-17T04:51:35.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:36.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:37.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836590 -lt 21474836590 2026-02-17T04:51:37.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:37.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705772 2026-02-17T04:51:37.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:37.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:37.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705772 2026-02-17T04:51:37.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:37.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705772 2026-02-17T04:51:37.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705772' 2026-02-17T04:51:37.059 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705772 2026-02-17T04:51:37.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705772 -lt 38654705772 2026-02-17T04:51:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:37.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574954 2026-02-17T04:51:37.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:37.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574954 2026-02-17T04:51:37.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:37.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574954 2026-02-17T04:51:37.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574954' 2026-02-17T04:51:37.232 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574954 2026-02-17T04:51:37.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:37.396 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574954 -lt 55834574954 2026-02-17T04:51:37.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:37.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:37.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:37.553 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:37.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:37.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:37.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:37.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:37.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:37.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:37.727 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:37.727 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:37.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:37.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:37.727 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:37.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836593 2026-02-17T04:51:37.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836593 2026-02-17T04:51:37.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836593' 2026-02-17T04:51:37.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:37.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:37.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705775 2026-02-17T04:51:37.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705775 2026-02-17T04:51:37.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836593 1-38654705775' 2026-02-17T04:51:37.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:37.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:37.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574957 2026-02-17T04:51:37.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574957 2026-02-17T04:51:37.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836593 1-38654705775 2-55834574957' 2026-02-17T04:51:37.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:37.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836593 2026-02-17T04:51:37.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:37.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:37.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836593 2026-02-17T04:51:37.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:37.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836593 2026-02-17T04:51:37.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836593' 2026-02-17T04:51:37.908 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836593 2026-02-17T04:51:37.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:38.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836590 -lt 21474836593 2026-02-17T04:51:38.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:39.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:39.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:39.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836593 -lt 21474836593 2026-02-17T04:51:39.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:39.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705775 2026-02-17T04:51:39.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:39.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:39.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705775 2026-02-17T04:51:39.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705775 2026-02-17T04:51:39.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705775' 2026-02-17T04:51:39.243 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705775 2026-02-17T04:51:39.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705775 -lt 38654705775 2026-02-17T04:51:39.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:39.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574957 2026-02-17T04:51:39.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:39.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:39.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574957 2026-02-17T04:51:39.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:39.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574957 2026-02-17T04:51:39.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574957' 2026-02-17T04:51:39.413 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574957 2026-02-17T04:51:39.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:39.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574957 -lt 55834574957 2026-02-17T04:51:39.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:39.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:39.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:39.742 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:39.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:39.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:39.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:39.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:39.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:39.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:39.920 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:39.921 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:39.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:39.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:39.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:39.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836596 2026-02-17T04:51:39.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836596 2026-02-17T04:51:39.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836596' 2026-02-17T04:51:39.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:39.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:40.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705778 2026-02-17T04:51:40.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705778 2026-02-17T04:51:40.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836596 1-38654705778' 2026-02-17T04:51:40.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:40.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574960 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574960 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836596 1-38654705778 2-55834574960' 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836596 2026-02-17T04:51:40.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:40.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:40.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836596 2026-02-17T04:51:40.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:40.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836596 2026-02-17T04:51:40.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836596' 2026-02-17T04:51:40.101 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836596 2026-02-17T04:51:40.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836596 -lt 21474836596 2026-02-17T04:51:40.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:40.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705778 2026-02-17T04:51:40.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:40.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:40.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705778 2026-02-17T04:51:40.268 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:40.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705778 2026-02-17T04:51:40.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705778' 2026-02-17T04:51:40.269 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705778 2026-02-17T04:51:40.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:40.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705778 -lt 38654705778 2026-02-17T04:51:40.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:40.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574960 2026-02-17T04:51:40.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:40.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:40.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574960 2026-02-17T04:51:40.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574960 2026-02-17T04:51:40.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574960' 2026-02-17T04:51:40.437 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574960 2026-02-17T04:51:40.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:40.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574959 -lt 55834574960 2026-02-17T04:51:40.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:41.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:41.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:41.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574959 -lt 55834574960 2026-02-17T04:51:41.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:42.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:51:42.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:42.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574962 -lt 55834574960 2026-02-17T04:51:42.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:42.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:42.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:43.095 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:43.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:43.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:43.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:43.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:43.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:43.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:43.269 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:43.270 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:43.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:43.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:43.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:43.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836601 2026-02-17T04:51:43.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836601 2026-02-17T04:51:43.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836601' 2026-02-17T04:51:43.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:43.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705783 2026-02-17T04:51:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705783 2026-02-17T04:51:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836601 1-38654705783' 2026-02-17T04:51:43.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:43.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:43.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574964 2026-02-17T04:51:43.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574964 2026-02-17T04:51:43.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836601 1-38654705783 2-55834574964' 2026-02-17T04:51:43.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:43.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836601 2026-02-17T04:51:43.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:43.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:43.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836601 2026-02-17T04:51:43.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:43.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836601 2026-02-17T04:51:43.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836601' 2026-02-17T04:51:43.447 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836601 2026-02-17T04:51:43.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:43.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836598 -lt 21474836601 2026-02-17T04:51:43.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:44.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:44.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:44.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836601 -lt 21474836601 2026-02-17T04:51:44.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:44.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705783 2026-02-17T04:51:44.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:44.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:44.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705783 2026-02-17T04:51:44.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:44.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705783 2026-02-17T04:51:44.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705783' 2026-02-17T04:51:44.786 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705783 2026-02-17T04:51:44.786 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:44.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705783 -lt 38654705783 2026-02-17T04:51:44.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:44.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574964 2026-02-17T04:51:44.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:44.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:44.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574964 2026-02-17T04:51:44.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:44.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574964 2026-02-17T04:51:44.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574964' 2026-02-17T04:51:44.953 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574964 2026-02-17T04:51:44.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:45.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574965 -lt 55834574964 2026-02-17T04:51:45.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:45.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:45.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:45.269 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:45.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:45.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:45.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:45.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:45.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:45.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:45.447 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:45.447 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:45.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:45.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:45.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:45.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836604 2026-02-17T04:51:45.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836604 2026-02-17T04:51:45.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836604' 2026-02-17T04:51:45.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:45.505 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:45.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705786 2026-02-17T04:51:45.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705786 2026-02-17T04:51:45.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836604 1-38654705786' 2026-02-17T04:51:45.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:45.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:45.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574968 2026-02-17T04:51:45.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574968 2026-02-17T04:51:45.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836604 1-38654705786 2-55834574968' 2026-02-17T04:51:45.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:45.619 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836604 2026-02-17T04:51:45.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:45.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:45.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836604 2026-02-17T04:51:45.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836604 2026-02-17T04:51:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836604' 2026-02-17T04:51:45.622 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836604 2026-02-17T04:51:45.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:45.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836601 -lt 21474836604 2026-02-17T04:51:45.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:46.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:46.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:46.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836604 -lt 21474836604 2026-02-17T04:51:46.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:46.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705786 2026-02-17T04:51:46.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:46.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:46.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705786 2026-02-17T04:51:46.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705786 2026-02-17T04:51:46.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705786' 2026-02-17T04:51:46.960 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705786 2026-02-17T04:51:46.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:47.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705786 -lt 38654705786 2026-02-17T04:51:47.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:47.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574968 2026-02-17T04:51:47.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:47.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:47.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574968 2026-02-17T04:51:47.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:47.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574968 2026-02-17T04:51:47.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574968' 2026-02-17T04:51:47.129 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574968 2026-02-17T04:51:47.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:47.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574968 -lt 55834574968 2026-02-17T04:51:47.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:47.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:47.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:47.448 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:47.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:47.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:47.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:47.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:47.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:47.620 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:47.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836607 2026-02-17T04:51:47.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836607 2026-02-17T04:51:47.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836607' 2026-02-17T04:51:47.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:47.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:47.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705789 2026-02-17T04:51:47.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705789 2026-02-17T04:51:47.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836607 1-38654705789' 2026-02-17T04:51:47.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:47.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:47.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574971 2026-02-17T04:51:47.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574971 2026-02-17T04:51:47.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836607 1-38654705789 2-55834574971' 2026-02-17T04:51:47.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:47.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836607 2026-02-17T04:51:47.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:47.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:47.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836607 2026-02-17T04:51:47.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:47.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836607 2026-02-17T04:51:47.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836607' 2026-02-17T04:51:47.800 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836607 2026-02-17T04:51:47.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:47.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836604 -lt 21474836607 2026-02-17T04:51:47.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:48.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:48.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:49.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836607 -lt 21474836607 2026-02-17T04:51:49.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:49.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705789 2026-02-17T04:51:49.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:49.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:49.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705789 2026-02-17T04:51:49.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:49.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705789 2026-02-17T04:51:49.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705789' 2026-02-17T04:51:49.138 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705789 2026-02-17T04:51:49.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:49.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705789 -lt 38654705789 2026-02-17T04:51:49.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:49.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574971 2026-02-17T04:51:49.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:49.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:49.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574971 2026-02-17T04:51:49.306 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:49.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574971 2026-02-17T04:51:49.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574971' 2026-02-17T04:51:49.308 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574971 2026-02-17T04:51:49.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:49.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574971 -lt 55834574971 2026-02-17T04:51:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:49.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:49.633 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:49.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:49.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:49.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:49.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:49.642 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:49.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:49.805 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:49.805 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:49.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:49.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:49.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836610 2026-02-17T04:51:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836610 2026-02-17T04:51:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836610' 2026-02-17T04:51:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:49.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705792 2026-02-17T04:51:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705792 2026-02-17T04:51:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836610 1-38654705792' 2026-02-17T04:51:49.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:49.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574974 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574974 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836610 1-38654705792 2-55834574974' 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836610 2026-02-17T04:51:49.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:49.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:49.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836610 2026-02-17T04:51:49.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:49.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836610 2026-02-17T04:51:49.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836610' 2026-02-17T04:51:49.984 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836610 2026-02-17T04:51:49.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:50.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836610 -lt 21474836610 2026-02-17T04:51:50.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:50.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705792 2026-02-17T04:51:50.147 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:50.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:50.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705792 2026-02-17T04:51:50.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:50.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705792 2026-02-17T04:51:50.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705792' 2026-02-17T04:51:50.150 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705792 2026-02-17T04:51:50.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:50.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705792 -lt 38654705792 2026-02-17T04:51:50.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:50.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574974 2026-02-17T04:51:50.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:50.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:50.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574974 2026-02-17T04:51:50.315 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:50.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574974 2026-02-17T04:51:50.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574974' 2026-02-17T04:51:50.316 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574974 2026-02-17T04:51:50.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:50.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574974 -lt 55834574974 2026-02-17T04:51:50.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:50.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:50.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:50.644 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:50.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:50.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:50.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:50.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:50.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:50.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:50.816 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:50.817 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:50.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:50.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:50.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836612 2026-02-17T04:51:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836612 2026-02-17T04:51:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612' 2026-02-17T04:51:50.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:50.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:50.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705794 2026-02-17T04:51:50.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705794 2026-02-17T04:51:50.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612 1-38654705794' 2026-02-17T04:51:50.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:50.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:50.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574976 2026-02-17T04:51:50.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574976 2026-02-17T04:51:50.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612 1-38654705794 2-55834574976' 2026-02-17T04:51:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:50.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836612 2026-02-17T04:51:50.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:50.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836612 2026-02-17T04:51:50.996 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836612 2026-02-17T04:51:50.997 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836612 2026-02-17T04:51:50.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836612' 2026-02-17T04:51:50.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:51.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836610 -lt 21474836612 2026-02-17T04:51:51.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:52.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:52.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:52.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836613 -lt 21474836612 2026-02-17T04:51:52.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:52.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705794 2026-02-17T04:51:52.336 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:52.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:52.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705794 2026-02-17T04:51:52.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:52.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705794 2026-02-17T04:51:52.339 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705794 2026-02-17T04:51:52.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705794' 2026-02-17T04:51:52.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705795 -lt 38654705794 2026-02-17T04:51:52.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:52.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574976 2026-02-17T04:51:52.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:52.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:52.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574976 2026-02-17T04:51:52.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:52.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574976 2026-02-17T04:51:52.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574976' 2026-02-17T04:51:52.509 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574976 2026-02-17T04:51:52.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:52.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574977 -lt 55834574976 2026-02-17T04:51:52.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:52.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:52.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:52.835 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:52.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:52.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:52.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:52.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:52.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:53.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:53.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836615 2026-02-17T04:51:53.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836615 2026-02-17T04:51:53.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615' 2026-02-17T04:51:53.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:53.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:53.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705797 2026-02-17T04:51:53.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705797 2026-02-17T04:51:53.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615 1-38654705797' 2026-02-17T04:51:53.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:53.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:53.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574979 2026-02-17T04:51:53.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574979 2026-02-17T04:51:53.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615 1-38654705797 2-55834574979' 2026-02-17T04:51:53.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:53.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836615 2026-02-17T04:51:53.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:53.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:53.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836615 2026-02-17T04:51:53.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:53.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836615 2026-02-17T04:51:53.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836615' 2026-02-17T04:51:53.186 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836615 2026-02-17T04:51:53.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:53.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836613 -lt 21474836615 2026-02-17T04:51:53.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:54.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:54.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:54.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836616 -lt 21474836615 2026-02-17T04:51:54.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:54.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705797 2026-02-17T04:51:54.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:54.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:54.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705797 2026-02-17T04:51:54.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:54.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705797 2026-02-17T04:51:54.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705797' 2026-02-17T04:51:54.519 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705797 2026-02-17T04:51:54.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:54.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705798 -lt 38654705797 2026-02-17T04:51:54.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:54.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574979 2026-02-17T04:51:54.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:54.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:54.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574979 2026-02-17T04:51:54.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:54.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574979 2026-02-17T04:51:54.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574979' 2026-02-17T04:51:54.689 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574979 2026-02-17T04:51:54.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:54.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574980 -lt 55834574979 2026-02-17T04:51:54.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:54.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:54.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:55.014 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:55.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:55.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:55.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:55.189 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:55.189 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:55.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:55.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:55.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:55.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836619 2026-02-17T04:51:55.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836619 2026-02-17T04:51:55.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619' 2026-02-17T04:51:55.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:55.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:55.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705801 2026-02-17T04:51:55.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705801 2026-02-17T04:51:55.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619 1-38654705801' 2026-02-17T04:51:55.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:55.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:55.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574982 2026-02-17T04:51:55.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574982 2026-02-17T04:51:55.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619 1-38654705801 2-55834574982' 2026-02-17T04:51:55.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:55.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836619 2026-02-17T04:51:55.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:55.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:55.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836619 2026-02-17T04:51:55.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:55.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836619 2026-02-17T04:51:55.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836619' 2026-02-17T04:51:55.367 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836619 2026-02-17T04:51:55.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:55.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836616 -lt 21474836619 2026-02-17T04:51:55.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:56.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:56.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:56.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836619 -lt 21474836619 2026-02-17T04:51:56.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:56.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705801 2026-02-17T04:51:56.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:56.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:56.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705801 2026-02-17T04:51:56.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:56.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705801 2026-02-17T04:51:56.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705801' 2026-02-17T04:51:56.701 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705801 2026-02-17T04:51:56.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:56.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705801 -lt 38654705801 2026-02-17T04:51:56.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:56.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574982 2026-02-17T04:51:56.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:56.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:56.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574982 2026-02-17T04:51:56.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:56.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574982 2026-02-17T04:51:56.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574982' 2026-02-17T04:51:56.876 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574982 2026-02-17T04:51:56.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:57.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574983 -lt 55834574982 2026-02-17T04:51:57.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:57.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:57.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:57.194 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:57.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:57.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:57.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:57.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:57.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:57.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:57.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836622 2026-02-17T04:51:57.428 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836622 2026-02-17T04:51:57.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622' 2026-02-17T04:51:57.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:57.429 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:57.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705804 2026-02-17T04:51:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705804 2026-02-17T04:51:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622 1-38654705804' 2026-02-17T04:51:57.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:57.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:57.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574986 2026-02-17T04:51:57.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574986 2026-02-17T04:51:57.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622 1-38654705804 2-55834574986' 2026-02-17T04:51:57.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:57.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836622 2026-02-17T04:51:57.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:57.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:57.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836622 2026-02-17T04:51:57.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:57.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836622 2026-02-17T04:51:57.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836622' 2026-02-17T04:51:57.552 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836622 2026-02-17T04:51:57.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:57.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836619 -lt 21474836622 2026-02-17T04:51:57.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:51:58.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:51:58.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:58.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836622 -lt 21474836622 2026-02-17T04:51:58.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:58.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705804 2026-02-17T04:51:58.884 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:58.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:51:58.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705804 2026-02-17T04:51:58.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:58.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705804 2026-02-17T04:51:58.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705804' 2026-02-17T04:51:58.887 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705804 2026-02-17T04:51:58.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:51:59.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705804 -lt 38654705804 2026-02-17T04:51:59.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:59.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574986 2026-02-17T04:51:59.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:59.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:51:59.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574986 2026-02-17T04:51:59.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:59.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574986 2026-02-17T04:51:59.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574986' 2026-02-17T04:51:59.056 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574986 2026-02-17T04:51:59.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:51:59.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574986 -lt 55834574986 2026-02-17T04:51:59.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:51:59.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:51:59.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:51:59.389 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:51:59.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:51:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:51:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:51:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:51:59.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:51:59.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:51:59.564 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:51:59.564 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:51:59.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:51:59.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:59.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:51:59.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836625 2026-02-17T04:51:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836625 2026-02-17T04:51:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836625' 2026-02-17T04:51:59.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:59.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:51:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705807 2026-02-17T04:51:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705807 2026-02-17T04:51:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836625 1-38654705807' 2026-02-17T04:51:59.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:51:59.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:51:59.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574989 2026-02-17T04:51:59.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574989 2026-02-17T04:51:59.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836625 1-38654705807 2-55834574989' 2026-02-17T04:51:59.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:51:59.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836625 2026-02-17T04:51:59.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:51:59.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:51:59.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836625 2026-02-17T04:51:59.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:51:59.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836625 2026-02-17T04:51:59.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836625' 2026-02-17T04:51:59.741 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836625 2026-02-17T04:51:59.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:51:59.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836622 -lt 21474836625 2026-02-17T04:51:59.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:00.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:00.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:01.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836625 -lt 21474836625 2026-02-17T04:52:01.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:01.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705807 2026-02-17T04:52:01.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:01.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:01.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705807 2026-02-17T04:52:01.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:01.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705807 2026-02-17T04:52:01.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705807' 2026-02-17T04:52:01.081 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705807 2026-02-17T04:52:01.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:01.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705807 -lt 38654705807 2026-02-17T04:52:01.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:01.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574989 2026-02-17T04:52:01.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:01.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:01.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574989 2026-02-17T04:52:01.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:01.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574989 2026-02-17T04:52:01.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574989' 2026-02-17T04:52:01.251 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574989 2026-02-17T04:52:01.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:01.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574989 -lt 55834574989 2026-02-17T04:52:01.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:01.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:01.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:01.570 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:01.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:01.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:01.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:01.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:01.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:01.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:01.742 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:01.742 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:01.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:01.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:01.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:01.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836628 2026-02-17T04:52:01.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836628 2026-02-17T04:52:01.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836628' 2026-02-17T04:52:01.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:01.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:01.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705810 2026-02-17T04:52:01.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705810 2026-02-17T04:52:01.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836628 1-38654705810' 2026-02-17T04:52:01.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:01.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:01.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574992 2026-02-17T04:52:01.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574992 2026-02-17T04:52:01.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836628 1-38654705810 2-55834574992' 2026-02-17T04:52:01.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:01.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836628 2026-02-17T04:52:01.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:01.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:01.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836628 2026-02-17T04:52:01.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:01.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836628 2026-02-17T04:52:01.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836628' 2026-02-17T04:52:01.927 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836628 2026-02-17T04:52:01.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:02.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836625 -lt 21474836628 2026-02-17T04:52:02.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:03.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:03.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:03.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836628 -lt 21474836628 2026-02-17T04:52:03.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:03.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705810 2026-02-17T04:52:03.261 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:03.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:03.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705810 2026-02-17T04:52:03.263 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:03.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705810 2026-02-17T04:52:03.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705810' 2026-02-17T04:52:03.264 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705810 2026-02-17T04:52:03.265 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:03.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705810 -lt 38654705810 2026-02-17T04:52:03.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:03.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574992 2026-02-17T04:52:03.430 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:03.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:03.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574992 2026-02-17T04:52:03.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:03.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574992 2026-02-17T04:52:03.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574992' 2026-02-17T04:52:03.433 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574992 2026-02-17T04:52:03.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:03.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574992 -lt 55834574992 2026-02-17T04:52:03.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:03.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:03.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:03.756 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:03.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:03.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:03.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:03.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:03.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:03.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:03.928 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:03.928 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:03.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:03.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:03.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:03.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836631 2026-02-17T04:52:03.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836631 2026-02-17T04:52:03.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631' 2026-02-17T04:52:03.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:03.988 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:04.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705813 2026-02-17T04:52:04.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705813 2026-02-17T04:52:04.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631 1-38654705813' 2026-02-17T04:52:04.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:04.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:04.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574995 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574995 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631 1-38654705813 2-55834574995' 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836631 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:04.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:04.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836631 2026-02-17T04:52:04.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:04.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836631 2026-02-17T04:52:04.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836631' 2026-02-17T04:52:04.107 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836631 2026-02-17T04:52:04.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:04.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836631 -lt 21474836631 2026-02-17T04:52:04.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:04.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705813 2026-02-17T04:52:04.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:04.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:04.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705813 2026-02-17T04:52:04.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:04.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705813 2026-02-17T04:52:04.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705813' 2026-02-17T04:52:04.278 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705813 2026-02-17T04:52:04.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705813 -lt 38654705813 2026-02-17T04:52:04.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:04.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574995 2026-02-17T04:52:04.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:04.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:04.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574995 2026-02-17T04:52:04.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:04.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574995 2026-02-17T04:52:04.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574995' 2026-02-17T04:52:04.445 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574995 2026-02-17T04:52:04.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:04.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574994 -lt 55834574995 2026-02-17T04:52:04.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:05.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:05.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574994 -lt 55834574995 2026-02-17T04:52:05.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:06.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:52:06.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:06.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574997 -lt 55834574995 2026-02-17T04:52:06.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:06.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:06.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:07.096 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:07.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:07.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:07.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:07.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:07.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:07.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:07.270 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:07.270 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:07.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:07.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:07.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836636 2026-02-17T04:52:07.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836636 2026-02-17T04:52:07.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836636' 2026-02-17T04:52:07.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:07.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:07.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705818 2026-02-17T04:52:07.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705818 2026-02-17T04:52:07.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836636 1-38654705818' 2026-02-17T04:52:07.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:07.389 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:07.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574999 2026-02-17T04:52:07.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574999 2026-02-17T04:52:07.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836636 1-38654705818 2-55834574999' 2026-02-17T04:52:07.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:07.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836636 2026-02-17T04:52:07.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:07.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:07.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836636 2026-02-17T04:52:07.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:07.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836636 2026-02-17T04:52:07.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836636' 2026-02-17T04:52:07.451 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836636 2026-02-17T04:52:07.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836633 -lt 21474836636 2026-02-17T04:52:07.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:08.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:08.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:08.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836636 -lt 21474836636 2026-02-17T04:52:08.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:08.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705818 2026-02-17T04:52:08.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:08.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:08.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705818 2026-02-17T04:52:08.783 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:08.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705818 2026-02-17T04:52:08.784 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705818 2026-02-17T04:52:08.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705818' 2026-02-17T04:52:08.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:08.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705818 -lt 38654705818 2026-02-17T04:52:08.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:08.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574999 2026-02-17T04:52:08.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:08.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:08.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574999 2026-02-17T04:52:08.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:08.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574999 2026-02-17T04:52:08.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574999' 2026-02-17T04:52:08.952 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574999 2026-02-17T04:52:08.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:09.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575000 -lt 55834574999 2026-02-17T04:52:09.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:09.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:09.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:09.275 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:09.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:09.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:09.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:09.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:09.446 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:09.446 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:09.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:09.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:09.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:09.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836639 2026-02-17T04:52:09.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836639 2026-02-17T04:52:09.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836639' 2026-02-17T04:52:09.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:09.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:09.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705821 2026-02-17T04:52:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705821 2026-02-17T04:52:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836639 1-38654705821' 2026-02-17T04:52:09.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:09.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:09.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575003 2026-02-17T04:52:09.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575003 2026-02-17T04:52:09.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836639 1-38654705821 2-55834575003' 2026-02-17T04:52:09.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:09.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836639 2026-02-17T04:52:09.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:09.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:09.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836639 2026-02-17T04:52:09.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:09.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836639 2026-02-17T04:52:09.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836639' 2026-02-17T04:52:09.626 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836639 2026-02-17T04:52:09.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:09.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836636 -lt 21474836639 2026-02-17T04:52:09.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:10.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:10.790 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:10.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836639 -lt 21474836639 2026-02-17T04:52:10.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:10.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705821 2026-02-17T04:52:10.957 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:10.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:10.958 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705821 2026-02-17T04:52:10.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:10.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705821 2026-02-17T04:52:10.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705821' 2026-02-17T04:52:10.960 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705821 2026-02-17T04:52:10.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:11.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705821 -lt 38654705821 2026-02-17T04:52:11.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:11.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575003 2026-02-17T04:52:11.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:11.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:11.128 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575003 2026-02-17T04:52:11.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:11.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575003 2026-02-17T04:52:11.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575003' 2026-02-17T04:52:11.130 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575003 2026-02-17T04:52:11.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:11.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575003 -lt 55834575003 2026-02-17T04:52:11.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:11.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:11.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:11.450 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:11.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:11.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:11.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:11.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:11.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:11.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:11.624 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:11.624 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:11.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:11.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:11.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:11.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836642 2026-02-17T04:52:11.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836642 2026-02-17T04:52:11.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836642' 2026-02-17T04:52:11.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:11.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705824 2026-02-17T04:52:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705824 2026-02-17T04:52:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836642 1-38654705824' 2026-02-17T04:52:11.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:11.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:11.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575006 2026-02-17T04:52:11.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575006 2026-02-17T04:52:11.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836642 1-38654705824 2-55834575006' 2026-02-17T04:52:11.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:11.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836642 2026-02-17T04:52:11.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:11.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:11.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836642 2026-02-17T04:52:11.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:11.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836642 2026-02-17T04:52:11.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836642' 2026-02-17T04:52:11.804 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836642 2026-02-17T04:52:11.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:11.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836639 -lt 21474836642 2026-02-17T04:52:11.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:12.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:12.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:13.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836642 -lt 21474836642 2026-02-17T04:52:13.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:13.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705824 2026-02-17T04:52:13.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:13.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:13.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705824 2026-02-17T04:52:13.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:13.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705824 2026-02-17T04:52:13.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705824' 2026-02-17T04:52:13.143 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705824 2026-02-17T04:52:13.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:13.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705824 -lt 38654705824 2026-02-17T04:52:13.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:13.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575006 2026-02-17T04:52:13.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:13.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:13.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575006 2026-02-17T04:52:13.309 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:13.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575006 2026-02-17T04:52:13.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575006' 2026-02-17T04:52:13.310 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575006 2026-02-17T04:52:13.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:13.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575006 -lt 55834575006 2026-02-17T04:52:13.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:13.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:13.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:13.635 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:13.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:13.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:13.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:13.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:13.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:13.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:13.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836645 2026-02-17T04:52:13.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836645 2026-02-17T04:52:13.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836645' 2026-02-17T04:52:13.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:13.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:13.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705827 2026-02-17T04:52:13.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705827 2026-02-17T04:52:13.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836645 1-38654705827' 2026-02-17T04:52:13.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:13.928 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:13.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575009 2026-02-17T04:52:13.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575009 2026-02-17T04:52:13.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836645 1-38654705827 2-55834575009' 2026-02-17T04:52:13.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:13.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836645 2026-02-17T04:52:13.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:13.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:13.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836645 2026-02-17T04:52:13.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:13.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836645 2026-02-17T04:52:13.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836645' 2026-02-17T04:52:13.988 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836645 2026-02-17T04:52:13.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:14.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836645 -lt 21474836645 2026-02-17T04:52:14.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:14.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705827 2026-02-17T04:52:14.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:14.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:14.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705827 2026-02-17T04:52:14.158 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:14.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705827 2026-02-17T04:52:14.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705827' 2026-02-17T04:52:14.159 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705827 2026-02-17T04:52:14.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:14.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705827 -lt 38654705827 2026-02-17T04:52:14.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:14.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575009 2026-02-17T04:52:14.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:14.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:14.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575009 2026-02-17T04:52:14.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:14.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575009 2026-02-17T04:52:14.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575009' 2026-02-17T04:52:14.329 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575009 2026-02-17T04:52:14.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:14.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575009 -lt 55834575009 2026-02-17T04:52:14.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:14.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:14.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:14.647 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:14.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:14.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:14.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:14.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:14.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:14.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:14.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836647 2026-02-17T04:52:14.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836647 2026-02-17T04:52:14.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647' 2026-02-17T04:52:14.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:14.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:14.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705829 2026-02-17T04:52:14.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705829 2026-02-17T04:52:14.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647 1-38654705829' 2026-02-17T04:52:14.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:14.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:14.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575011 2026-02-17T04:52:14.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575011 2026-02-17T04:52:14.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647 1-38654705829 2-55834575011' 2026-02-17T04:52:14.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:14.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836647 2026-02-17T04:52:14.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:14.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:14.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836647 2026-02-17T04:52:14.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:14.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836647 2026-02-17T04:52:14.996 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836647 2026-02-17T04:52:14.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836647' 2026-02-17T04:52:14.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:15.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836645 -lt 21474836647 2026-02-17T04:52:15.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:16.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:16.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:16.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836648 -lt 21474836647 2026-02-17T04:52:16.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:16.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705829 2026-02-17T04:52:16.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:16.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:16.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705829 2026-02-17T04:52:16.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:16.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705829 2026-02-17T04:52:16.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705829' 2026-02-17T04:52:16.329 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705829 2026-02-17T04:52:16.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705830 -lt 38654705829 2026-02-17T04:52:16.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:16.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575011 2026-02-17T04:52:16.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:16.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:16.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575011 2026-02-17T04:52:16.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:16.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575011 2026-02-17T04:52:16.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575011' 2026-02-17T04:52:16.498 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575011 2026-02-17T04:52:16.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:16.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575012 -lt 55834575011 2026-02-17T04:52:16.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:16.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:16.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:16.818 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:16.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:16.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:16.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:16.993 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:16.993 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:16.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:16.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:16.994 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:17.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836650 2026-02-17T04:52:17.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836650 2026-02-17T04:52:17.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836650' 2026-02-17T04:52:17.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:17.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:17.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705832 2026-02-17T04:52:17.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705832 2026-02-17T04:52:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836650 1-38654705832' 2026-02-17T04:52:17.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:17.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575014 2026-02-17T04:52:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575014 2026-02-17T04:52:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836650 1-38654705832 2-55834575014' 2026-02-17T04:52:17.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:17.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836650 2026-02-17T04:52:17.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:17.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:17.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836650 2026-02-17T04:52:17.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:17.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836650 2026-02-17T04:52:17.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836650' 2026-02-17T04:52:17.171 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836650 2026-02-17T04:52:17.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:17.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836648 -lt 21474836650 2026-02-17T04:52:17.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:18.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:18.339 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:18.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836651 -lt 21474836650 2026-02-17T04:52:18.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:18.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705832 2026-02-17T04:52:18.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:18.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:18.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705832 2026-02-17T04:52:18.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:18.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705832 2026-02-17T04:52:18.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705832' 2026-02-17T04:52:18.506 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705832 2026-02-17T04:52:18.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:18.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705833 -lt 38654705832 2026-02-17T04:52:18.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:18.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575014 2026-02-17T04:52:18.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:18.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:18.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575014 2026-02-17T04:52:18.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:18.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575014 2026-02-17T04:52:18.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575014' 2026-02-17T04:52:18.674 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575014 2026-02-17T04:52:18.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:18.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575015 -lt 55834575014 2026-02-17T04:52:18.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:18.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:18.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:18.997 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:19.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:19.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:19.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:19.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836654 2026-02-17T04:52:19.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836654 2026-02-17T04:52:19.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654' 2026-02-17T04:52:19.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:19.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705836 2026-02-17T04:52:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705836 2026-02-17T04:52:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654 1-38654705836' 2026-02-17T04:52:19.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:19.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575017 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575017 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654 1-38654705836 2-55834575017' 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836654 2026-02-17T04:52:19.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:19.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:19.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836654 2026-02-17T04:52:19.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:19.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836654 2026-02-17T04:52:19.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836654' 2026-02-17T04:52:19.347 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836654 2026-02-17T04:52:19.347 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:19.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836651 -lt 21474836654 2026-02-17T04:52:19.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:20.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:20.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:20.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836654 -lt 21474836654 2026-02-17T04:52:20.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:20.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705836 2026-02-17T04:52:20.680 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:20.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:20.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705836 2026-02-17T04:52:20.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:20.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705836 2026-02-17T04:52:20.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705836' 2026-02-17T04:52:20.683 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705836 2026-02-17T04:52:20.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:20.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705836 -lt 38654705836 2026-02-17T04:52:20.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575017 2026-02-17T04:52:20.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:20.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:20.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575017 2026-02-17T04:52:20.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:20.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575017 2026-02-17T04:52:20.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575017' 2026-02-17T04:52:20.852 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575017 2026-02-17T04:52:20.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575018 -lt 55834575017 2026-02-17T04:52:21.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:21.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:21.179 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:21.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:21.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:21.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:21.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:21.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:21.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836657 2026-02-17T04:52:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836657 2026-02-17T04:52:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657' 2026-02-17T04:52:21.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:21.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705839 2026-02-17T04:52:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705839 2026-02-17T04:52:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657 1-38654705839' 2026-02-17T04:52:21.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:21.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575021 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575021 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657 1-38654705839 2-55834575021' 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836657 2026-02-17T04:52:21.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:21.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:21.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836657 2026-02-17T04:52:21.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:21.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836657 2026-02-17T04:52:21.531 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836657 2026-02-17T04:52:21.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836657' 2026-02-17T04:52:21.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:21.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836654 -lt 21474836657 2026-02-17T04:52:21.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:22.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:22.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:22.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836657 -lt 21474836657 2026-02-17T04:52:22.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:22.874 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705839 2026-02-17T04:52:22.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:22.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:22.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705839 2026-02-17T04:52:22.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:22.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705839 2026-02-17T04:52:22.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705839' 2026-02-17T04:52:22.877 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705839 2026-02-17T04:52:22.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:23.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705839 -lt 38654705839 2026-02-17T04:52:23.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:23.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575021 2026-02-17T04:52:23.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:23.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:23.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575021 2026-02-17T04:52:23.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:23.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575021 2026-02-17T04:52:23.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575021' 2026-02-17T04:52:23.051 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575021 2026-02-17T04:52:23.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:23.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575021 -lt 55834575021 2026-02-17T04:52:23.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:23.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:23.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:23.373 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:23.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:23.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:23.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:23.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:23.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:23.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:23.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836660 2026-02-17T04:52:23.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836660 2026-02-17T04:52:23.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660' 2026-02-17T04:52:23.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:23.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:23.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705842 2026-02-17T04:52:23.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705842 2026-02-17T04:52:23.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660 1-38654705842' 2026-02-17T04:52:23.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:23.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575024 2026-02-17T04:52:23.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575024 2026-02-17T04:52:23.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660 1-38654705842 2-55834575024' 2026-02-17T04:52:23.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:23.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836660 2026-02-17T04:52:23.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:23.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:23.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836660 2026-02-17T04:52:23.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:23.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836660 2026-02-17T04:52:23.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836660' 2026-02-17T04:52:23.723 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836660 2026-02-17T04:52:23.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:23.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836657 -lt 21474836660 2026-02-17T04:52:23.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:24.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:24.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:25.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836660 -lt 21474836660 2026-02-17T04:52:25.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:25.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705842 2026-02-17T04:52:25.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:25.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:25.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705842 2026-02-17T04:52:25.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:25.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705842 2026-02-17T04:52:25.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705842' 2026-02-17T04:52:25.061 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705842 2026-02-17T04:52:25.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:25.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705842 -lt 38654705842 2026-02-17T04:52:25.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:25.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575024 2026-02-17T04:52:25.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:25.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:25.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575024 2026-02-17T04:52:25.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:25.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575024 2026-02-17T04:52:25.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575024' 2026-02-17T04:52:25.234 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575024 2026-02-17T04:52:25.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:25.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575024 -lt 55834575024 2026-02-17T04:52:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:25.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:25.557 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:25.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:25.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:25.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:25.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:25.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:25.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:25.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836663 2026-02-17T04:52:25.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836663 2026-02-17T04:52:25.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663' 2026-02-17T04:52:25.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:25.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:25.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705845 2026-02-17T04:52:25.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705845 2026-02-17T04:52:25.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663 1-38654705845' 2026-02-17T04:52:25.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:25.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575027 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575027 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663 1-38654705845 2-55834575027' 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836663 2026-02-17T04:52:25.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:25.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:25.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836663 2026-02-17T04:52:25.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:25.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836663 2026-02-17T04:52:25.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836663' 2026-02-17T04:52:25.905 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836663 2026-02-17T04:52:25.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:26.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836660 -lt 21474836663 2026-02-17T04:52:26.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:27.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:27.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:27.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836663 -lt 21474836663 2026-02-17T04:52:27.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:27.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705845 2026-02-17T04:52:27.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:27.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:27.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705845 2026-02-17T04:52:27.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:27.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705845 2026-02-17T04:52:27.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705845' 2026-02-17T04:52:27.241 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705845 2026-02-17T04:52:27.241 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:27.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705845 -lt 38654705845 2026-02-17T04:52:27.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:27.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575027 2026-02-17T04:52:27.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:27.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:27.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575027 2026-02-17T04:52:27.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:27.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575027 2026-02-17T04:52:27.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575027' 2026-02-17T04:52:27.409 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575027 2026-02-17T04:52:27.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:27.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575027 -lt 55834575027 2026-02-17T04:52:27.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:27.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:27.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:27.732 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:27.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:27.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:27.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:27.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:27.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:27.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:27.904 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:27.904 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:27.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:27.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:27.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836666 2026-02-17T04:52:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836666 2026-02-17T04:52:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836666' 2026-02-17T04:52:27.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:27.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705848 2026-02-17T04:52:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705848 2026-02-17T04:52:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836666 1-38654705848' 2026-02-17T04:52:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:28.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575030 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575030 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836666 1-38654705848 2-55834575030' 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836666 2026-02-17T04:52:28.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:28.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:28.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836666 2026-02-17T04:52:28.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:28.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836666 2026-02-17T04:52:28.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836666' 2026-02-17T04:52:28.083 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836666 2026-02-17T04:52:28.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:28.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836666 -lt 21474836666 2026-02-17T04:52:28.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:28.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705848 2026-02-17T04:52:28.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:28.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:28.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705848 2026-02-17T04:52:28.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:28.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705848 2026-02-17T04:52:28.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705848' 2026-02-17T04:52:28.253 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705848 2026-02-17T04:52:28.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:28.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705848 -lt 38654705848 2026-02-17T04:52:28.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:28.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575030 2026-02-17T04:52:28.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:28.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:28.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575030 2026-02-17T04:52:28.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:28.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575030 2026-02-17T04:52:28.420 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575030 2026-02-17T04:52:28.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575030' 2026-02-17T04:52:28.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:28.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575029 -lt 55834575030 2026-02-17T04:52:28.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:29.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:29.585 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:29.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575029 -lt 55834575030 2026-02-17T04:52:29.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:30.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T04:52:30.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:30.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575032 -lt 55834575030 2026-02-17T04:52:30.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:30.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:30.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:31.080 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:31.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:31.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:31.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:31.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:31.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:31.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:31.256 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:31.257 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:31.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:31.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:31.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:31.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836671 2026-02-17T04:52:31.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836671 2026-02-17T04:52:31.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836671' 2026-02-17T04:52:31.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:31.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:31.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705853 2026-02-17T04:52:31.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705853 2026-02-17T04:52:31.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836671 1-38654705853' 2026-02-17T04:52:31.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:31.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575034 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575034 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836671 1-38654705853 2-55834575034' 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836671 2026-02-17T04:52:31.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:31.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:31.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836671 2026-02-17T04:52:31.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:31.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836671 2026-02-17T04:52:31.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836671' 2026-02-17T04:52:31.436 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836671 2026-02-17T04:52:31.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:31.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836668 -lt 21474836671 2026-02-17T04:52:31.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:32.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:32.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:32.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836671 -lt 21474836671 2026-02-17T04:52:32.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:32.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705853 2026-02-17T04:52:32.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:32.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:32.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705853 2026-02-17T04:52:32.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:32.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705853 2026-02-17T04:52:32.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705853' 2026-02-17T04:52:32.772 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705853 2026-02-17T04:52:32.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705853 -lt 38654705853 2026-02-17T04:52:32.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:32.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575034 2026-02-17T04:52:32.937 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:32.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:32.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575034 2026-02-17T04:52:32.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575034 2026-02-17T04:52:32.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575034' 2026-02-17T04:52:32.940 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575034 2026-02-17T04:52:32.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:33.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575035 -lt 55834575034 2026-02-17T04:52:33.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:33.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:33.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:33.261 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:33.269 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:33.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:33.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:33.434 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:33.434 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:33.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:33.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:33.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836674 2026-02-17T04:52:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836674 2026-02-17T04:52:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836674' 2026-02-17T04:52:33.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:33.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:33.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705856 2026-02-17T04:52:33.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705856 2026-02-17T04:52:33.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836674 1-38654705856' 2026-02-17T04:52:33.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:33.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:33.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575038 2026-02-17T04:52:33.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575038 2026-02-17T04:52:33.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836674 1-38654705856 2-55834575038' 2026-02-17T04:52:33.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:33.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836674 2026-02-17T04:52:33.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:33.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:33.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836674 2026-02-17T04:52:33.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:33.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836674 2026-02-17T04:52:33.613 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836674 2026-02-17T04:52:33.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836674' 2026-02-17T04:52:33.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:33.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836671 -lt 21474836674 2026-02-17T04:52:33.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:34.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:34.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:34.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836674 -lt 21474836674 2026-02-17T04:52:34.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:34.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705856 2026-02-17T04:52:34.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:34.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:34.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705856 2026-02-17T04:52:34.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705856 2026-02-17T04:52:34.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705856' 2026-02-17T04:52:34.947 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705856 2026-02-17T04:52:34.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:35.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705856 -lt 38654705856 2026-02-17T04:52:35.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:35.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575038 2026-02-17T04:52:35.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:35.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:35.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575038 2026-02-17T04:52:35.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:35.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575038 2026-02-17T04:52:35.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575038' 2026-02-17T04:52:35.117 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575038 2026-02-17T04:52:35.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:35.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575038 -lt 55834575038 2026-02-17T04:52:35.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:35.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:35.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:35.446 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:35.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:35.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:35.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:35.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:35.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:35.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:35.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836677 2026-02-17T04:52:35.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836677 2026-02-17T04:52:35.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836677' 2026-02-17T04:52:35.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:35.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:35.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705859 2026-02-17T04:52:35.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705859 2026-02-17T04:52:35.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836677 1-38654705859' 2026-02-17T04:52:35.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:35.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575041 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575041 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836677 1-38654705859 2-55834575041' 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836677 2026-02-17T04:52:35.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:35.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:35.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836677 2026-02-17T04:52:35.797 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:35.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836677 2026-02-17T04:52:35.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836677' 2026-02-17T04:52:35.799 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836677 2026-02-17T04:52:35.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:35.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836674 -lt 21474836677 2026-02-17T04:52:35.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:36.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:36.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:37.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836677 -lt 21474836677 2026-02-17T04:52:37.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:37.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705859 2026-02-17T04:52:37.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:37.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:37.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705859 2026-02-17T04:52:37.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:37.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705859 2026-02-17T04:52:37.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705859' 2026-02-17T04:52:37.136 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705859 2026-02-17T04:52:37.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:37.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705859 -lt 38654705859 2026-02-17T04:52:37.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:37.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575041 2026-02-17T04:52:37.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:37.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:37.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575041 2026-02-17T04:52:37.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:37.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575041 2026-02-17T04:52:37.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575041' 2026-02-17T04:52:37.304 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575041 2026-02-17T04:52:37.304 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575041 -lt 55834575041 2026-02-17T04:52:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:37.620 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:37.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:37.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:37.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:37.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:37.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:37.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:37.793 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:37.794 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:37.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:37.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:37.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:37.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836680 2026-02-17T04:52:37.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836680 2026-02-17T04:52:37.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836680' 2026-02-17T04:52:37.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:37.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:37.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705862 2026-02-17T04:52:37.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705862 2026-02-17T04:52:37.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836680 1-38654705862' 2026-02-17T04:52:37.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:37.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575044 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575044 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836680 1-38654705862 2-55834575044' 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836680 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:37.968 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:37.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836680 2026-02-17T04:52:37.969 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836680 2026-02-17T04:52:37.970 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836680 2026-02-17T04:52:37.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836680' 2026-02-17T04:52:37.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836680 -lt 21474836680 2026-02-17T04:52:38.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:38.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705862 2026-02-17T04:52:38.143 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:38.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:38.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705862 2026-02-17T04:52:38.144 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:38.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705862 2026-02-17T04:52:38.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705862' 2026-02-17T04:52:38.145 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705862 2026-02-17T04:52:38.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:38.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705862 -lt 38654705862 2026-02-17T04:52:38.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:38.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575044 2026-02-17T04:52:38.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:38.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:38.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575044 2026-02-17T04:52:38.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:38.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575044 2026-02-17T04:52:38.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575044' 2026-02-17T04:52:38.314 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575044 2026-02-17T04:52:38.314 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:38.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575044 -lt 55834575044 2026-02-17T04:52:38.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:38.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:38.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:38.637 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:38.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T04:52:38.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T04:52:38.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T04:52:38.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T04:52:38.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:38.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T04:52:38.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836682 2026-02-17T04:52:38.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836682 2026-02-17T04:52:38.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682' 2026-02-17T04:52:38.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:38.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T04:52:38.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705864 2026-02-17T04:52:38.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705864 2026-02-17T04:52:38.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682 1-38654705864' 2026-02-17T04:52:38.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:52:38.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T04:52:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575046 2026-02-17T04:52:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575046 2026-02-17T04:52:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682 1-38654705864 2-55834575046' 2026-02-17T04:52:38.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:38.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836682 2026-02-17T04:52:38.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:52:38.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836682 2026-02-17T04:52:38.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:38.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836682 2026-02-17T04:52:38.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836682' 2026-02-17T04:52:38.991 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836682 2026-02-17T04:52:38.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836680 -lt 21474836682 2026-02-17T04:52:39.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:52:40.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T04:52:40.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:52:40.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836683 -lt 21474836682 2026-02-17T04:52:40.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:40.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705864 2026-02-17T04:52:40.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:40.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:52:40.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705864 2026-02-17T04:52:40.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:40.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705864 2026-02-17T04:52:40.333 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705864 2026-02-17T04:52:40.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705864' 2026-02-17T04:52:40.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:52:40.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705865 -lt 38654705864 2026-02-17T04:52:40.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:52:40.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575046 2026-02-17T04:52:40.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:52:40.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:52:40.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575046 2026-02-17T04:52:40.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:52:40.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575046 2026-02-17T04:52:40.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575046' 2026-02-17T04:52:40.501 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834575046 2026-02-17T04:52:40.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:52:40.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575047 -lt 55834575046 2026-02-17T04:52:40.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T04:52:40.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T04:52:40.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T04:52:40.829 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:52:40.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:378: _scrub_abort: break 2026-02-17T04:52:40.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:380: _scrub_abort: set +o pipefail 2026-02-17T04:52:40.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:382: _scrub_abort: sleep 5 2026-02-17T04:52:45.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:384: _scrub_abort: grep 'nodeep_scrub set, aborting' td/osd-scrub-test/osd.1.log 2026-02-17T04:52:45.849 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T04:50:43.066+0000 7fc68120d640 10 osd.1 pg_epoch: 19 pg[1.0( v 17'1000 (0'0,17'1000] local-lis/les=15/16 n=1000 ec=15/15 lis/c=15/15 les/c/f=16/16/0 sis=15) [1,0,2] r=0 lpr=15 crt=17'1000 lcod 17'999 mlcod 17'999 active+clean+scrubbing+deep(periodic-regular)] scrubber: nodeep_scrub set, aborting 2026-02-17T04:52:45.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: get_last_scrub_stamp 1.0 2026-02-17T04:52:45.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:45.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:45.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:45.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:46.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: local last_scrub=2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:46.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:391: _scrub_abort: ceph config set osd osd_scrub_sleep 0.1 2026-02-17T04:52:46.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:393: _scrub_abort: ceph osd unset nodeep-scrub 2026-02-17T04:52:46.370 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is unset 2026-02-17T04:52:46.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:394: _scrub_abort: '[' deep-scrub = deep-scrub ']' 2026-02-17T04:52:46.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:396: _scrub_abort: ceph osd unset noscrub 2026-02-17T04:52:46.571 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is unset 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:398: _scrub_abort: TIMEOUT=500 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:399: _scrub_abort: wait_for_scrub 1.0 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:46.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:46.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:46.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:46.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:46.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:46.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:46.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:47.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:47.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:47.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:47.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:47.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:47.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:47.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:47.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:47.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:48.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:48.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:48.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:48.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:48.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:48.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:48.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:49.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:49.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:50.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:50.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:50.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:50.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:50.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:50.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:50.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:50.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:50.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:51.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:51.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:51.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:51.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:51.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:51.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:51.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:51.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:51.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:52.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:52.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:52.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:52.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:53.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:53.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:53.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:53.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:53.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:53.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:53.586 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:53.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:53.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:54.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:54.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:54.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:54.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:54.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:54.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:54.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:54.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:55.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:55.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:55.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:55.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:55.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:55.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:55.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:56.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:56.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:57.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:57.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:57.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:57.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:57.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:57.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:57.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:57.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:57.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:58.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:58.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:58.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:58.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:58.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:58.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:58.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:58.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:58.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:52:59.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:52:59.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:52:59.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:52:59.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:52:59.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:52:59.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:52:59.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:52:59.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:52:59.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:00.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:00.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:00.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:00.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:00.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:00.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:00.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:01.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:01.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:01.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:01.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:02.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:02.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:02.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:02.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:02.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:02.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:02.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:03.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:03.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:04.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:04.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:05.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:05.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:05.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:05.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:05.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:05.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:05.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:05.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:05.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:06.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:06.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:06.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:06.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:06.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:06.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:06.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:06.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:07.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:07.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:07.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:07.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:07.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:07.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:07.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:07.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:07.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:08.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:08.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:08.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:08.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:08.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:08.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:08.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:08.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:08.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:09.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:09.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:10.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:10.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:11.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:11.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:11.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:11.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:11.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:11.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:11.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:11.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:11.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:12.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:12.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:12.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:12.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:12.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:12.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:12.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:12.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:12.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:13.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:13.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:13.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:13.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:13.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:13.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:13.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:13.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:13.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:14.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:14.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:14.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:14.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:14.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:14.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:14.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:14.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:15.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:15.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:15.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:15.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:16.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:16.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:16.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:16.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:16.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:16.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:17.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:17.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:18.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:18.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:18.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:18.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:18.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:18.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:18.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:18.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:18.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:19.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:19.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:19.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:19.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:19.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:19.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:19.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:19.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:19.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:20.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:20.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:20.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:20.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:20.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:20.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:20.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:20.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:21.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:21.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:21.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:21.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:21.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:21.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:21.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:21.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:21.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:22.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:22.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:22.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:22.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:22.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:22.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:22.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:22.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:22.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:23.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:23.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:23.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:23.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:23.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:23.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:23.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:24.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:24.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:25.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:25.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:25.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:25.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:25.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:25.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:25.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:25.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:25.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:26.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:26.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:26.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:26.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:26.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:26.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:26.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:26.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:26.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:27.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:27.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:27.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:27.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:27.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:27.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:27.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:27.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:27.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:28.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:28.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:28.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:28.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:28.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:28.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:28.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:28.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:28.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:29.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:29.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:29.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:29.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:29.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:29.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:29.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:29.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:29.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:30.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:30.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:30.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:30.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:30.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:30.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:30.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:31.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:31.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:32.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:32.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:32.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:32.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:32.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:32.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:32.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:32.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:32.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:33.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:33.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:33.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:33.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:33.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:33.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:33.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:33.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:33.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:34.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:34.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:34.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:34.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:34.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:34.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:34.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:34.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:34.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:35.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:35.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:35.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:35.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:35.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:35.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:35.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:35.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:35.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:36.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:36.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:36.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:36.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:36.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:36.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:36.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:36.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:36.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:37.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:37.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:37.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:37.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:37.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:37.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:37.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:38.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:38.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:39.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:39.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:39.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:39.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:39.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:39.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:39.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:39.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:39.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:40.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:40.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:40.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:40.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:40.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:40.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:40.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:41.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:41.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:41.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:41.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:41.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:41.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:41.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:41.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:41.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:42.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:42.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:42.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:42.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:42.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:42.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:42.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:42.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:42.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:43.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:43.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:43.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:43.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:43.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:43.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:43.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:43.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:43.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:44.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:44.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:44.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:44.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:44.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:44.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:44.889 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:45.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:45.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:46.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:46.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:46.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:46.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:46.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:46.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:46.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:46.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:46.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:47.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:47.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:47.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:47.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:47.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:47.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:47.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:47.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:47.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:48.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:48.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:48.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:48.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:48.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:48.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:48.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:49.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:49.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:49.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:49.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:49.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:49.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:49.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:49.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:49.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:50.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:50.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:50.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:50.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:50.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:50.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:50.715 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:50.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:50.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:51.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:51.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:51.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:51.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:51.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:51.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:51.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:52.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:52.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:53.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:53.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:53.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:53.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:53.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:53.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:53.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:53.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:53.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:54.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:54.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:54.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:54.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:54.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:54.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:54.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:54.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:54.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:55.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:55.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:55.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:55.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:55.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:55.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:55.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:55.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:55.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:56.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:56.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:56.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:56.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:56.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:56.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:56.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:56.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:56.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:57.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:57.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:57.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:57.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:57.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:57.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:57.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:57.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:57.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:53:58.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:53:58.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:53:59.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:53:59.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:00.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:00.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:00.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:00.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:00.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:00.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:00.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:00.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:00.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:01.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:01.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:01.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:01.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:01.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:01.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:01.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:01.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:01.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:02.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:02.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:02.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:02.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:02.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:02.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:02.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:02.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:02.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:03.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:03.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:03.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:03.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:03.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:03.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:03.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:03.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:03.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:04.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:04.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:04.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:04.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:04.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:04.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:04.712 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:04.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:04.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:05.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:05.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:06.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:06.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:07.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:07.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:07.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:07.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:07.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:07.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:07.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:07.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:07.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:08.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:08.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:08.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:08.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:08.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:08.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:08.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:08.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:08.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:09.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:09.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:09.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:09.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:09.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:09.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:09.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:09.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:09.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:10.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:10.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:10.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:10.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:10.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:11.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:11.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:11.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:11.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:11.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:12.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:12.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:12.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:12.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:12.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:12.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:12.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:13.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:13.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:14.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:14.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:14.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:14.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:15.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:15.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:15.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:15.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:15.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:15.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:15.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:15.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:16.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:16.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:16.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:16.390 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:16.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:16.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:16.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:16.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:16.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:17.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:17.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:17.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:17.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:17.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:17.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:17.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:17.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:17.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:18.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:18.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:18.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:18.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:18.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:19.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:19.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:19.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:19.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:19.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:19.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:19.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:20.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:21.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:21.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:21.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:21.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:21.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:21.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:21.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:21.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:21.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:22.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:22.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:22.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:22.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:22.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:22.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:22.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:23.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:23.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:23.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:23.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:23.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:23.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:23.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:23.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:23.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:24.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:24.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:24.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:24.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:24.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:24.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:24.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:24.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:24.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:25.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:25.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:25.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:25.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:25.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:25.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:25.722 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:25.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:25.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:26.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:26.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:26.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:26.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:26.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:26.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:26.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:27.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:27.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:28.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:28.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:28.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:28.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:28.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:28.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:28.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:28.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:28.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:29.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:29.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:29.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:29.226 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:29.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:29.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:29.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:29.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:29.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:30.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:30.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:30.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:30.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:30.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:30.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:30.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:30.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:30.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:31.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:31.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:31.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:31.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:31.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:31.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:31.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:31.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:31.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:32.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:32.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:32.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:32.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:32.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:32.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:32.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:32.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:32.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:33.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:33.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:33.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:33.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:33.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:33.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:33.904 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:34.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:34.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:35.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:35.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:35.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:35.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:35.075 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:35.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:35.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:36.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:36.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:36.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:36.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:36.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:36.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:36.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:36.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:37.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:37.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:37.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:37.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:37.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:38.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:38.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:38.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:38.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:38.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:38.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:38.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:39.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:39.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:39.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:39.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:39.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:39.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:39.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:39.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:39.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:40.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:40.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:40.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:40.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:40.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:40.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:40.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:42.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:42.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:42.084 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:42.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:42.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:43.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:43.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:43.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:43.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:43.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:43.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:43.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:43.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:43.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:44.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:44.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:44.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:44.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:44.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:44.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:44.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:44.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:44.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:45.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:45.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:45.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:45.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:45.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:45.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:45.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:45.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:46.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:46.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:46.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:46.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:46.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:46.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:46.755 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:46.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:46.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:47.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:47.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:47.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:47.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:47.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:47.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:47.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:48.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:48.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:49.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:49.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:49.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:49.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:49.089 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:49.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:49.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:49.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:49.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:50.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:50.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:50.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:50.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:50.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:50.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:50.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:50.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:50.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:51.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:51.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:51.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:51.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:51.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:51.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:51.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:51.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:51.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:52.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:52.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:52.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:52.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:52.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:52.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:52.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:52.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:52.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:53.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:53.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:53.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:53.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:53.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:53.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:53.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:53.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:53.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:54.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:54.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:54.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:54.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:54.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:54.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:54.940 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:55.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:55.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:56.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:56.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:56.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:56.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:56.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:56.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:56.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:57.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:57.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:57.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:57.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:58.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:58.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:58.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:58.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:58.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:58.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:58.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:58.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:58.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:54:59.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:54:59.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:54:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:54:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:54:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:54:59.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:54:59.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:54:59.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:54:59.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:00.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:00.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:00.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:00.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:00.788 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:00.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:00.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:00.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:00.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:01.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:01.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:01.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:01.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:01.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:01.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:01.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:02.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:02.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:03.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:03.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:03.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:03.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:03.117 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:03.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:03.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:03.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:03.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:04.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:04.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:04.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:04.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:04.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:04.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:04.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:04.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:04.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:05.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:05.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:05.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:05.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:05.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:05.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:05.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:05.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:06.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:06.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:06.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:06.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:06.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:06.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:06.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:06.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:06.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:07.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:07.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:07.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:07.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:07.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:07.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:07.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:07.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:07.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:08.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:08.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:08.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:08.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:08.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:08.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:08.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:09.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:09.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:10.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:10.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:10.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:10.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:10.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:10.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:10.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:10.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:10.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:11.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:11.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:11.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:11.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:11.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:11.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:11.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:11.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:11.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:12.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:12.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:12.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:12.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:12.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:12.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:12.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:12.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:12.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:13.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:13.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:13.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:13.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:13.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:13.614 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:13.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:13.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:14.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:14.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:14.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:14.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:14.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:14.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:14.785 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:14.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:14.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:15.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:15.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:15.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:15.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:15.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:15.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:15.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:16.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:16.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:17.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:17.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:17.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:17.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:17.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:17.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:17.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:17.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:17.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:18.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:18.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:18.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:18.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:18.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:18.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:18.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:18.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:19.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:19.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:19.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:19.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:19.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:19.458 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:19.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:19.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:20.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:20.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:20.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:20.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:20.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:20.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:20.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:20.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:20.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:21.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:21.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:21.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:21.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:21.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:21.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:21.795 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:21.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:21.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:22.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:22.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:22.961 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:23.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:23.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:24.129 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:24.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:24.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:24.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:25.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:25.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:25.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:25.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:25.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:25.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:25.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:25.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:25.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:26.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:26.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:26.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:26.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:26.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:26.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:26.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:26.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:26.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:27.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:27.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:27.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:27.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:27.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:27.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:27.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:27.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:27.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:28.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:28.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:28.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:28.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:28.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:28.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:28.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:28.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:28.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:29.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:29.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:29.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:29.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:29.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:29.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:29.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:30.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:30.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:31.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:31.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:31.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:31.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:31.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:31.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:31.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:31.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:31.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:32.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:32.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:32.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:32.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:32.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:32.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:32.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:32.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:32.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:33.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:33.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:33.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:33.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:33.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:33.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:33.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:33.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:33.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:34.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:34.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:34.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:34.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:34.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:35.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:35.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:35.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:35.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:35.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:35.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:35.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:35.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:35.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:36.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:36.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:36.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:36.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:36.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:36.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:36.972 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:37.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:38.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:38.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:38.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:38.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:38.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:38.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:38.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:38.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:38.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:39.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:39.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:39.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:39.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:39.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:39.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:39.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:39.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:40.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:40.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:40.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:40.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:40.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:40.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:40.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:40.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:40.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:41.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:41.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:41.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:41.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:41.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:41.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:41.644 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:41.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:41.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:42.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:42.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:42.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:42.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:42.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:43.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:43.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:43.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:43.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:43.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:43.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:43.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:44.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:44.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:45.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:45.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:45.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:45.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:45.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:45.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:45.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:45.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:45.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:46.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:46.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:46.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:46.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:46.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:47.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:47.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:47.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:47.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:47.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:47.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:47.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:47.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:47.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:48.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:48.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:48.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:48.645 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:48.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:48.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:48.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:48.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:48.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:49.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:49.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:49.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:49.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:49.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:49.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:49.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:49.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:49.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:50.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:50.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:50.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:50.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:50.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:50.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:50.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:51.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:51.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:52.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:52.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:52.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:52.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:52.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:52.145 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:52.146 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:52.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:52.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:53.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:53.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:53.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:53.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:53.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:53.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:53.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:53.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:53.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:54.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:54.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:54.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:54.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:54.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:54.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:54.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:54.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:54.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:55.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:55.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:55.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:55.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:55.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:55.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:55.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:55.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:55.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:56.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:56.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:56.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:56.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:56.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:56.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:56.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:56.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:56.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:57.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:57.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:57.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:57.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:57.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:57.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:57.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:58.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:58.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:55:59.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:55:59.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:55:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:55:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:55:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:55:59.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:55:59.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:55:59.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:55:59.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:00.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:00.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:00.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:00.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:00.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:00.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:00.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:00.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:00.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:01.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:01.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:01.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:01.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:01.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:01.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:01.484 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:02.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:02.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:02.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:02.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:02.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:02.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:02.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:02.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:02.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:03.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:03.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:03.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:03.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:03.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:03.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:03.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:03.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:03.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:04.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:04.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:04.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:04.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:04.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:05.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:05.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:06.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:06.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:06.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:06.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:06.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:07.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:07.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:07.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:07.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:07.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:07.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:07.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:07.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:07.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:08.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:08.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:08.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:08.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:08.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:08.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:08.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:08.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:08.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:09.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:09.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:09.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:09.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:09.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:09.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:09.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:09.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:09.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:10.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:10.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:10.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:10.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:10.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:10.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:10.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:10.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:10.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:11.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:11.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:11.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:11.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:11.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:11.981 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:11.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:12.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:12.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:13.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:13.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:13.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:13.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:13.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:13.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:14.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:14.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:14.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:14.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:14.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:14.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:14.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:14.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:14.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:15.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:15.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:15.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:15.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:15.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:15.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:15.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:15.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:15.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:16.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:16.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:16.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:16.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:16.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:17.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:17.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:17.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:17.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:17.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:17.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:17.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:17.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:17.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:18.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:18.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:18.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:18.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:18.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:18.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:18.987 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:19.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:19.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:20.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:20.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:20.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:20.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:20.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:20.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:21.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:21.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:21.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:21.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:21.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:21.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:21.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:21.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:21.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:22.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:22.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:22.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:22.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:22.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:22.487 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:22.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:22.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:23.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:23.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:23.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:23.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:23.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:23.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:23.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:23.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:24.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:24.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:24.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:24.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:24.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:24.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:24.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:24.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:24.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:25.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:25.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:25.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:25.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:25.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:25.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:25.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:26.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:26.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:27.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:27.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:27.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:27.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:27.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:27.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:27.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:27.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:27.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:28.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:28.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:28.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:28.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:28.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:28.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:28.334 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:28.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:28.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:29.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:29.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:29.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:29.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:29.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:29.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:29.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:29.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:29.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:30.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:30.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:30.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:30.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:30.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:30.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:30.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:30.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:30.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:31.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:31.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:31.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:31.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:31.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:31.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:31.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:31.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:31.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:32.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:32.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:32.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:32.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:32.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:32.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:32.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:33.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:33.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:34.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:34.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:34.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:34.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:34.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:34.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:34.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:34.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:34.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:35.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:35.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:35.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:35.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:35.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:35.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:35.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:35.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:35.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:36.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:36.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:36.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:36.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:36.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:36.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:36.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:36.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:36.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:37.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:37.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:37.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:37.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:37.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:37.654 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:37.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:37.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:38.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:38.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:38.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:38.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:38.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:38.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:38.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:38.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:39.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:39.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:39.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:39.985 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:39.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:39.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:40.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:40.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:41.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:41.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:41.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:41.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:41.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:41.153 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:41.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:42.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:42.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:42.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:42.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:42.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:42.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:42.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:42.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:43.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:43.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:43.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:43.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:43.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:43.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:43.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:43.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:43.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:44.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:44.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:44.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:44.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:44.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:44.652 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:44.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:44.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:44.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:45.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:45.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:45.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:45.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:45.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:45.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:45.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:45.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:45.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:46.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:46.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:46.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:46.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:46.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:46.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:46.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:47.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:47.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:48.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:48.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:48.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:48.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:48.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:48.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:48.161 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:48.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:48.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:49.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:49.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:49.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:49.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:49.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:49.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:49.329 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:49.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:49.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:50.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:50.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:50.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:50.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:50.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:50.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:50.501 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:50.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:50.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:51.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:51.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:51.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:51.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:51.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:51.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:51.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:51.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:51.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:52.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:52.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:52.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:52.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:52.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:52.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:52.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:52.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:52.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:54.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:54.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:54.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:54.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:54.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:54.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:54.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:54.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:55.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:55.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:55.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:55.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:55.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:55.170 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:55.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:55.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:55.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:56.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:56.336 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:56.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:56.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:56.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:56.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:56.337 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:57.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:57.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:57.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:57.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:57.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:57.503 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:57.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:57.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:57.668 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:58.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:58.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:58.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:58.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:58.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:58.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:58.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:56:58.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:56:58.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:56:59.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:56:59.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:56:59.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:56:59.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:56:59.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:56:59.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:56:59.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:00.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:00.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:01.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:01.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:01.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:01.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:01.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:01.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:02.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:02.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:02.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:02.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:03.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:03.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:03.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:04.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:04.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:04.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:04.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:04.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:04.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:04.515 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:04.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:04.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:05.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:05.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:05.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:05.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:05.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:05.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:06.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:06.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:06.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:06.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:06.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:06.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:06.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:07.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:07.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:08.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:08.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:08.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:08.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:08.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:08.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:08.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:08.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:08.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:09.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:09.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:09.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:09.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:09.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:09.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:09.186 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:09.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:09.352 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:10.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:10.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:10.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:10.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:10.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:10.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:10.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:10.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:10.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:11.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:11.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:11.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:11.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:11.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:11.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:11.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:11.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:12.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:12.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:12.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:12.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:12.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:12.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:12.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:12.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:12.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:13.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:13.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:13.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:13.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:13.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:13.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:13.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:14.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:14.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:15.021 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:15.021 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:15.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:15.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:15.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:15.022 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:15.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:15.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:16.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:16.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:16.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:16.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:16.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:16.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:16.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:16.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:17.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:17.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:17.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:17.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:17.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:17.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:17.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:17.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:17.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:18.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:18.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:18.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:18.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:18.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:18.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:18.528 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:18.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:18.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:19.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:19.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:19.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:19.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:19.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:19.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:19.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:19.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:19.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:20.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:20.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:20.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:20.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:20.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:20.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:20.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:21.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:21.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:22.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:22.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:22.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:22.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:22.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:22.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:22.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:22.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:23.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:23.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:23.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:23.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:23.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:23.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:23.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:23.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:23.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:24.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:24.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:24.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:24.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:24.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:24.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:24.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:24.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:24.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:25.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:25.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:25.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:25.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:25.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:25.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:25.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:25.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:25.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:26.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:26.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:26.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:26.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:26.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:26.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:26.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:26.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:26.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:27.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:27.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:27.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:27.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:27.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:27.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:27.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:28.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:28.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:29.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:29.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:29.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:29.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:29.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:29.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:29.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:30.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:30.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:30.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:30.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:30.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:30.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:30.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:30.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:30.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:31.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:31.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:31.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:31.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:31.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:31.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:31.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:31.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:31.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:32.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:32.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:32.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:32.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:32.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:32.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:32.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:32.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:32.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:33.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:33.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:33.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:33.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:33.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:33.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:33.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:33.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:33.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:34.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:34.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:34.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:34.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:34.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:34.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:34.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:35.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:35.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:36.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:36.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:36.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:36.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:37.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:37.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:37.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:38.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:38.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:38.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:38.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:38.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:38.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:38.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:38.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:38.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:39.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:39.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:39.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:39.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:39.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:39.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:39.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:39.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:39.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:40.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:40.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:40.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:40.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:40.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:41.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:41.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:41.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:41.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:41.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:41.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:41.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:42.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:42.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:43.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:43.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:43.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:43.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:43.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:44.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:44.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:44.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:44.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:44.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:44.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:44.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:44.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:44.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:45.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:45.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:45.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:45.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:45.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:45.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:45.387 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:45.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:45.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:46.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:46.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:46.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:46.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:46.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:46.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:46.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:46.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:46.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:47.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:47.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:47.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:47.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:47.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:47.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:47.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:47.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:47.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:48.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:48.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:48.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:48.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:48.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:48.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:48.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:49.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:49.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:50.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:50.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:50.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:50.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:50.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:50.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:50.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:50.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:50.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:51.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:51.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:51.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:51.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:51.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:51.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:51.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:51.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:51.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:52.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:52.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:52.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:52.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:52.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:52.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:52.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:52.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:52.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:53.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:53.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:53.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:53.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:53.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:53.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:53.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:53.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:53.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:54.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:54.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:54.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:54.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:54.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:54.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:54.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:54.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:54.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:55.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:55.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:55.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:55.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:55.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:56.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:56.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:57.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:57.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:58.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:58.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:58.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:58.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:58.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:58.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:58.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:58.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:58.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:57:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:57:59.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:57:59.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:57:59.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:57:59.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:57:59.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:57:59.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:57:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:57:59.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:00.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:00.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:00.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:00.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:00.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:00.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:00.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:00.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:00.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:01.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:01.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:01.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:01.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:01.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:01.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:01.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:01.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:01.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:02.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:02.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:03.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:03.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:04.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:04.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:04.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:04.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:04.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:04.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:04.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:04.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:04.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:05.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:05.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:05.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:05.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:05.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:05.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:05.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:05.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:06.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:06.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:06.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:06.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:06.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:06.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:06.405 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:06.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:06.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:07.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:07.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:07.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:07.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:07.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:07.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:07.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:07.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:08.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:08.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:08.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:08.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:09.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:09.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:09.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:09.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:09.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:09.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:09.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:10.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:10.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:11.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:11.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:11.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:12.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:12.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:12.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:12.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:12.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:13.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:13.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:13.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:13.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:13.393 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:13.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:13.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:13.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:13.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:14.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:14.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:14.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:14.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:14.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:14.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:14.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:14.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:14.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:15.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:15.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:15.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:15.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:15.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:15.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:15.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:15.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:16.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:16.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:16.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:16.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:16.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:16.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:16.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:17.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:17.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:18.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:18.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:18.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:18.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:18.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:18.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:18.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:18.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:18.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:19.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:19.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:19.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:19.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:19.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:19.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:20.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:20.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:20.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:20.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:20.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:20.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:20.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:21.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:21.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:21.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:21.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:21.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:21.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:21.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:21.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:21.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:22.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:22.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:22.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:22.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:22.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:22.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:22.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:23.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:23.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:23.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:23.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:23.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:23.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:23.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:24.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:24.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:25.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:25.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:25.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:25.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:25.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:26.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:26.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:26.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:26.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:26.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:26.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:26.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:26.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:26.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:27.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:27.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:27.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:27.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:27.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:27.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:27.403 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:27.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:27.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:28.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:28.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:28.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:28.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:28.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:28.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:28.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:28.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:28.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:29.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:29.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:29.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:29.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:29.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:29.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:29.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:29.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:29.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:30.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:30.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:30.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:30.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:30.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:30.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:30.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:31.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:31.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:32.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:32.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:32.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:32.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:32.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:32.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:32.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:33.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:33.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:33.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:33.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:33.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:34.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:34.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:34.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:34.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:34.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:34.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:34.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:34.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:34.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:35.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:35.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:35.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:35.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:36.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:36.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:36.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:36.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:36.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:36.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:36.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:36.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:36.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:37.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:37.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:37.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:37.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:37.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:37.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:37.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:38.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:38.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:39.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:39.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:39.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:39.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:40.262 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:40.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:40.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:41.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:41.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:41.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:41.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:41.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:41.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:41.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:42.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:42.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:42.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:42.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:42.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:42.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:42.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:42.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:42.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:43.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:43.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:43.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:43.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:43.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:43.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:43.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:43.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:43.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:44.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:44.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:44.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:44.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:45.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:46.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:46.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:46.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:46.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:46.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:46.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:46.102 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:46.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:46.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:47.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:47.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:47.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:47.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:47.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:47.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:47.272 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:47.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:47.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:48.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:48.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:48.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:48.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:48.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:48.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:48.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:48.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:48.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:49.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:49.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:49.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:49.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:49.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:49.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:49.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:49.776 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:50.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:50.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:50.778 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:50.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:50.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:50.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:50.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:50.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:50.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:51.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:51.942 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:51.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:51.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:51.942 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:51.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:51.943 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:52.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:52.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:53.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:53.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:53.109 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:53.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:53.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:53.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:53.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:53.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:53.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:54.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:54.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:54.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:54.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:55.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:55.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:55.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:55.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:55.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:55.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:55.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:50:18.474795+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:55.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T04:58:56.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T04:58:56.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T04:58:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T04:58:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T04:58:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T04:58:56.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T04:58:56.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T04:58:56.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T04:58:54.056969+0000 '>' 2026-02-17T04:50:18.474795+0000 2026-02-17T04:58:56.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T04:58:56.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:400: _scrub_abort: perf_counters td/osd-scrub-test 3 2026-02-17T04:58:56.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T04:58:56.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T04:58:56.773 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T04:58:56.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T04:58:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:58:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T04:58:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.831 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.832 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T04:58:56.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:58:56.891 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:58:56.891 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:58:56.891 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.891 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.891 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.892 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 67, 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.893 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.894 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.895 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:58:56.896 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:58:56.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:58:56.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T04:58:56.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.948 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.949 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.950 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.951 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:58:56.952 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:58:56.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_deep_scrub_abort ------------------' 2026-02-17T04:58:56.954 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_deep_scrub_abort ------------------ 2026-02-17T04:58:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T04:58:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:58:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:58:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:58:56.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:58:56.956 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:58:56.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:58:56.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:58:56.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:58:57.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:58:57.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:58:57.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:58:57.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:58:57.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:58:57.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:58:57.059 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:58:57.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:58:57.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:58:57.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:58:57.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:58:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:58:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:58:57.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:58:57.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:58:57.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:58:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:58:57.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:58:57.128 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_deep_scrub_abort ------------------ 2026-02-17T04:58:57.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_deep_scrub_abort ------------------' 2026-02-17T04:58:57.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T04:58:57.129 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_dump_scrub_schedule ------------------- 2026-02-17T04:58:57.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_dump_scrub_schedule -------------------' 2026-02-17T04:58:57.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T04:58:57.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T04:58:57.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:58:57.131 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:58:57.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:58:57.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:58:57.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:58:57.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:58:57.133 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:58:57.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:58:57.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:58:57.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:58:57.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:58:57.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:58:57.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:58:57.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:58:57.136 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:58:57.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:58:57.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:58:57.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:58:57.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T04:58:57.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:58:57.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T04:58:57.140 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:58:57.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:58:57.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:58:57.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T04:58:57.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_dump_scrub_schedule -----------------------' 2026-02-17T04:58:57.142 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_dump_scrub_schedule ----------------------- 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_dump_scrub_schedule td/osd-scrub-test 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:530: TEST_dump_scrub_schedule: local dir=td/osd-scrub-test 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:531: TEST_dump_scrub_schedule: local poolname=test 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:532: TEST_dump_scrub_schedule: local OSDS=3 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:533: TEST_dump_scrub_schedule: local objects=90 2026-02-17T04:58:57.143 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:535: TEST_dump_scrub_schedule: TESTDATA=testdata.897552 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:537: TEST_dump_scrub_schedule: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T04:58:57.144 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T04:58:57.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:58:57.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:58:57.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:58:57.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:58:57.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.160 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.160 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:57.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T04:58:57.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:58:57.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:58:57.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:58:57.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:58:57.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:58:57.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:58:57.186 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:58:57.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T04:58:57.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.232 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.233 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:58:57.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:58:57.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:538: TEST_dump_scrub_schedule: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T04:58:57.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:57.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:58:57.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T04:58:57.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:552: TEST_dump_scrub_schedule: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-17T04:58:57.373 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: expr 3 - 1 2026-02-17T04:58:57.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: seq 0 2 2026-02-17T04:58:57.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:58:57.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 0 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:58:57.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:58:57.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:58:57.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:58:57.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:58:57.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eadb38d8-dcbc-400a-baa7-4a6a0c1c7422 2026-02-17T04:58:57.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 eadb38d8-dcbc-400a-baa7-4a6a0c1c7422' 2026-02-17T04:58:57.382 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 eadb38d8-dcbc-400a-baa7-4a6a0c1c7422 2026-02-17T04:58:57.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:58:57.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCR9ZNpaNQHFxAAyGenPJ1o+c+lAYXhuSyZ6Q== 2026-02-17T04:58:57.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCR9ZNpaNQHFxAAyGenPJ1o+c+lAYXhuSyZ6Q=="}' 2026-02-17T04:58:57.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eadb38d8-dcbc-400a-baa7-4a6a0c1c7422 -i td/osd-scrub-test/0/new.json 2026-02-17T04:58:57.466 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:58:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T04:58:57.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQCR9ZNpaNQHFxAAyGenPJ1o+c+lAYXhuSyZ6Q== --osd-uuid eadb38d8-dcbc-400a-baa7-4a6a0c1c7422 2026-02-17T04:58:57.490 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:57.488+0000 7f9d57648780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:57.491 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:57.490+0000 7f9d57648780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:57.492 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:57.491+0000 7f9d57648780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:57.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:57.491+0000 7f9d57648780 -1 bdev(0x4352c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:58:57.493 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:57.491+0000 7f9d57648780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T04:58:57.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T04:58:57.916 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:58:57.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:58:57.917 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:58:57.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:58:57.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:58:57.999 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:58:57.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:58:57.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:58:57.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:58:58.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:58:58.017 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:58.015+0000 7f76ce3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:58.018 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:58.017+0000 7f76ce3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:58.019 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:58.018+0000 7f76ce3d4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:58:58.080 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:58:58.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:58:58.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:58:58.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:58:58.230 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:58.229+0000 7f76ce3d4780 -1 Falling back to public interface 2026-02-17T04:58:58.643 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:58.642+0000 7f76ce3d4780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:58:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:58:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:58:59.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:58:59.160 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:58:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:58:59.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:58:59.239 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3723109483,v1:127.0.0.1:6801/3723109483] [v2:127.0.0.1:6802/3723109483,v1:127.0.0.1:6803/3723109483] exists,up eadb38d8-dcbc-400a-baa7-4a6a0c1c7422 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 1 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:58:59.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:58:59.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:58:59.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e18130f5-573c-4f23-b9d3-8ce0645dad7b 2026-02-17T04:58:59.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e18130f5-573c-4f23-b9d3-8ce0645dad7b' 2026-02-17T04:58:59.247 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e18130f5-573c-4f23-b9d3-8ce0645dad7b 2026-02-17T04:58:59.247 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:58:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCT9ZNpdRIHDxAA19GIZqghx3NUQH8AgobR8Q== 2026-02-17T04:58:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCT9ZNpdRIHDxAA19GIZqghx3NUQH8AgobR8Q=="}' 2026-02-17T04:58:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e18130f5-573c-4f23-b9d3-8ce0645dad7b -i td/osd-scrub-test/1/new.json 2026-02-17T04:58:59.333 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:58:59.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T04:58:59.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQCT9ZNpdRIHDxAA19GIZqghx3NUQH8AgobR8Q== --osd-uuid e18130f5-573c-4f23-b9d3-8ce0645dad7b 2026-02-17T04:58:59.360 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.358+0000 7f9963422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:59.361 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.360+0000 7f9963422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:59.362 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.361+0000 7f9963422780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:59.363 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.361+0000 7f9963422780 -1 bdev(0x33d2c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:58:59.363 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.361+0000 7f9963422780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T04:58:59.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T04:58:59.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:58:59.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:58:59.724 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:58:59.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:58:59.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:58:59.934 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:58:59.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:58:59.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:58:59.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:58:59.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:58:59.951 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.949+0000 7f889480a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:59.952 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.951+0000 7f889480a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:58:59.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:58:59.952+0000 7f889480a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:00.086 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:00.084+0000 7f889480a780 -1 Falling back to public interface 2026-02-17T04:59:00.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:59:00.098 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:59:00.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:00.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:59:00.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:59:00.405 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:00.403+0000 7f889480a780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:59:01.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:59:01.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:01.265 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:59:01.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:59:01.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:01.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:59:01.430 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2418284911,v1:127.0.0.1:6811/2418284911] [v2:127.0.0.1:6812/2418284911,v1:127.0.0.1:6813/2418284911] exists,up e18130f5-573c-4f23-b9d3-8ce0645dad7b 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 2 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:59:01.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T04:59:01.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:59:01.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:59:01.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2cbdb1c2-406b-4524-8daf-c9df80e2b0c6 2026-02-17T04:59:01.438 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 2cbdb1c2-406b-4524-8daf-c9df80e2b0c6 2026-02-17T04:59:01.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2cbdb1c2-406b-4524-8daf-c9df80e2b0c6' 2026-02-17T04:59:01.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:59:01.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCV9ZNplb5qGhAA/ngA5qhzErYgiw/O5covDw== 2026-02-17T04:59:01.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCV9ZNplb5qGhAA/ngA5qhzErYgiw/O5covDw=="}' 2026-02-17T04:59:01.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2cbdb1c2-406b-4524-8daf-c9df80e2b0c6 -i td/osd-scrub-test/2/new.json 2026-02-17T04:59:01.607 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T04:59:01.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T04:59:01.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQCV9ZNplb5qGhAA/ngA5qhzErYgiw/O5covDw== --osd-uuid 2cbdb1c2-406b-4524-8daf-c9df80e2b0c6 2026-02-17T04:59:01.635 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:01.633+0000 7fdb98471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:01.636 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:01.635+0000 7fdb98471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:01.637 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:01.636+0000 7fdb98471780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:01.638 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:01.636+0000 7fdb98471780 -1 bdev(0x37aac00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T04:59:01.638 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:01.636+0000 7fdb98471780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T04:59:01.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T04:59:01.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:59:01.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T04:59:01.959 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T04:59:01.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:59:02.180 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T04:59:02.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T04:59:02.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-17T04:59:02.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:59:02.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:59:02.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:59:02.198 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:02.197+0000 7f42327fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:02.200 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:02.198+0000 7f42327fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:02.201 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:02.199+0000 7f42327fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:02.326 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:02.324+0000 7f42327fd780 -1 Falling back to public interface 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:02.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:59:02.350 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:59:02.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:02.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:59:02.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:59:02.595 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:02.593+0000 7f42327fd780 -1 osd.2 0 log_to_monitors true 2026-02-17T04:59:03.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:59:03.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:03.512 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:59:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:59:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:03.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T04:59:03.675 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1274896591,v1:127.0.0.1:6819/1274896591] [v2:127.0.0.1:6820/1274896591,v1:127.0.0.1:6821/1274896591] exists,up 2cbdb1c2-406b-4524-8daf-c9df80e2b0c6 2026-02-17T04:59:03.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:59:03.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:59:03.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:59:03.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:560: TEST_dump_scrub_schedule: create_pool test 1 1 2026-02-17T04:59:03.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:59:03.889 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:59:03.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:561: TEST_dump_scrub_schedule: wait_for_clean 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:59:04.899 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:59:04.900 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:59:04.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:59:04.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:59:04.900 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T04:59:04.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:59:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:59:05.150 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T04:59:05.150 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T04:59:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:59:05.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:59:05.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T04:59:05.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T04:59:05.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T04:59:05.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T04:59:05.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:59:05.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T04:59:05.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T04:59:05.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T04:59:05.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T04:59:05.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:59:05.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T04:59:05.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T04:59:05.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T04:59:05.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-60129542147' 2026-02-17T04:59:05.324 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:59:05.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T04:59:05.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:59:05.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:59:05.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T04:59:05.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:59:05.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T04:59:05.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T04:59:05.328 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T04:59:05.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:59:05.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T04:59:05.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:59:06.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T04:59:06.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:59:06.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T04:59:06.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:59:06.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T04:59:06.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:59:06.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:59:06.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T04:59:06.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:59:06.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T04:59:06.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T04:59:06.658 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T04:59:06.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:59:06.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T04:59:06.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:59:06.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T04:59:06.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:59:06.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T04:59:06.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T04:59:06.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:59:06.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T04:59:06.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T04:59:06.829 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T04:59:06.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T04:59:06.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T04:59:06.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:59:06.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:59:06.997 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:59:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:59:07.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:59:07.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:59:07.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:59:07.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:59:07.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:59:07.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:59:07.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:59:07.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:59:07.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:59:07.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:59:07.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:59:07.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:59:07.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:59:07.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:59:07.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: ceph osd dump 2026-02-17T04:59:07.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: grep '^pool.*['\'']test['\'']' 2026-02-17T04:59:07.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: awk '{ print $2 }' 2026-02-17T04:59:07.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: poolid=1 2026-02-17T04:59:07.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:564: TEST_dump_scrub_schedule: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T04:59:07.748 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:59:07.748 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:59:07.748 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.5225e-05 s, 29.3 MB/s 2026-02-17T04:59:07.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: seq 1 90 2026-02-17T04:59:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj1 testdata.897552 2026-02-17T04:59:07.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj2 testdata.897552 2026-02-17T04:59:07.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj3 testdata.897552 2026-02-17T04:59:07.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj4 testdata.897552 2026-02-17T04:59:07.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj5 testdata.897552 2026-02-17T04:59:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj6 testdata.897552 2026-02-17T04:59:07.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj7 testdata.897552 2026-02-17T04:59:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj8 testdata.897552 2026-02-17T04:59:07.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj9 testdata.897552 2026-02-17T04:59:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj10 testdata.897552 2026-02-17T04:59:07.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj11 testdata.897552 2026-02-17T04:59:07.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj12 testdata.897552 2026-02-17T04:59:07.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.941 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj13 testdata.897552 2026-02-17T04:59:07.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj14 testdata.897552 2026-02-17T04:59:07.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj15 testdata.897552 2026-02-17T04:59:07.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:07.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj16 testdata.897552 2026-02-17T04:59:08.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj17 testdata.897552 2026-02-17T04:59:08.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj18 testdata.897552 2026-02-17T04:59:08.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj19 testdata.897552 2026-02-17T04:59:08.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj20 testdata.897552 2026-02-17T04:59:08.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj21 testdata.897552 2026-02-17T04:59:08.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj22 testdata.897552 2026-02-17T04:59:08.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj23 testdata.897552 2026-02-17T04:59:08.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj24 testdata.897552 2026-02-17T04:59:08.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj25 testdata.897552 2026-02-17T04:59:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj26 testdata.897552 2026-02-17T04:59:08.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj27 testdata.897552 2026-02-17T04:59:08.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj28 testdata.897552 2026-02-17T04:59:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj29 testdata.897552 2026-02-17T04:59:08.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj30 testdata.897552 2026-02-17T04:59:08.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj31 testdata.897552 2026-02-17T04:59:08.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj32 testdata.897552 2026-02-17T04:59:08.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj33 testdata.897552 2026-02-17T04:59:08.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj34 testdata.897552 2026-02-17T04:59:08.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj35 testdata.897552 2026-02-17T04:59:08.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj36 testdata.897552 2026-02-17T04:59:08.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj37 testdata.897552 2026-02-17T04:59:08.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj38 testdata.897552 2026-02-17T04:59:08.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj39 testdata.897552 2026-02-17T04:59:08.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj40 testdata.897552 2026-02-17T04:59:08.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj41 testdata.897552 2026-02-17T04:59:08.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj42 testdata.897552 2026-02-17T04:59:08.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj43 testdata.897552 2026-02-17T04:59:08.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj44 testdata.897552 2026-02-17T04:59:08.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj45 testdata.897552 2026-02-17T04:59:08.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj46 testdata.897552 2026-02-17T04:59:08.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj47 testdata.897552 2026-02-17T04:59:08.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj48 testdata.897552 2026-02-17T04:59:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj49 testdata.897552 2026-02-17T04:59:08.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj50 testdata.897552 2026-02-17T04:59:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj51 testdata.897552 2026-02-17T04:59:08.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj52 testdata.897552 2026-02-17T04:59:08.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj53 testdata.897552 2026-02-17T04:59:08.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj54 testdata.897552 2026-02-17T04:59:08.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj55 testdata.897552 2026-02-17T04:59:08.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj56 testdata.897552 2026-02-17T04:59:08.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj57 testdata.897552 2026-02-17T04:59:08.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj58 testdata.897552 2026-02-17T04:59:08.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj59 testdata.897552 2026-02-17T04:59:08.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj60 testdata.897552 2026-02-17T04:59:08.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj61 testdata.897552 2026-02-17T04:59:08.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj62 testdata.897552 2026-02-17T04:59:08.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj63 testdata.897552 2026-02-17T04:59:08.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj64 testdata.897552 2026-02-17T04:59:08.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj65 testdata.897552 2026-02-17T04:59:08.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj66 testdata.897552 2026-02-17T04:59:08.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj67 testdata.897552 2026-02-17T04:59:08.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj68 testdata.897552 2026-02-17T04:59:08.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj69 testdata.897552 2026-02-17T04:59:08.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj70 testdata.897552 2026-02-17T04:59:08.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj71 testdata.897552 2026-02-17T04:59:08.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj72 testdata.897552 2026-02-17T04:59:08.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj73 testdata.897552 2026-02-17T04:59:08.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj74 testdata.897552 2026-02-17T04:59:08.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj75 testdata.897552 2026-02-17T04:59:08.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj76 testdata.897552 2026-02-17T04:59:08.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj77 testdata.897552 2026-02-17T04:59:08.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj78 testdata.897552 2026-02-17T04:59:08.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj79 testdata.897552 2026-02-17T04:59:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj80 testdata.897552 2026-02-17T04:59:08.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:08.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj81 testdata.897552 2026-02-17T04:59:09.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj82 testdata.897552 2026-02-17T04:59:09.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj83 testdata.897552 2026-02-17T04:59:09.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj84 testdata.897552 2026-02-17T04:59:09.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj85 testdata.897552 2026-02-17T04:59:09.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj86 testdata.897552 2026-02-17T04:59:09.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj87 testdata.897552 2026-02-17T04:59:09.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj88 testdata.897552 2026-02-17T04:59:09.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj89 testdata.897552 2026-02-17T04:59:09.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-17T04:59:09.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj90 testdata.897552 2026-02-17T04:59:09.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:569: TEST_dump_scrub_schedule: rm -f testdata.897552 2026-02-17T04:59:09.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:571: TEST_dump_scrub_schedule: local pgid=1.0 2026-02-17T04:59:09.151 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:573: TEST_dump_scrub_schedule: date +%Y-%m-%dT%H:%M:%S.%N%:z 2026-02-17T04:59:09.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:573: TEST_dump_scrub_schedule: local now_is=2026-02-17T04:59:09.152283965+00:00 2026-02-17T04:59:09.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:581: TEST_dump_scrub_schedule: expct_starting=(['query_active']='false' ['query_is_future']='true' ['query_schedule']='scrub scheduled') 2026-02-17T04:59:09.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:581: TEST_dump_scrub_schedule: declare -A expct_starting 2026-02-17T04:59:09.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:582: TEST_dump_scrub_schedule: declare -A sched_data 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:583: TEST_dump_scrub_schedule: extract_published_sch 1.0 2026-02-17T04:59:09.152283965+00:00 2019-10-12T20:32:43.645168+0000 sched_data 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.0 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sched_data 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-17T04:59:09.152283965+00:00 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2019-10-12T20:32:43.645168+0000 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-17T04:59:09.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-17T04:59:09.308 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:09.316 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 0, 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T04:59:03.888134+0000", 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 16, 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 12 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:09.317 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:03.888134+0000", 2026-02-17T04:59:09.373 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T04:59:03.888 (2026-02-18T04:59:03.888)", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:03.888134+0000", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T04:59:03.888134+0000", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:09.374 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T22:10:28.832799+0000", 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T22:10:28.832799+0000", 2026-02-17T04:59:09.375 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:09.376 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=17 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=107 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T04:59:03.888' 2026-02-17T04:59:09.432 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T04:59:03.888' 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=0 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T04:59:03.888134+0000' 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='0x0' 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=0 2026-02-17T04:59:09.433 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T04:59:03.888134+0000' 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=16 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=12 2026-02-17T04:59:09.434 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:09.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:584: TEST_dump_scrub_schedule: schedule_against_expected sched_data expct_starting initial 2026-02-17T04:59:09.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:178: schedule_against_expected: local -n dict=sched_data 2026-02-17T04:59:09.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:179: schedule_against_expected: local -n ep=expct_starting 2026-02-17T04:59:09.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:180: schedule_against_expected: local extr_dbg=1 2026-02-17T04:59:09.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:183: schedule_against_expected: local saved_echo_flag=x 2026-02-17T04:59:09.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:184: schedule_against_expected: set +x 2026-02-17T04:59:09.437 INFO:tasks.workunit.client.0.trial090.stdout:-- - comparing: 2026-02-17T04:59:09.437 INFO:tasks.workunit.client.0.trial090.stdout:key is query_schedule expected: scrub scheduled in actual: scrub scheduled 2026-02-17T04:59:09.437 INFO:tasks.workunit.client.0.trial090.stdout:key is query_is_future expected: true in actual: true 2026-02-17T04:59:09.437 INFO:tasks.workunit.client.0.trial090.stdout:key is query_active expected: false in actual: false 2026-02-17T04:59:09.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:203: schedule_against_expected: return 0 2026-02-17T04:59:09.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:585: TEST_dump_scrub_schedule: (( 0 == 0 )) 2026-02-17T04:59:09.438 INFO:tasks.workunit.client.0.trial090.stdout:last-scrub --- 0x0 2026-02-17T04:59:09.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:586: TEST_dump_scrub_schedule: echo 'last-scrub --- ' 0x0 2026-02-17T04:59:09.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:592: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-17T04:59:03.888134+0000 2026-02-17T04:59:09.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:593: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_scrub_sleep 0 2026-02-17T04:59:09.487 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:59:09.487 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:09.487 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:09.495 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:59:09.495 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:09.495 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:09.502 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:59:09.503 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:09.503 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:09.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:594: TEST_dump_scrub_schedule: ceph tell 1.0 deep-scrub 2026-02-17T04:59:09.556 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:09.556 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T04:59:09.556 INFO:tasks.workunit.client.0.trial090.stdout: "must": true, 2026-02-17T04:59:09.556 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "0.000000" 2026-02-17T04:59:09.556 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:09.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:599: TEST_dump_scrub_schedule: sleep 5 2026-02-17T04:59:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:600: TEST_dump_scrub_schedule: sched_data=() 2026-02-17T04:59:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:601: TEST_dump_scrub_schedule: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:601: TEST_dump_scrub_schedule: declare -A expct_qry_duration 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:602: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-17T04:59:03.888134+0000 expct_qry_duration 'WaitingAfterScrub ' sched_data 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-17T04:59:03.888134+0000 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_qry_duration 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T04:59:14.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T04:59:14.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T04:59:14.564 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (WaitingAfterScrub ): pg:1.0 dt:2026-02-17T04:59:03.888134+0000 (10 retries) 2026-02-17T04:59:15.223 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:15.232 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:15.232 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:15.232 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:15.232 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 17, 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 123 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:15.233 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:15.291 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:15.291 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T04:59:15.291 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T04:59:10.481 (2026-02-18T04:59:10.481)", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:15.292 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:15.293 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-23T05:31:50.300932+0000", 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-23T05:31:50.300932+0000", 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:15.294 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:15.295 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=17 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=125 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T04:59:15.352 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T04:59:10.481' 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T04:59:10.481' 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T04:59:10.481558+0000' 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:15.353 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T04:59:10.481558+0000' 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=17 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=123 2026-02-17T04:59:15.354 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:15.356 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ false / 125 / 123 / true / 2026-02-17T04:59:10.481558+0000 / scrub scheduled %%% query_last_duration_neg query_last_duration 2026-02-17T04:59:15.356 INFO:tasks.workunit.client.0.trial090.stdout:key is query_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-17T04:59:15.356 INFO:tasks.workunit.client.0.trial090.stdout:WaitingAfterScrub - 'query_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:604: TEST_dump_scrub_schedule: sched_data=() 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:605: TEST_dump_scrub_schedule: expct_dmp_duration=(['dmp_last_duration']='0' ['dmp_last_duration_neg']='not0') 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:605: TEST_dump_scrub_schedule: declare -A expct_dmp_duration 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:606: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-17T04:59:03.888134+0000 expct_dmp_duration 'WaitingAfterScrub_dmp ' sched_data 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-17T04:59:03.888134+0000 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_dmp_duration 2026-02-17T04:59:15.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-17T04:59:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T04:59:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T04:59:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T04:59:15.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T04:59:15.359 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (WaitingAfterScrub_dmp ): pg:1.0 dt:2026-02-17T04:59:03.888134+0000 (10 retries) 2026-02-17T04:59:16.016 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:16.024 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 17, 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 124 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:16.025 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:16.081 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T04:59:10.481 (2026-02-18T04:59:10.481)", 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:16.082 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T04:59:10.481558+0000", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:16.083 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-23T05:31:50.300932+0000", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-23T05:31:50.300932+0000", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:16.084 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:16.085 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:16.085 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:16.085 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:16.141 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:16.141 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=17 2026-02-17T04:59:16.141 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=126 2026-02-17T04:59:16.141 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T04:59:10.481' 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T04:59:10.481' 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T04:59:10.481558+0000' 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:16.142 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T04:59:10.481558+0000' 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=17 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=124 2026-02-17T04:59:16.143 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:16.145 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ false / 126 / 124 / true / 2026-02-17T04:59:10.481558+0000 / scrub scheduled %%% dmp_last_duration dmp_last_duration_neg 2026-02-17T04:59:16.145 INFO:tasks.workunit.client.0.trial090.stdout:key is dmp_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-17T04:59:16.145 INFO:tasks.workunit.client.0.trial090.stdout:WaitingAfterScrub_dmp - 'dmp_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-17T04:59:16.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T04:59:16.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:613: TEST_dump_scrub_schedule: ceph osd set noscrub 2026-02-17T04:59:16.360 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T04:59:16.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:614: TEST_dump_scrub_schedule: sleep 2 2026-02-17T04:59:18.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:615: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-17T04:59:18.425 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:59:18.425 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:59:18.426 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.433 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:59:18.433 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:59:18.433 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.441 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:59:18.441 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-17T04:59:18.441 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:616: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_scrub_sleep 2.0 2026-02-17T04:59:18.497 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T04:59:18.498 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:18.498 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.505 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T04:59:18.506 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:18.506 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.513 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T04:59:18.513 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_sleep = '' " 2026-02-17T04:59:18.513 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:18.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:617: TEST_dump_scrub_schedule: sleep 8 2026-02-17T04:59:26.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:618: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-17T04:59:10.481558+0000 2026-02-17T04:59:26.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:620: TEST_dump_scrub_schedule: ceph tell 1.0 schedule-scrub 2026-02-17T04:59:26.571 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:26.572 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:59:26.572 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T04:59:26.572 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T04:59:26.571580+0000" 2026-02-17T04:59:26.572 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:26.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:621: TEST_dump_scrub_schedule: sleep 1 2026-02-17T04:59:27.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:622: TEST_dump_scrub_schedule: sched_data=() 2026-02-17T04:59:27.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:623: TEST_dump_scrub_schedule: expct_scrub_peri_sched=(['query_is_future']='false') 2026-02-17T04:59:27.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:623: TEST_dump_scrub_schedule: declare -A expct_scrub_peri_sched 2026-02-17T04:59:27.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:624: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-17T04:59:10.481558+0000 expct_scrub_peri_sched waitingBeingScheduled sched_data 2026-02-17T04:59:27.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-17T04:59:10.481558+0000 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_scrub_peri_sched 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T04:59:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T04:59:27.580 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (waitingBeingScheduled): pg:1.0 dt:2026-02-17T04:59:10.481558+0000 (10 retries) 2026-02-17T04:59:28.239 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:28.248 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:28.248 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:28.248 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "queued for scrub", 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "0", 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": false, 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": false, 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 18, 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 135 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:28.249 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:28.305 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-17T04:59:28.658 (2026-02-16T04:59:26.571)", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-16T04:59:26.571580+0000", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "noscrub", 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:28.306 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:28.307 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:28.308 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:28.308 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:28.308 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:28.365 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:28.365 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=18 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=137 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-17T04:59:28.658' 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-16T04:59:26.571' 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-15T04:59:26.571580+0000' 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T04:59:28.366 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='queued for scrub' 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='0' 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=false 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=false 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=18 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=135 2026-02-17T04:59:28.367 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:28.368 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ false / 137 / 135 / false / 2026-02-15T04:59:26.571580+0000 / scrub scheduled %%% query_is_future 2026-02-17T04:59:28.368 INFO:tasks.workunit.client.0.trial090.stdout:key is query_is_future: negation:0 # expected: false # in actual: false 2026-02-17T04:59:28.369 INFO:tasks.workunit.client.0.trial090.stdout:waitingBeingScheduled - 'query_is_future' actual value (false) matches expected (false) (negation: 0) 2026-02-17T04:59:28.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T04:59:28.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:636: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-15T04:59:26.571580+0000 2026-02-17T04:59:28.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:637: TEST_dump_scrub_schedule: ceph osd unset noscrub 2026-02-17T04:59:28.578 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is unset 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:639: TEST_dump_scrub_schedule: cond_active=(['query_active']='true') 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:639: TEST_dump_scrub_schedule: declare -A cond_active 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:640: TEST_dump_scrub_schedule: sched_data=() 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:641: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-15T04:59:26.571580+0000 cond_active 'WaitingActive ' sched_data 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-15T04:59:26.571580+0000 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=cond_active 2026-02-17T04:59:28.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-17T04:59:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T04:59:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T04:59:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T04:59:28.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T04:59:28.592 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (WaitingActive ): pg:1.0 dt:2026-02-15T04:59:26.571580+0000 (10 retries) 2026-02-17T04:59:29.249 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:29.257 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:29.257 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-17T04:59:27.625436+0000", 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": false, 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 18, 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 136 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:29.258 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "queued for scrub at 2026-02-16T04:59:26.571", 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:29.315 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-16T04:59:26.571580+0000", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "noscrub", 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": true, 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:29.316 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:29.317 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:29.375 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=139 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='queued for scrub at 2026-02-16T04:59:26.571' 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='0' 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='0' 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-15T04:59:26.571580+0000' 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:29.376 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=false 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-17T04:59:27.625436+0000' 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=false 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=18 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=136 2026-02-17T04:59:29.377 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:29.379 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ false / 139 / 136 / false / 2026-02-15T04:59:26.571580+0000 / queued for scrub at 2026-02-16T04:59:26.571 %%% query_active 2026-02-17T04:59:29.379 INFO:tasks.workunit.client.0.trial090.stdout:key is query_active: negation:0 # expected: true # in actual: false 2026-02-17T04:59:30.035 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:30.043 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 19, 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 138 2026-02-17T04:59:30.044 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:30.045 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:30.101 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:30.101 INFO:tasks.workunit.client.0.trial090.stdout: "active": true, 2026-02-17T04:59:30.101 INFO:tasks.workunit.client.0.trial090.stdout: "epoch_start": "15", 2026-02-17T04:59:30.101 INFO:tasks.workunit.client.0.trial090.stdout: "start": "1:00000000::::0", 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "end": "MIN", 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "max_end": "MIN", 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "subset_last_update": "0'0", 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "req_scrub": false, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "auto_repair": false, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "check_repair": false, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "deep_scrub_on_error": false, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "priority": 5, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "shallow_errors": 0, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "deep_errors": 0, 2026-02-17T04:59:30.102 INFO:tasks.workunit.client.0.trial090.stdout: "fixed": 0, 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "waiting_on_whom": [], 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrubbing", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "is_reserving_replicas": false, 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:30.103 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "active": true 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:30.104 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:30.105 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:30.105 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:30.105 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:30.105 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:30.105 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=143 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=true 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrubbing' 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='0' 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='0' 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:30.161 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-15T04:59:26.571580+0000' 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=false 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-17T04:59:28.658888+0000' 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:30.162 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=19 2026-02-17T04:59:30.163 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=138 2026-02-17T04:59:30.163 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:30.164 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 2 ~ true / 143 / 138 / false / 2026-02-15T04:59:26.571580+0000 / scrubbing %%% query_active 2026-02-17T04:59:30.164 INFO:tasks.workunit.client.0.trial090.stdout:key is query_active: negation:0 # expected: true # in actual: true 2026-02-17T04:59:30.164 INFO:tasks.workunit.client.0.trial090.stdout:WaitingActive - 'query_active' actual value (true) matches expected (true) (negation: 0) 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:645: TEST_dump_scrub_schedule: cond_active_dmp=(['dmp_state_has_scrubbing']='true' ['query_active']='false') 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:645: TEST_dump_scrub_schedule: declare -A cond_active_dmp 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:646: TEST_dump_scrub_schedule: sched_data=() 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:647: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-15T04:59:26.571580+0000 cond_active_dmp 'WaitingActive ' sched_data 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-17T04:59:30.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-15T04:59:26.571580+0000 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=cond_active_dmp 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T04:59:30.167 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (WaitingActive ): pg:1.0 dt:2026-02-15T04:59:26.571580+0000 (10 retries) 2026-02-17T04:59:30.823 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:30.831 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-17T04:59:28.658888+0000", 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": false, 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 19, 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 138 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:30.832 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "active": true, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "epoch_start": "15", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "start": "1:00000000::::0", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "end": "MIN", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "max_end": "MIN", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "subset_last_update": "0'0", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "req_scrub": false, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "auto_repair": false, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "check_repair": false, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "deep_scrub_on_error": false, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "priority": 5, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "shallow_errors": 0, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "deep_errors": 0, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "fixed": 0, 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "waiting_on_whom": [], 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrubbing", 2026-02-17T04:59:30.892 INFO:tasks.workunit.client.0.trial090.stdout: "is_reserving_replicas": false, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "active": true 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:30.893 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:30.894 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:30.894 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:30.894 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:30.894 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:30.894 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=143 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=true 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrubbing' 2026-02-17T04:59:30.953 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='0' 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='0' 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-15T04:59:26.571580+0000' 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=false 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:30.954 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-17T04:59:28.658888+0000' 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=false 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=19 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=138 2026-02-17T04:59:30.955 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:30.956 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ true / 143 / 138 / false / 2026-02-15T04:59:26.571580+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-17T04:59:30.956 INFO:tasks.workunit.client.0.trial090.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: false 2026-02-17T04:59:30.956 INFO:tasks.workunit.client.0.trial090.stdout:key is query_active: negation:0 # expected: false # in actual: true 2026-02-17T04:59:31.612 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T04:59:31.620 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean+scrubbing", 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": true, 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "scrubbing for 1s", 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "0", 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": false, 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": false, 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 19, 2026-02-17T04:59:31.621 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 142 2026-02-17T04:59:31.622 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:31.622 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T04:59:31.677 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "active": true, 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "epoch_start": "15", 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "start": "1:a0217245:::obj31:0", 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "end": "1:a0217245:::obj31:0", 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "max_end": "1:a0217245:::obj31:0", 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "subset_last_update": "17'90", 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T04:59:31.678 INFO:tasks.workunit.client.0.trial090.stdout: "req_scrub": false, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "auto_repair": false, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "check_repair": false, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "deep_scrub_on_error": false, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "priority": 5, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "shallow_errors": 0, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "deep_errors": 0, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "fixed": 0, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "waiting_on_whom": [], 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrubbing", 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "is_reserving_replicas": false, 2026-02-17T04:59:31.679 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:31.680 INFO:tasks.workunit.client.0.trial090.stdout: "active": true 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.0", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T20:00:33.769882+0000", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T04:59:31.681 INFO:tasks.workunit.client.0.trial090.stdout: "queued": false, 2026-02-17T04:59:31.682 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T04:59:31.682 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:31.682 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:31.682 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=145 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=true 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrubbing' 2026-02-17T04:59:31.738 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='0' 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='0' 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-15T04:59:26.571580+0000' 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='17x90' 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=false 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=null 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean+scrubbing' 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=true 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T04:59:31.739 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='scrubbing for 1s' 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='0' 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=false 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=false 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=19 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=142 2026-02-17T04:59:31.740 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T04:59:31.741 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 2 ~ true / 145 / 142 / false / 2026-02-15T04:59:26.571580+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-17T04:59:31.741 INFO:tasks.workunit.client.0.trial090.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: true 2026-02-17T04:59:31.741 INFO:tasks.workunit.client.0.trial090.stdout:WaitingActive - 'dmp_state_has_scrubbing' actual value (true) matches expected (true) (negation: 0) 2026-02-17T04:59:31.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T04:59:31.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:648: TEST_dump_scrub_schedule: sleep 4 2026-02-17T04:59:35.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:649: TEST_dump_scrub_schedule: perf_counters td/osd-scrub-test 3 2026-02-17T04:59:35.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T04:59:35.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T04:59:35.744 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T04:59:35.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T04:59:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T04:59:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:59:35.805 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.806 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.807 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.808 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.809 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.810 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:59:35.811 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:35.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:35.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T04:59:35.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:59:35.862 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:35.862 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:59:35.862 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.862 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.863 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.864 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 7, 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.865 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.866 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 2, 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.867 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.868 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.868 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.868 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.868 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:59:35.868 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:35.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:35.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T04:59:35.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T04:59:35.918 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:35.918 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.919 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.920 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.921 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T04:59:35.922 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T04:59:35.923 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.924 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T04:59:35.924 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T04:59:35.924 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:35.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_dump_scrub_schedule ------------------' 2026-02-17T04:59:35.925 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_dump_scrub_schedule ------------------ 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:59:35.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:59:35.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:59:36.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:59:36.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:59:36.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:59:36.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:59:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:59:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:59:36.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:59:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:59:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:59:36.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:59:36.032 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:59:36.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:59:36.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:59:36.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:59:36.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:59:36.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:59:36.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:59:36.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:59:36.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_dump_scrub_schedule ------------------' 2026-02-17T04:59:36.045 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_dump_scrub_schedule ------------------ 2026-02-17T04:59:36.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T04:59:36.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_interval_changes -------------------' 2026-02-17T04:59:36.046 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_interval_changes ------------------- 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T04:59:36.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T04:59:36.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T04:59:36.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T04:59:36.049 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T04:59:36.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T04:59:36.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T04:59:36.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T04:59:36.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T04:59:36.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T04:59:36.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:59:36.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T04:59:36.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T04:59:36.052 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T04:59:36.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T04:59:36.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T04:59:36.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T04:59:36.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T04:59:36.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.054 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T04:59:36.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T04:59:36.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T04:59:36.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T04:59:36.056 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T04:59:36.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T04:59:36.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T04:59:36.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T04:59:36.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T04:59:36.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T04:59:36.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_interval_changes -----------------------' 2026-02-17T04:59:36.059 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_interval_changes ----------------------- 2026-02-17T04:59:36.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_interval_changes td/osd-scrub-test 2026-02-17T04:59:36.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:142: TEST_interval_changes: local poolname=test 2026-02-17T04:59:36.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:143: TEST_interval_changes: local OSDS=2 2026-02-17T04:59:36.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:144: TEST_interval_changes: local objects=10 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:146: TEST_interval_changes: expr 24 '*' 60 '*' 60 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:146: TEST_interval_changes: local day=86400 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:147: TEST_interval_changes: expr 86400 '*' 7 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:147: TEST_interval_changes: local week=604800 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:148: TEST_interval_changes: local min_interval=86400 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:149: TEST_interval_changes: local max_interval=604800 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:150: TEST_interval_changes: local WAIT_FOR_UPDATE=15 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:152: TEST_interval_changes: TESTDATA=testdata.897552 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:155: TEST_interval_changes: run_mon td/osd-scrub-test a --osd_pool_default_size=2 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T04:59:36.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T04:59:36.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T04:59:36.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T04:59:36.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T04:59:36.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=2 2026-02-17T04:59:36.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T04:59:36.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:36.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-17T04:59:36.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T04:59:36.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T04:59:36.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.106 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:59:36.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:59:36.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T04:59:36.152 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T04:59:36.153 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:36.153 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.153 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.153 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T04:59:36.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T04:59:36.154 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T04:59:36.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:156: TEST_interval_changes: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T04:59:36.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:36.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T04:59:36.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T04:59:36.292 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: expr 2 - 1 2026-02-17T04:59:36.293 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: seq 0 1 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:159: TEST_interval_changes: run_osd td/osd-scrub-test 0 --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:59:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:59:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:59:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0' 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aeb83bc6-d19a-4c86-a523-a53596d8e17e 2026-02-17T04:59:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 aeb83bc6-d19a-4c86-a523-a53596d8e17e' 2026-02-17T04:59:36.302 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 aeb83bc6-d19a-4c86-a523-a53596d8e17e 2026-02-17T04:59:36.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:59:36.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC49ZNpQcM3EhAAIAqXg1X9+zxkZKnciV24Eg== 2026-02-17T04:59:36.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC49ZNpQcM3EhAAIAqXg1X9+zxkZKnciV24Eg=="}' 2026-02-17T04:59:36.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aeb83bc6-d19a-4c86-a523-a53596d8e17e -i td/osd-scrub-test/0/new.json 2026-02-17T04:59:36.386 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:59:36.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T04:59:36.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 --mkfs --key AQC49ZNpQcM3EhAAIAqXg1X9+zxkZKnciV24Eg== --osd-uuid aeb83bc6-d19a-4c86-a523-a53596d8e17e 2026-02-17T04:59:36.409 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.408+0000 7f978e020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:36.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.409+0000 7f978e020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:36.411 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.410+0000 7f978e020780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:36.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.410+0000 7f978e020780 -1 bdev(0x39fcc00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T04:59:36.412 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.410+0000 7f978e020780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T04:59:36.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T04:59:36.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:59:36.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T04:59:36.838 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T04:59:36.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:59:36.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T04:59:36.921 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T04:59:36.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-17T04:59:36.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:59:36.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:59:36.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:59:36.936 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.935+0000 7f9d27233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:36.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.936+0000 7f9d27233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:36.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:36.937+0000 7f9d27233780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:37.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T04:59:37.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:59:37.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T04:59:37.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:59:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:59:37.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:37.001 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:59:37.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:59:37.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:37.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:59:37.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:59:37.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:37.126+0000 7f9d27233780 -1 Falling back to public interface 2026-02-17T04:59:37.466 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:37.464+0000 7f9d27233780 -1 osd.0 0 log_to_monitors true 2026-02-17T04:59:38.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:59:38.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:38.082 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:59:38.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:59:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T04:59:38.160 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/682322335,v1:127.0.0.1:6801/682322335] [v2:127.0.0.1:6802/682322335,v1:127.0.0.1:6803/682322335] exists,up aeb83bc6-d19a-4c86-a523-a53596d8e17e 2026-02-17T04:59:38.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:59:38.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:59:38.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:159: TEST_interval_changes: run_osd td/osd-scrub-test 1 --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T04:59:38.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T04:59:38.166 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T04:59:38.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0' 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ebe37023-abea-41d7-9e88-a41fd27cb9e9 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ebe37023-abea-41d7-9e88-a41fd27cb9e9' 2026-02-17T04:59:38.168 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 ebe37023-abea-41d7-9e88-a41fd27cb9e9 2026-02-17T04:59:38.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T04:59:38.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC69ZNpPBxHChAArLxYpoIvio18fgtmz5OGMA== 2026-02-17T04:59:38.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC69ZNpPBxHChAArLxYpoIvio18fgtmz5OGMA=="}' 2026-02-17T04:59:38.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ebe37023-abea-41d7-9e88-a41fd27cb9e9 -i td/osd-scrub-test/1/new.json 2026-02-17T04:59:38.253 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:59:38.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T04:59:38.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 --mkfs --key AQC69ZNpPBxHChAArLxYpoIvio18fgtmz5OGMA== --osd-uuid ebe37023-abea-41d7-9e88-a41fd27cb9e9 2026-02-17T04:59:38.277 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.275+0000 7f58741e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:38.278 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.277+0000 7f58741e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:38.279 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.277+0000 7f58741e3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:38.280 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.278+0000 7f58741e3780 -1 bdev(0x2a26c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T04:59:38.280 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.278+0000 7f58741e3780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T04:59:38.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T04:59:38.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T04:59:38.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T04:59:38.617 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T04:59:38.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T04:59:38.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T04:59:38.836 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T04:59:38.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-17T04:59:38.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T04:59:38.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T04:59:38.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T04:59:38.850 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.849+0000 7f81a022c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:38.852 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.850+0000 7f81a022c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:38.852 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:38.851+0000 7f81a022c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T04:59:39.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:39.007 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T04:59:39.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T04:59:39.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:39.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:59:39.034 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:39.032+0000 7f81a022c780 -1 Falling back to public interface 2026-02-17T04:59:39.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T04:59:39.306 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T04:59:39.305+0000 7f81a022c780 -1 osd.1 0 log_to_monitors true 2026-02-17T04:59:40.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T04:59:40.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T04:59:40.172 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T04:59:40.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T04:59:40.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T04:59:40.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T04:59:40.336 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/110820153,v1:127.0.0.1:6811/110820153] [v2:127.0.0.1:6812/110820153,v1:127.0.0.1:6813/110820153] exists,up ebe37023-abea-41d7-9e88-a41fd27cb9e9 2026-02-17T04:59:40.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T04:59:40.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T04:59:40.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T04:59:40.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:163: TEST_interval_changes: create_pool test 1 1 2026-02-17T04:59:40.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T04:59:40.581 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T04:59:40.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T04:59:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:164: TEST_interval_changes: wait_for_clean 2026-02-17T04:59:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T04:59:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T04:59:41.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T04:59:41.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T04:59:41.592 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T04:59:41.593 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T04:59:41.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T04:59:41.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T04:59:41.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T04:59:41.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T04:59:41.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T04:59:41.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T04:59:41.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T04:59:41.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T04:59:41.682 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T04:59:41.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T04:59:41.846 INFO:tasks.workunit.client.0.trial090.stderr:1' 2026-02-17T04:59:41.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T04:59:41.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:59:41.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T04:59:41.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T04:59:41.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T04:59:41.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T04:59:41.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T04:59:41.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T04:59:41.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T04:59:41.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T04:59:41.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-17T04:59:41.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:59:41.964 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T04:59:41.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:59:41.965 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T04:59:41.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T04:59:41.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:59:41.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T04:59:41.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T04:59:41.967 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836485 2026-02-17T04:59:41.968 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:59:42.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-17T04:59:42.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T04:59:43.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T04:59:43.130 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T04:59:43.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T04:59:43.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T04:59:43.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T04:59:43.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T04:59:43.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T04:59:43.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T04:59:43.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T04:59:43.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T04:59:43.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T04:59:43.302 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672964 2026-02-17T04:59:43.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T04:59:43.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T04:59:43.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T04:59:43.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:59:43.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:59:43.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T04:59:43.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T04:59:43.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T04:59:43.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T04:59:43.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T04:59:43.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T04:59:43.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T04:59:43.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T04:59:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T04:59:43.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T04:59:43.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T04:59:43.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T04:59:44.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T04:59:44.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T04:59:44.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T04:59:44.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: ceph osd dump 2026-02-17T04:59:44.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: grep '^pool.*['\'']test['\'']' 2026-02-17T04:59:44.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: awk '{ print $2 }' 2026-02-17T04:59:44.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: local poolid=1 2026-02-17T04:59:44.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:167: TEST_interval_changes: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T04:59:44.208 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T04:59:44.208 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T04:59:44.208 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.6678e-05 s, 28.1 MB/s 2026-02-17T04:59:44.209 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: seq 1 10 2026-02-17T04:59:44.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj1 testdata.897552 2026-02-17T04:59:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj2 testdata.897552 2026-02-17T04:59:44.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj3 testdata.897552 2026-02-17T04:59:44.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj4 testdata.897552 2026-02-17T04:59:44.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj5 testdata.897552 2026-02-17T04:59:44.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj6 testdata.897552 2026-02-17T04:59:44.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj7 testdata.897552 2026-02-17T04:59:44.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj8 testdata.897552 2026-02-17T04:59:44.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj9 testdata.897552 2026-02-17T04:59:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-17T04:59:44.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj10 testdata.897552 2026-02-17T04:59:44.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:172: TEST_interval_changes: rm -f testdata.897552 2026-02-17T04:59:44.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:174: TEST_interval_changes: get_primary test obj1 2026-02-17T04:59:44.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T04:59:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T04:59:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T04:59:44.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T04:59:44.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:174: TEST_interval_changes: local primary=1 2026-02-17T04:59:44.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:177: TEST_interval_changes: check_dump_scrubs 1 '1 day' 2026-02-17T04:59:44.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-17T04:59:44.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=1 day' 2026-02-17T04:59:44.539 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-17T04:59:44.539 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-17T04:59:44.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok dump_scrubs 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-18T04:59:40.579325+0000", 2026-02-17T04:59:44.587 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-18T04:59:40.579325+0000", 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:59:44.588 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-22T15:32:42.884675+0000", 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-22T15:32:42.884675+0000", 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:59:44.589 INFO:tasks.workunit.client.0.trial090.stderr:]' 2026-02-17T04:59:44.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-18T04:59:40.579325+0000",' '"orig_sched_time":' '"2026-02-18T04:59:40.579325+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-22T15:32:42.884675+0000",' '"orig_sched_time":' '"2026-02-22T15:32:42.884675+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-17T04:59:44.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-17T04:59:44.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-18T04:59:40.579325+0000"' 2026-02-17T04:59:44.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-18T04:59:40.579325+0000 2026-02-17T04:59:44.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-18T04:59:40.579325+0000 2026-02-17T04:59:44.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-17T04:59:44.592 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 1 day' 2026-02-17T04:59:44.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-18 = 2026-02-18 2026-02-17T04:59:44.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: get_asok_path osd.1 2026-02-17T04:59:44.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:59:44.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:59:44.594 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:44.594 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:44.595 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:44.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:59:44.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: expr 86400 '*' 2 2026-02-17T04:59:44.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: CEPH_ARGS= 2026-02-17T04:59:44.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok config set osd_scrub_min_interval 172800 2026-02-17T04:59:44.639 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:44.640 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-17T04:59:44.640 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:44.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:181: TEST_interval_changes: sleep 15 2026-02-17T04:59:59.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:182: TEST_interval_changes: check_dump_scrubs 1 '2 days' 2026-02-17T04:59:59.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-17T04:59:59.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=2 days' 2026-02-17T04:59:59.646 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-17T04:59:59.647 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:59:59.647 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:59:59.647 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:59.647 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:59.648 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:59.648 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:59:59.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-17T04:59:59.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok dump_scrubs 2026-02-17T04:59:59.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-17T04:59:59.697 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:59:59.697 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-19T04:59:40.579325+0000", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-19T04:59:40.579325+0000", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T04:59:59.698 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-26T15:40:46.980290+0000", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-26T15:40:46.980290+0000", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T04:59:59.699 INFO:tasks.workunit.client.0.trial090.stderr:]' 2026-02-17T04:59:59.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-19T04:59:40.579325+0000",' '"orig_sched_time":' '"2026-02-19T04:59:40.579325+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-26T15:40:46.980290+0000",' '"orig_sched_time":' '"2026-02-26T15:40:46.980290+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-17T04:59:59.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-17T04:59:59.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-19T04:59:40.579325+0000"' 2026-02-17T04:59:59.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-19T04:59:40.579325+0000 2026-02-17T04:59:59.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-19T04:59:40.579325+0000 2026-02-17T04:59:59.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-17T04:59:59.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 2 days' 2026-02-17T04:59:59.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-19 = 2026-02-19 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: get_asok_path osd.1 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T04:59:59.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T04:59:59.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: expr 604800 '*' 2 2026-02-17T04:59:59.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: CEPH_ARGS= 2026-02-17T04:59:59.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok config set osd_scrub_max_interval 1209600 2026-02-17T04:59:59.751 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T04:59:59.751 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_max_interval = '' " 2026-02-17T04:59:59.751 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T04:59:59.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:186: TEST_interval_changes: sleep 15 2026-02-17T05:00:14.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:187: TEST_interval_changes: check_dump_scrubs 1 '2 days' 2026-02-17T05:00:14.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-17T05:00:14.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=2 days' 2026-02-17T05:00:14.757 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-17T05:00:14.758 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:00:14.758 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-17T05:00:14.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok dump_scrubs 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-19T04:59:40.579325+0000", 2026-02-17T05:00:14.809 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-19T04:59:40.579325+0000", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-21T16:12:27.086994+0000", 2026-02-17T05:00:14.810 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-21T16:12:27.086994+0000", 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T05:00:14.811 INFO:tasks.workunit.client.0.trial090.stderr:]' 2026-02-17T05:00:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-19T04:59:40.579325+0000",' '"orig_sched_time":' '"2026-02-19T04:59:40.579325+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-21T16:12:27.086994+0000",' '"orig_sched_time":' '"2026-02-21T16:12:27.086994+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-17T05:00:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-17T05:00:14.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-19T04:59:40.579325+0000"' 2026-02-17T05:00:14.812 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-19T04:59:40.579325+0000 2026-02-17T05:00:14.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-19T04:59:40.579325+0000 2026-02-17T05:00:14.813 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-17T05:00:14.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 2 days' 2026-02-17T05:00:14.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-19 = 2026-02-19 2026-02-17T05:00:14.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:190: TEST_interval_changes: expr 86400 '*' 3 2026-02-17T05:00:14.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:190: TEST_interval_changes: ceph osd pool set test scrub_min_interval 259200 2026-02-17T05:00:15.024 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 scrub_min_interval to 259200 2026-02-17T05:00:15.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:191: TEST_interval_changes: sleep 15 2026-02-17T05:00:30.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:192: TEST_interval_changes: check_dump_scrubs 1 '3 days' 2026-02-17T05:00:30.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-17T05:00:30.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=3 days' 2026-02-17T05:00:30.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-17T05:00:30.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:00:30.039 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:00:30.040 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:00:30.040 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:30.040 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:30.040 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T05:00:30.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-17T05:00:30.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok dump_scrubs 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-20T04:59:40.579325+0000", 2026-02-17T05:00:30.089 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-20T04:59:40.579325+0000", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-25T06:01:53.957095+0000", 2026-02-17T05:00:30.090 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-25T06:01:53.957095+0000", 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T05:00:30.091 INFO:tasks.workunit.client.0.trial090.stderr:]' 2026-02-17T05:00:30.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-20T04:59:40.579325+0000",' '"orig_sched_time":' '"2026-02-20T04:59:40.579325+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-25T06:01:53.957095+0000",' '"orig_sched_time":' '"2026-02-25T06:01:53.957095+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-17T05:00:30.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-17T05:00:30.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-20T04:59:40.579325+0000"' 2026-02-17T05:00:30.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-20T04:59:40.579325+0000 2026-02-17T05:00:30.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-20T04:59:40.579325+0000 2026-02-17T05:00:30.093 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-17T05:00:30.094 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 3 days' 2026-02-17T05:00:30.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-20 = 2026-02-20 2026-02-17T05:00:30.095 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:195: TEST_interval_changes: expr 604800 '*' 3 2026-02-17T05:00:30.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:195: TEST_interval_changes: ceph osd pool set test scrub_max_interval 1814400 2026-02-17T05:00:30.301 INFO:tasks.workunit.client.0.trial090.stderr:set pool 1 scrub_max_interval to 1814400 2026-02-17T05:00:30.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:196: TEST_interval_changes: sleep 15 2026-02-17T05:00:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:197: TEST_interval_changes: check_dump_scrubs 1 '3 days' 2026-02-17T05:00:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-17T05:00:45.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=3 days' 2026-02-17T05:00:45.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-17T05:00:45.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T05:00:45.314 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T05:00:45.315 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:00:45.315 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:45.315 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:45.315 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.1.asok 2026-02-17T05:00:45.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-17T05:00:45.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.897552/ceph-osd.1.asok dump_scrubs 2026-02-17T05:00:45.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "level": "shallow", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-20T04:59:40.579325+0000", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-20T04:59:40.579325+0000", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: }, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: { 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "pgid": "1.0", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "level": "deep", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "urgency": "periodic-regular", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "sched_time": "2026-02-23T06:23:59.515245+0000", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "orig_sched_time": "2026-02-23T06:23:59.515245+0000", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "last_issue": "ok", 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "forced": false, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "eligible": false, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "queued": true, 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: "active": false 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr: } 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr:]' 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-20T04:59:40.579325+0000",' '"orig_sched_time":' '"2026-02-20T04:59:40.579325+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-23T06:23:59.515245+0000",' '"orig_sched_time":' '"2026-02-23T06:23:59.515245+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-17T05:00:45.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-17T05:00:45.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-20T04:59:40.579325+0000"' 2026-02-17T05:00:45.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-20T04:59:40.579325+0000 2026-02-17T05:00:45.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-20T04:59:40.579325+0000 2026-02-17T05:00:45.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-17T05:00:45.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 3 days' 2026-02-17T05:00:45.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-20 = 2026-02-20 2026-02-17T05:00:45.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:198: TEST_interval_changes: perf_counters td/osd-scrub-test 2 2026-02-17T05:00:45.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:00:45.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=2 2026-02-17T05:00:45.372 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 2 - 1 2026-02-17T05:00:45.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 1 2026-02-17T05:00:45.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:00:45.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:00:45.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:00:45.431 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:00:45.432 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.434 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.435 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:00:45.436 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:00:45.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:00:45.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:00:45.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:00:45.488 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:00:45.488 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:00:45.488 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.488 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.488 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.489 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.490 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.491 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:00:45.492 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:00:45.493 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:00:45.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_interval_changes ------------------' 2026-02-17T05:00:45.494 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_interval_changes ------------------ 2026-02-17T05:00:45.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:00:45.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:00:45.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:00:45.598 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:00:45.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:00:45.599 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:00:45.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:00:45.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:00:45.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:00:45.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:00:45.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:00:45.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:00:45.603 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:00:45.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:00:45.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:00:45.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:00:45.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:00:45.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:45.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:45.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:00:45.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:00:45.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:00:45.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_interval_changes ------------------' 2026-02-17T05:00:45.612 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_interval_changes ------------------ 2026-02-17T05:00:45.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T05:00:45.613 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_just_deep_scrubs ------------------- 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_just_deep_scrubs -------------------' 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:00:45.615 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:00:45.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:00:45.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:00:45.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:00:45.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:00:45.616 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:00:45.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:00:45.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:00:45.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:00:45.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:00:45.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:00:45.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:00:45.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:00:45.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:00:45.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:00:45.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:00:45.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:00:45.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:00:45.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:00:45.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:45.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:00:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:00:45.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:00:45.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:00:45.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:00:45.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:00:45.624 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:00:45.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:00:45.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:00:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:00:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:00:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:00:45.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_just_deep_scrubs -----------------------' 2026-02-17T05:00:45.626 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_just_deep_scrubs ----------------------- 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_just_deep_scrubs td/osd-scrub-test 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:462: TEST_just_deep_scrubs: local dir=td/osd-scrub-test 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:463: TEST_just_deep_scrubs: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test') 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:463: TEST_just_deep_scrubs: local -A cluster_conf 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:469: TEST_just_deep_scrubs: standard_scrub_cluster td/osd-scrub-test cluster_conf 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-test 2026-02-17T05:00:45.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local extra_pars= 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-17T05:00:45.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-17T05:00:45.862 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 a8987cb7-0f03-4c8d-9a47-fe2355924a20 2026-02-17T05:00:45.951 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:00:45.977 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:45.975+0000 7f56dfa54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:45.978 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:45.977+0000 7f56dfa54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:45.979 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:45.977+0000 7f56dfa54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:45.979 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:45.978+0000 7f56dfa54780 -1 bdev(0x3de2c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:00:45.979 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:45.978+0000 7f56dfa54780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T05:00:46.445 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:00:46.526 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:00:46.544 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:46.543+0000 7f7b6f035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:46.546 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:46.544+0000 7f7b6f035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:46.547 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:46.545+0000 7f7b6f035780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:46.605 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:00:46.770 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:46.769+0000 7f7b6f035780 -1 Falling back to public interface 2026-02-17T05:00:47.133 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.132+0000 7f7b6f035780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:00:47.687 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:00:47.765 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1550841108,v1:127.0.0.1:6801/1550841108] [v2:127.0.0.1:6802/1550841108,v1:127.0.0.1:6803/1550841108] exists,up a8987cb7-0f03-4c8d-9a47-fe2355924a20 2026-02-17T05:00:47.769 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 52428075-8c0d-4c79-ae87-82613b95f9b3 2026-02-17T05:00:47.858 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:00:47.885 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.884+0000 7fab68036780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:47.887 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.885+0000 7fab68036780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:47.887 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.886+0000 7fab68036780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:47.888 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.886+0000 7fab68036780 -1 bdev(0x4116c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:00:47.888 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:47.886+0000 7fab68036780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T05:00:48.235 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:00:48.445 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:00:48.462 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:48.461+0000 7fe836a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:48.463 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:48.462+0000 7fe836a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:48.464 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:48.463+0000 7fe836a15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:48.601 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:48.599+0000 7fe836a15780 -1 Falling back to public interface 2026-02-17T05:00:48.609 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:00:48.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:48.891+0000 7fe836a15780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:00:49.773 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:00:49.936 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/692377944,v1:127.0.0.1:6811/692377944] [v2:127.0.0.1:6812/692377944,v1:127.0.0.1:6813/692377944] exists,up 52428075-8c0d-4c79-ae87-82613b95f9b3 2026-02-17T05:00:49.940 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 bfc82cf9-7f23-4148-b788-593c9739be15 2026-02-17T05:00:50.112 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:00:50.142 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.140+0000 7f17d0067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.143 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.142+0000 7f17d0067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.144 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.143+0000 7f17d0067780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.145 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.143+0000 7f17d0067780 -1 bdev(0x261cc00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:00:50.145 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.143+0000 7f17d0067780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T05:00:50.458 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:00:50.670 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:00:50.688 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.687+0000 7ffb9fa10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.690 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.688+0000 7ffb9fa10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.691 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.689+0000 7ffb9fa10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:00:50.832 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:00:50.895 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:50.894+0000 7ffb9fa10780 -1 Falling back to public interface 2026-02-17T05:00:51.207 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:00:51.206+0000 7ffb9fa10780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:00:51.997 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:00:52.163 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1599739034,v1:127.0.0.1:6819/1599739034] [v2:127.0.0.1:6820/1599739034,v1:127.0.0.1:6821/1599739034] exists,up bfc82cf9-7f23-4148-b788-593c9739be15 2026-02-17T05:00:52.385 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T05:00:53.826 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:00:53.990 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T05:00:54.161 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 55834574851 2026-02-17T05:00:56.096 INFO:tasks.workunit.client.0.trial090.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-17T05:00:56.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:470: TEST_just_deep_scrubs: local poolid=1 2026-02-17T05:00:56.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:471: TEST_just_deep_scrubs: local poolname=test 2026-02-17T05:00:56.097 INFO:tasks.workunit.client.0.trial090.stdout:Pool: test : 1 2026-02-17T05:00:56.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:472: TEST_just_deep_scrubs: echo 'Pool: test : 1' 2026-02-17T05:00:56.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:474: TEST_just_deep_scrubs: TESTDATA=testdata.897552 2026-02-17T05:00:56.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:475: TEST_just_deep_scrubs: local objects=90 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:476: TEST_just_deep_scrubs: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 4.2539e-05 s, 24.3 MB/s 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: seq 1 90 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj1 testdata.897552 2026-02-17T05:00:56.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj2 testdata.897552 2026-02-17T05:00:56.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj3 testdata.897552 2026-02-17T05:00:56.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj4 testdata.897552 2026-02-17T05:00:56.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj5 testdata.897552 2026-02-17T05:00:56.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj6 testdata.897552 2026-02-17T05:00:56.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj7 testdata.897552 2026-02-17T05:00:56.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj8 testdata.897552 2026-02-17T05:00:56.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj9 testdata.897552 2026-02-17T05:00:56.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj10 testdata.897552 2026-02-17T05:00:56.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj11 testdata.897552 2026-02-17T05:00:56.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj12 testdata.897552 2026-02-17T05:00:56.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj13 testdata.897552 2026-02-17T05:00:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.308 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj14 testdata.897552 2026-02-17T05:00:56.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj15 testdata.897552 2026-02-17T05:00:56.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj16 testdata.897552 2026-02-17T05:00:56.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj17 testdata.897552 2026-02-17T05:00:56.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj18 testdata.897552 2026-02-17T05:00:56.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj19 testdata.897552 2026-02-17T05:00:56.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj20 testdata.897552 2026-02-17T05:00:56.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj21 testdata.897552 2026-02-17T05:00:56.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj22 testdata.897552 2026-02-17T05:00:56.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj23 testdata.897552 2026-02-17T05:00:56.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj24 testdata.897552 2026-02-17T05:00:56.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj25 testdata.897552 2026-02-17T05:00:56.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj26 testdata.897552 2026-02-17T05:00:56.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj27 testdata.897552 2026-02-17T05:00:56.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj28 testdata.897552 2026-02-17T05:00:56.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj29 testdata.897552 2026-02-17T05:00:56.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj30 testdata.897552 2026-02-17T05:00:56.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj31 testdata.897552 2026-02-17T05:00:56.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj32 testdata.897552 2026-02-17T05:00:56.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj33 testdata.897552 2026-02-17T05:00:56.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj34 testdata.897552 2026-02-17T05:00:56.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj35 testdata.897552 2026-02-17T05:00:56.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj36 testdata.897552 2026-02-17T05:00:56.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj37 testdata.897552 2026-02-17T05:00:56.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.687 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj38 testdata.897552 2026-02-17T05:00:56.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj39 testdata.897552 2026-02-17T05:00:56.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.720 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj40 testdata.897552 2026-02-17T05:00:56.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj41 testdata.897552 2026-02-17T05:00:56.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj42 testdata.897552 2026-02-17T05:00:56.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj43 testdata.897552 2026-02-17T05:00:56.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj44 testdata.897552 2026-02-17T05:00:56.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj45 testdata.897552 2026-02-17T05:00:56.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj46 testdata.897552 2026-02-17T05:00:56.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj47 testdata.897552 2026-02-17T05:00:56.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj48 testdata.897552 2026-02-17T05:00:56.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj49 testdata.897552 2026-02-17T05:00:56.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj50 testdata.897552 2026-02-17T05:00:56.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj51 testdata.897552 2026-02-17T05:00:56.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj52 testdata.897552 2026-02-17T05:00:56.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.925 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj53 testdata.897552 2026-02-17T05:00:56.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj54 testdata.897552 2026-02-17T05:00:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj55 testdata.897552 2026-02-17T05:00:56.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj56 testdata.897552 2026-02-17T05:00:56.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:56.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj57 testdata.897552 2026-02-17T05:00:57.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj58 testdata.897552 2026-02-17T05:00:57.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj59 testdata.897552 2026-02-17T05:00:57.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj60 testdata.897552 2026-02-17T05:00:57.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj61 testdata.897552 2026-02-17T05:00:57.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj62 testdata.897552 2026-02-17T05:00:57.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj63 testdata.897552 2026-02-17T05:00:57.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj64 testdata.897552 2026-02-17T05:00:57.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj65 testdata.897552 2026-02-17T05:00:57.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj66 testdata.897552 2026-02-17T05:00:57.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj67 testdata.897552 2026-02-17T05:00:57.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj68 testdata.897552 2026-02-17T05:00:57.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj69 testdata.897552 2026-02-17T05:00:57.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj70 testdata.897552 2026-02-17T05:00:57.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj71 testdata.897552 2026-02-17T05:00:57.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj72 testdata.897552 2026-02-17T05:00:57.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj73 testdata.897552 2026-02-17T05:00:57.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj74 testdata.897552 2026-02-17T05:00:57.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj75 testdata.897552 2026-02-17T05:00:57.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj76 testdata.897552 2026-02-17T05:00:57.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj77 testdata.897552 2026-02-17T05:00:57.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj78 testdata.897552 2026-02-17T05:00:57.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj79 testdata.897552 2026-02-17T05:00:57.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj80 testdata.897552 2026-02-17T05:00:57.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj81 testdata.897552 2026-02-17T05:00:57.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj82 testdata.897552 2026-02-17T05:00:57.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj83 testdata.897552 2026-02-17T05:00:57.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj84 testdata.897552 2026-02-17T05:00:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj85 testdata.897552 2026-02-17T05:00:57.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj86 testdata.897552 2026-02-17T05:00:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj87 testdata.897552 2026-02-17T05:00:57.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj88 testdata.897552 2026-02-17T05:00:57.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj89 testdata.897552 2026-02-17T05:00:57.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-17T05:00:57.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj90 testdata.897552 2026-02-17T05:00:57.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:481: TEST_just_deep_scrubs: rm -f testdata.897552 2026-02-17T05:00:57.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:486: TEST_just_deep_scrubs: ceph tell 'osd.*' config set osd_scrub_retry_after_noscrub 2 2026-02-17T05:00:57.569 INFO:tasks.workunit.client.0.trial090.stdout:osd.0: { 2026-02-17T05:00:57.569 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-17T05:00:57.569 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:00:57.577 INFO:tasks.workunit.client.0.trial090.stdout:osd.1: { 2026-02-17T05:00:57.577 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-17T05:00:57.577 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:00:57.585 INFO:tasks.workunit.client.0.trial090.stdout:osd.2: { 2026-02-17T05:00:57.585 INFO:tasks.workunit.client.0.trial090.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-17T05:00:57.585 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:00:57.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:487: TEST_just_deep_scrubs: ceph osd set noscrub 2026-02-17T05:00:57.802 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T05:00:57.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:488: TEST_just_deep_scrubs: ceph osd set nodeep-scrub 2026-02-17T05:00:58.057 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is set 2026-02-17T05:00:58.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:489: TEST_just_deep_scrubs: sleep 6 2026-02-17T05:01:04.069 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:490: TEST_just_deep_scrubs: date -Ins 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:490: TEST_just_deep_scrubs: local now_is=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:491: TEST_just_deep_scrubs: declare -A sched_data 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:492: TEST_just_deep_scrubs: local pgid=1.2 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:495: TEST_just_deep_scrubs: set_query_debug 1.2 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.2 2026-02-17T05:01:04.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-17T05:01:04.072 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.2' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-17T05:01:04.226 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs_brief 2026-02-17T05:01:04.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=0 2026-02-17T05:01:04.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.2 is 0' 2026-02-17T05:01:04.235 INFO:tasks.workunit.client.0.trial090.stdout:Setting scrub debug data. Primary for 1.2 is 0 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.0 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:04.237 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-osd.0.asok 2026-02-17T05:01:04.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-17T05:01:04.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.897552/ceph-osd.0.asok scrubdebug 1.2 set sessions 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:497: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04,070633791+00:00 sched_data 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sched_data 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-17T05:01:04.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-17T05:01:04.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-17T05:01:04.439 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout:{"success":true}from pg dump pg: { 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 0, 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T05:01:04.447 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 18, 2026-02-17T05:01:04.448 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 39 2026-02-17T05:01:04.448 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:04.448 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T05:00:52.384 (2026-02-18T05:00:52.384)", 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:04.504 INFO:tasks.workunit.client.0.trial090.stdout: "test_sequence": 13701120, 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:04.505 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-23T05:27:35.002402+0000", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-23T05:27:35.002402+0000", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:04.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:04.507 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=18 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=40 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T05:00:52.384' 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T05:00:52.384' 2026-02-17T05:01:04.566 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=0 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T05:00:52.384290+0000' 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='0x0' 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=13701120 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=0 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T05:00:52.384290+0000' 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T05:01:04.567 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T05:01:04.568 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=18 2026-02-17T05:01:04.568 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=39 2026-02-17T05:01:04.568 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T05:01:04.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:498: TEST_just_deep_scrubs: local saved_last_stamp=2026-02-17T05:00:52.384290+0000 2026-02-17T05:01:04.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:499: TEST_just_deep_scrubs: local dbg_counter_at_start=13701120 2026-02-17T05:01:04.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:500: TEST_just_deep_scrubs: echo 'test counter @ start: 13701120' 2026-02-17T05:01:04.570 INFO:tasks.workunit.client.0.trial090.stdout:test counter @ start: 13701120 2026-02-17T05:01:04.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:502: TEST_just_deep_scrubs: ceph tell 1.2 schedule-deep-scrub 2026-02-17T05:01:04.623 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:04.623 INFO:tasks.workunit.client.0.trial090.stdout: "deep": true, 2026-02-17T05:01:04.623 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T05:01:04.623 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-06T00:12:54.622687+0000" 2026-02-17T05:01:04.623 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:04.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:504: TEST_just_deep_scrubs: sleep 5 2026-02-17T05:01:09.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:506: TEST_just_deep_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-17T05:01:09.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:506: TEST_just_deep_scrubs: jq -r '.pg_stats[] | "\(.pgid) \(.stat_sum.num_objects)"' 2026-02-17T05:01:09.784 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:01:09.792 INFO:tasks.workunit.client.0.trial090.stdout:1.3 20 2026-02-17T05:01:09.792 INFO:tasks.workunit.client.0.trial090.stdout:1.2 20 2026-02-17T05:01:09.792 INFO:tasks.workunit.client.0.trial090.stdout:1.1 25 2026-02-17T05:01:09.792 INFO:tasks.workunit.client.0.trial090.stdout:1.0 25 2026-02-17T05:01:09.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: ceph pg 1.2 query --format=json-pretty 2026-02-17T05:01:09.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: jq -r .info.stats.stat_sum.num_objects 2026-02-17T05:01:09.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: echo 'Objects # in pg 1.2: ' 20 2026-02-17T05:01:09.852 INFO:tasks.workunit.client.0.trial090.stdout:Objects # in pg 1.2: 20 2026-02-17T05:01:09.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:509: TEST_just_deep_scrubs: declare -A sc_data_2 2026-02-17T05:01:09.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:510: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04,070633791+00:00 sc_data_2 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sc_data_2 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-17T05:01:09.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-17T05:01:10.009 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 0, 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic deep scrub scheduled", 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-17T05:01:09.218768+0000", 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 18, 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 44 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:10.018 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T05:01:11.295647+0000", 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "deep scrub scheduled @ 2026-02-17T05:01:11.295 (2026-02-10T23:16:27.503)", 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "test_sequence": 13701120, 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T05:01:10.077 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T05:00:52.384290+0000", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-17T05:01:11.295647+0000", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-10T23:16:27.503287+0000", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "noscrub", 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:10.078 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T05:01:10.137 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=18 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=45 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='deep scrub scheduled' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-17T05:01:11.295' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-10T23:16:27.503' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=0 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T05:00:52.384290+0000' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='0x0' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=false 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=13701120 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=0 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic deep scrub scheduled' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-17T05:01:09.218768+0000' 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=18 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=44 2026-02-17T05:01:10.138 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T05:01:10.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:511: TEST_just_deep_scrubs: echo 'test counter @ should show no change: ' 13701120 2026-02-17T05:01:10.140 INFO:tasks.workunit.client.0.trial090.stdout:test counter @ should show no change: 13701120 2026-02-17T05:01:10.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:512: TEST_just_deep_scrubs: (( 0 == 0 )) 2026-02-17T05:01:10.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:513: TEST_just_deep_scrubs: (( 13701120 == 13701120 )) 2026-02-17T05:01:10.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:516: TEST_just_deep_scrubs: ceph osd unset nodeep-scrub 2026-02-17T05:01:10.352 INFO:tasks.workunit.client.0.trial090.stderr:nodeep-scrub is unset 2026-02-17T05:01:10.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:517: TEST_just_deep_scrubs: sleep 8 2026-02-17T05:01:18.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:518: TEST_just_deep_scrubs: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-17T05:01:18.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:518: TEST_just_deep_scrubs: declare -A expct_qry_duration 2026-02-17T05:01:18.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:519: TEST_just_deep_scrubs: sc_data_2=() 2026-02-17T05:01:18.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:520: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:04,070633791+00:00 sc_data_2 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sc_data_2 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-17T05:01:04,070633791+00:00 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-17T05:01:18.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-17T05:01:18.524 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:01:18.533 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T05:01:18.533 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T05:01:18.533 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T05:01:18.533 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 19, 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 56 2026-02-17T05:01:18.534 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:18.535 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T05:01:18.591 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T05:01:18.591 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T05:01:18.591 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T05:01:12.323 (2026-02-18T05:01:12.323)", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "test_sequence": 13701123, 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:18.592 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:18.593 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T11:17:49.207452+0000", 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T11:17:49.207452+0000", 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:18.594 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T05:01:18.651 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T05:01:18.651 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T05:01:18.651 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=58 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T05:01:12.323' 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T05:01:12.323' 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T05:01:12.323977+0000' 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='16x20' 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T05:01:18.652 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=13701123 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T05:01:12.323977+0000' 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=19 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=56 2026-02-17T05:01:18.653 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T05:01:18.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:521: TEST_just_deep_scrubs: echo 'test counter @ should be higher than before the unset: ' 13701123 2026-02-17T05:01:18.655 INFO:tasks.workunit.client.0.trial090.stdout:test counter @ should be higher than before the unset: 13701123 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:523: TEST_just_deep_scrubs: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:523: TEST_just_deep_scrubs: declare -A expct_qry_duration 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:524: TEST_just_deep_scrubs: sc_data_2=() 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:525: TEST_just_deep_scrubs: wait_any_cond 1.2 10 2026-02-17T05:00:52.384290+0000 expct_qry_duration 'WaitingAfterScrub ' sc_data_2 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.2 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-17T05:00:52.384290+0000 2026-02-17T05:01:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_qry_duration 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sc_data_2 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-17T05:01:18.658 INFO:tasks.workunit.client.0.trial090.stdout:waiting for any condition (WaitingAfterScrub ): pg:1.2 dt:2026-02-17T05:00:52.384290+0000 (10 retries) 2026-02-17T05:01:19.315 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:01:19.324 INFO:tasks.workunit.client.0.trial090.stdout:from pg dump pg: { 2026-02-17T05:01:19.324 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_pg_state": "active+clean", 2026-02-17T05:01:19.324 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_state_has_scrubbing": false, 2026-02-17T05:01:19.324 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_last_duration": 1, 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_schedule_at": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_is_future": true, 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_vs_date": true, 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_reported_epoch": 19, 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout: "dmp_seq": 56 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:19.325 INFO:tasks.workunit.client.0.trial090.stdout:query output: 2026-02-17T05:01:19.382 INFO:tasks.workunit.client.0.trial090.stdout: "scrubber": { 2026-02-17T05:01:19.382 INFO:tasks.workunit.client.0.trial090.stdout: "active": false, 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "must_scrub": false, 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "must_deep_scrub": false, 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "must_repair": false, 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "schedule": "scrub scheduled @ 2026-02-18T05:01:12.323 (2026-02-18T05:01:12.323)", 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "test_sequence": 13701123, 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "shallow-target": { 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.383 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-18T05:01:12.323977+0000", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "deep-target": { 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "pgid": "1.2", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "urgency": "periodic-regular", 2026-02-17T05:01:19.384 INFO:tasks.workunit.client.0.trial090.stdout: "sched_time": "2026-02-24T11:17:49.207452+0000", 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "orig_sched_time": "2026-02-24T11:17:49.207452+0000", 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "last_issue": "ok", 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "forced": false, 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "eligible": false, 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "queued": true, 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "active": false 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.385 INFO:tasks.workunit.client.0.trial090.stdout: "agent_state": {} 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:( 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:[query_epoch]=19 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:[query_seq]=58 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:[query_active]=false 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule]='scrub scheduled' 2026-02-17T05:01:19.443 INFO:tasks.workunit.client.0.trial090.stdout:[query_schedule_at]='2026-02-18T05:01:12.323' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_target_at]='2026-02-18T05:01:12.323' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_duration]=1 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_stamp]='2026-02-17T05:01:12.323977+0000' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_last_scrub]='16x20' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_is_future]=true 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_vs_date]=true 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[query_scrub_seq]=13701123 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_pg_state]='active+clean' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_state_has_scrubbing]=false 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_last_duration]=1 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-17T05:01:19.444 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_schedule_at]='2026-02-18T05:01:12.323977+0000' 2026-02-17T05:01:19.445 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_is_future]=true 2026-02-17T05:01:19.445 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_vs_date]=true 2026-02-17T05:01:19.445 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_reported_epoch]=19 2026-02-17T05:01:19.445 INFO:tasks.workunit.client.0.trial090.stdout:[dmp_seq]=56 2026-02-17T05:01:19.445 INFO:tasks.workunit.client.0.trial090.stdout:) 2026-02-17T05:01:19.446 INFO:tasks.workunit.client.0.trial090.stdout:--> loop: 1 ~ false / 58 / 56 / true / 2026-02-17T05:01:12.323977+0000 / scrub scheduled %%% query_last_duration_neg query_last_duration 2026-02-17T05:01:19.446 INFO:tasks.workunit.client.0.trial090.stdout:key is query_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-17T05:01:19.446 INFO:tasks.workunit.client.0.trial090.stdout:WaitingAfterScrub - 'query_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:526: TEST_just_deep_scrubs: perf_counters td/osd-scrub-test 3 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T05:01:19.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T05:01:19.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:19.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:01:19.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.506 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:19.507 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 2, 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.508 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.509 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.510 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:19.511 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:01:19.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:19.562 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.563 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.564 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.565 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.566 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.567 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.568 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.568 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.568 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.568 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:19.568 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:19.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:19.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T05:01:19.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.621 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.622 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.623 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.624 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:19.625 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:19.626 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:19.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_just_deep_scrubs ------------------' 2026-02-17T05:01:19.627 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_just_deep_scrubs ------------------ 2026-02-17T05:01:19.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:01:19.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:19.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:19.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:19.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:19.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:19.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:19.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:19.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:19.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:19.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:19.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:19.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:19.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:19.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:19.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:19.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:19.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:19.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:19.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_just_deep_scrubs ------------------' 2026-02-17T05:01:19.748 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_just_deep_scrubs ------------------ 2026-02-17T05:01:19.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T05:01:19.749 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_pg_dump_objects_scrubbed ------------------- 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_pg_dump_objects_scrubbed -------------------' 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:19.751 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:19.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:19.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:19.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:19.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:19.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:19.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:19.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:19.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:19.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:19.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:19.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:19.754 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:19.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:19.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:19.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:19.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:19.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:19.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:01:19.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:01:19.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:01:19.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:01:19.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:01:19.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:01:19.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:01:19.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_pg_dump_objects_scrubbed -----------------------' 2026-02-17T05:01:19.764 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_pg_dump_objects_scrubbed ----------------------- 2026-02-17T05:01:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_pg_dump_objects_scrubbed td/osd-scrub-test 2026-02-17T05:01:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:653: TEST_pg_dump_objects_scrubbed: local dir=td/osd-scrub-test 2026-02-17T05:01:19.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:654: TEST_pg_dump_objects_scrubbed: local poolname=test 2026-02-17T05:01:19.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:655: TEST_pg_dump_objects_scrubbed: local OSDS=3 2026-02-17T05:01:19.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:656: TEST_pg_dump_objects_scrubbed: local objects=15 2026-02-17T05:01:19.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:657: TEST_pg_dump_objects_scrubbed: local timeout=10 2026-02-17T05:01:19.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:659: TEST_pg_dump_objects_scrubbed: TESTDATA=testdata.897552 2026-02-17T05:01:19.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:661: TEST_pg_dump_objects_scrubbed: setup td/osd-scrub-test 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:19.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:19.773 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:19.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:19.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:19.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:19.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:662: TEST_pg_dump_objects_scrubbed: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T05:01:19.782 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:01:19.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:01:19.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:01:19.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T05:01:19.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T05:01:19.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:01:19.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:19.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:19.794 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:19.794 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.794 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:19.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T05:01:19.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:01:19.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:01:19.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:01:19.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:01:19.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:01:19.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:01:19.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T05:01:19.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:01:19.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.865 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:01:19.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:01:19.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T05:01:19.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:663: TEST_pg_dump_objects_scrubbed: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T05:01:19.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T05:01:19.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:01:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:01:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:01:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T05:01:19.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:01:19.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:01:19.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:19.991 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:19.992 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:19.992 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:19.992 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:19.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:19.992 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:01:19.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T05:01:20.007 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: expr 3 - 1 2026-02-17T05:01:20.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: seq 0 2 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 0 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:20.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:01:20.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T05:01:20.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:20.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=524162e5-c120-4320-8eeb-400729b0f97b 2026-02-17T05:01:20.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 524162e5-c120-4320-8eeb-400729b0f97b' 2026-02-17T05:01:20.013 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 524162e5-c120-4320-8eeb-400729b0f97b 2026-02-17T05:01:20.013 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:20.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAg9pNpD5RcARAA5ds4ELtr25MWMUO1Z64JYg== 2026-02-17T05:01:20.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAg9pNpD5RcARAA5ds4ELtr25MWMUO1Z64JYg=="}' 2026-02-17T05:01:20.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 524162e5-c120-4320-8eeb-400729b0f97b -i td/osd-scrub-test/0/new.json 2026-02-17T05:01:20.104 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:20.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T05:01:20.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAg9pNpD5RcARAA5ds4ELtr25MWMUO1Z64JYg== --osd-uuid 524162e5-c120-4320-8eeb-400729b0f97b 2026-02-17T05:01:20.127 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.125+0000 7fd962451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.128 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.127+0000 7fd962451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.129 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.128+0000 7fd962451780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.130 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.128+0000 7fd962451780 -1 bdev(0x43e4c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:20.130 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.128+0000 7fd962451780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T05:01:20.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T05:01:20.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:20.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:01:20.509 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:01:20.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:20.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:01:20.597 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:01:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:01:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:20.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:20.610 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.609+0000 7f7e94a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.611 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.610+0000 7f7e94a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.612 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.611+0000 7f7e94a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:20.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:20.677 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:20.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:20.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:01:20.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:20.809 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:20.808+0000 7f7e94a0c780 -1 Falling back to public interface 2026-02-17T05:01:21.192 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.190+0000 7f7e94a0c780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:01:21.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:21.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:21.759 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:21.760 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:21.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:21.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:01:21.833 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/239015402,v1:127.0.0.1:6801/239015402] [v2:127.0.0.1:6802/239015402,v1:127.0.0.1:6803/239015402] exists,up 524162e5-c120-4320-8eeb-400729b0f97b 2026-02-17T05:01:21.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:21.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:21.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:21.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:21.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 1 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:21.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:01:21.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T05:01:21.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:21.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ffc1421-d88f-4e4b-8043-246cdcb5095b 2026-02-17T05:01:21.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5ffc1421-d88f-4e4b-8043-246cdcb5095b' 2026-02-17T05:01:21.838 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 5ffc1421-d88f-4e4b-8043-246cdcb5095b 2026-02-17T05:01:21.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:21.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAh9pNpEQSBMhAA4HGK1FSVUDKsI34nmnLo5g== 2026-02-17T05:01:21.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAh9pNpEQSBMhAA4HGK1FSVUDKsI34nmnLo5g=="}' 2026-02-17T05:01:21.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ffc1421-d88f-4e4b-8043-246cdcb5095b -i td/osd-scrub-test/1/new.json 2026-02-17T05:01:21.927 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:21.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T05:01:21.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAh9pNpEQSBMhAA4HGK1FSVUDKsI34nmnLo5g== --osd-uuid 5ffc1421-d88f-4e4b-8043-246cdcb5095b 2026-02-17T05:01:21.950 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.949+0000 7f6601038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:21.952 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.950+0000 7f6601038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:21.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.951+0000 7f6601038780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:21.953 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.951+0000 7f6601038780 -1 bdev(0x36c6c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:21.954 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:21.952+0000 7f6601038780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T05:01:22.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T05:01:22.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:22.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:01:22.323 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:01:22.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:22.535 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:01:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:01:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:01:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:22.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:22.548 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:22.547+0000 7fbfb4830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:22.550 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:22.548+0000 7fbfb4830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:22.550 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:22.549+0000 7fbfb4830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:22.697 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:22.695+0000 7fbfb4830780 -1 Falling back to public interface 2026-02-17T05:01:22.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:01:22.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:22.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:01:22.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:22.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:22.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:22.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:22.702 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:22.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:22.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:01:22.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:23.018 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:23.016+0000 7fbfb4830780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:01:23.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:23.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:23.865 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:23.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:01:24.028 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/982643633,v1:127.0.0.1:6811/982643633] [v2:127.0.0.1:6812/982643633,v1:127.0.0.1:6813/982643633] exists,up 5ffc1421-d88f-4e4b-8043-246cdcb5095b 2026-02-17T05:01:24.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:24.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:24.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 2 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:24.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:24.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:24.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=316c51bc-6f30-4559-a485-cbe31074f9bd 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 316c51bc-6f30-4559-a485-cbe31074f9bd' 2026-02-17T05:01:24.036 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 316c51bc-6f30-4559-a485-cbe31074f9bd 2026-02-17T05:01:24.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAk9pNpm6xsAhAAMAU4v1D/bTT8ZlXFdDjvRQ== 2026-02-17T05:01:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAk9pNpm6xsAhAAMAU4v1D/bTT8ZlXFdDjvRQ=="}' 2026-02-17T05:01:24.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 316c51bc-6f30-4559-a485-cbe31074f9bd -i td/osd-scrub-test/2/new.json 2026-02-17T05:01:24.204 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:01:24.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T05:01:24.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAk9pNpm6xsAhAAMAU4v1D/bTT8ZlXFdDjvRQ== --osd-uuid 316c51bc-6f30-4559-a485-cbe31074f9bd 2026-02-17T05:01:24.229 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.228+0000 7f452da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.231 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.229+0000 7f452da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.231 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.230+0000 7f452da0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.230+0000 7f452da0c780 -1 bdev(0x272cc00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:24.232 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.231+0000 7f452da0c780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T05:01:24.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T05:01:24.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:24.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:01:24.554 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:01:24.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:24.764 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:01:24.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:01:24.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:01:24.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:24.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:24.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:24.778 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.777+0000 7f0d27a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.778+0000 7f0d27a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.780 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.779+0000 7f0d27a30780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:24.916 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:24.914+0000 7f0d27a30780 -1 Falling back to public interface 2026-02-17T05:01:24.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:24.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:24.930 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:24.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:24.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:01:25.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:25.242 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:25.240+0000 7f0d27a30780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:01:26.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:26.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:26.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:26.095 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:26.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:26.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:01:26.259 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2003361563,v1:127.0.0.1:6819/2003361563] [v2:127.0.0.1:6820/2003361563,v1:127.0.0.1:6821/2003361563] exists,up 316c51bc-6f30-4559-a485-cbe31074f9bd 2026-02-17T05:01:26.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:26.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:26.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:26.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:670: TEST_pg_dump_objects_scrubbed: create_pool test 1 1 2026-02-17T05:01:26.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:01:26.476 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T05:01:26.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:01:27.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:671: TEST_pg_dump_objects_scrubbed: wait_for_clean 2026-02-17T05:01:27.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:01:27.489 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:01:27.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:01:27.490 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:01:27.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:01:27.491 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:01:27.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:01:27.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:01:27.491 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:01:27.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:01:27.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:01:27.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:01:27.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:01:27.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:01:27.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:01:27.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:01:27.744 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:01:27.745 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:01:27.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:01:27.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:27.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:01:27.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:01:27.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:01:27.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:01:27.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:27.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:01:27.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T05:01:27.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T05:01:27.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-17T05:01:27.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:27.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:01:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:01:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:01:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542147' 2026-02-17T05:01:27.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:27.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:01:27.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:27.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:01:27.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:01:27.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:27.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:01:27.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:01:27.922 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:01:27.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:01:28.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T05:01:28.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:01:29.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:01:29.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:01:29.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:01:29.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:29.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T05:01:29.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:29.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:01:29.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T05:01:29.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:29.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T05:01:29.258 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705670 2026-02-17T05:01:29.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T05:01:29.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:01:29.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-17T05:01:29.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:29.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:01:29.422 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:29.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:01:29.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:01:29.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:29.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:01:29.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:01:29.424 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:01:29.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:01:29.586 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:01:29.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:01:29.587 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:01:29.588 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:01:29.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:01:29.805 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:01:29.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:01:29.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:01:29.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:01:29.967 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:01:30.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:01:30.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:01:30.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:01:30.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: ceph osd dump 2026-02-17T05:01:30.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: grep '^pool.*['\'']test['\'']' 2026-02-17T05:01:30.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: awk '{ print $2 }' 2026-02-17T05:01:30.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: poolid=1 2026-02-17T05:01:30.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:674: TEST_pg_dump_objects_scrubbed: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T05:01:30.340 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T05:01:30.340 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T05:01:30.341 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.7279e-05 s, 27.7 MB/s 2026-02-17T05:01:30.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: seq 1 15 2026-02-17T05:01:30.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj1 testdata.897552 2026-02-17T05:01:30.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj2 testdata.897552 2026-02-17T05:01:30.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj3 testdata.897552 2026-02-17T05:01:30.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj4 testdata.897552 2026-02-17T05:01:30.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj5 testdata.897552 2026-02-17T05:01:30.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj6 testdata.897552 2026-02-17T05:01:30.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj7 testdata.897552 2026-02-17T05:01:30.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj8 testdata.897552 2026-02-17T05:01:30.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj9 testdata.897552 2026-02-17T05:01:30.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj10 testdata.897552 2026-02-17T05:01:30.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj11 testdata.897552 2026-02-17T05:01:30.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj12 testdata.897552 2026-02-17T05:01:30.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj13 testdata.897552 2026-02-17T05:01:30.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj14 testdata.897552 2026-02-17T05:01:30.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-17T05:01:30.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj15 testdata.897552 2026-02-17T05:01:30.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:679: TEST_pg_dump_objects_scrubbed: rm -f testdata.897552 2026-02-17T05:01:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:681: TEST_pg_dump_objects_scrubbed: local pgid=1.0 2026-02-17T05:01:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:683: TEST_pg_dump_objects_scrubbed: pg_scrub 1.0 2026-02-17T05:01:30.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-17T05:01:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-17T05:01:30.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T05:01:30.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T05:01:30.575 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:01:30.575 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:01:30.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:01:30.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:01:30.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:01:30.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:01:30.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:01:30.946 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:01:30.946 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:01:30.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:01:30.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:30.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:01:31.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-17T05:01:31.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-17T05:01:31.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-17T05:01:31.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:31.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:01:31.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T05:01:31.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T05:01:31.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-17T05:01:31.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:31.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:01:31.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T05:01:31.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T05:01:31.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542151' 2026-02-17T05:01:31.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:31.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-17T05:01:31.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:31.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:01:31.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-17T05:01:31.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:31.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-17T05:01:31.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-17T05:01:31.124 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836491 2026-02-17T05:01:31.124 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:01:31.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-17T05:01:31.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:01:32.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:01:32.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:01:32.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836491 2026-02-17T05:01:32.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:32.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T05:01:32.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:32.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:01:32.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T05:01:32.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:32.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T05:01:32.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T05:01:32.465 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705674 2026-02-17T05:01:32.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:01:32.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705674 2026-02-17T05:01:32.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:32.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T05:01:32.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:32.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:01:32.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T05:01:32.632 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:32.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T05:01:32.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T05:01:32.633 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542151 2026-02-17T05:01:32.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:01:32.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-17T05:01:32.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T05:01:32.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T05:01:32.797 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T05:01:32.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T05:01:32.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T05:01:32.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T05:01:32.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T05:01:32.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:01:32.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:01:33.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:33.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-17T05:01:33.174 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:01:33.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:01:33.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:01:33.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:01:33.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:01:33.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:01:33.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:01:26.475127+0000 '>' 2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:33.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:01:34.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:01:34.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:01:34.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:01:34.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:01:34.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:01:34.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:01:34.348 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:01:34.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:01:26.475127+0000 '>' 2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:34.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:01:35.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:01:35.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:01:35.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:01:35.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:01:35.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:01:35.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:01:35.514 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:01:35.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:01:26.475127+0000 '>' 2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:35.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:01:36.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:01:36.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:01:36.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:01:36.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:01:36.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:01:36.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:01:36.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:01:36.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:01:33.888996+0000 '>' 2026-02-17T05:01:26.475127+0000 2026-02-17T05:01:36.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T05:01:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: ceph pg 1.0 query 2026-02-17T05:01:36.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: jq .info.stats.objects_scrubbed 2026-02-17T05:01:36.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: test 15 = 15 2026-02-17T05:01:36.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:685: TEST_pg_dump_objects_scrubbed: perf_counters td/osd-scrub-test 3 2026-02-17T05:01:36.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:01:36.904 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T05:01:36.904 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T05:01:36.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T05:01:36.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:36.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:01:36.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:36.963 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:36.964 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:36.965 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:36.966 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:36.967 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:36.968 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:36.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:36.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:01:36.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:37.018 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:37.018 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:37.018 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.019 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.020 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.021 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:37.022 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 1, 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:37.023 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T05:01:37.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:01:37.076 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.077 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.078 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.079 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:01:37.080 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:01:37.081 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:01:37.082 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:687: TEST_pg_dump_objects_scrubbed: teardown td/osd-scrub-test 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:37.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:37.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:37.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:37.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:37.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:37.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:37.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:37.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:37.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:37.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:37.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:37.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:37.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:37.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:37.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:37.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:37.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:37.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:37.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_pg_dump_objects_scrubbed ------------------' 2026-02-17T05:01:37.201 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_pg_dump_objects_scrubbed ------------------ 2026-02-17T05:01:37.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:01:37.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:37.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:37.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:37.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:37.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:37.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:37.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:37.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:37.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:37.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:37.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:37.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:37.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:37.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:37.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:37.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:37.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:37.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:37.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_pg_dump_objects_scrubbed ------------------' 2026-02-17T05:01:37.212 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_pg_dump_objects_scrubbed ------------------ 2026-02-17T05:01:37.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T05:01:37.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_abort -------------------' 2026-02-17T05:01:37.213 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_scrub_abort ------------------- 2026-02-17T05:01:37.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:01:37.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:01:37.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:01:37.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:01:37.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:01:37.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:01:37.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:01:37.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:01:37.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:01:37.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:01:37.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:01:37.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:01:37.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:01:37.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:01:37.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:01:37.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:01:37.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:01:37.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:01:37.222 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:01:37.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:01:37.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.223 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:01:37.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:01:37.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:01:37.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:01:37.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:01:37.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_abort -----------------------' 2026-02-17T05:01:37.225 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_scrub_abort ----------------------- 2026-02-17T05:01:37.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_abort td/osd-scrub-test 2026-02-17T05:01:37.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:404: TEST_scrub_abort: local dir=td/osd-scrub-test 2026-02-17T05:01:37.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:405: TEST_scrub_abort: _scrub_abort td/osd-scrub-test scrub 2026-02-17T05:01:37.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:293: _scrub_abort: local dir=td/osd-scrub-test 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:294: _scrub_abort: local poolname=test 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:295: _scrub_abort: local OSDS=3 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:296: _scrub_abort: local objects=1000 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:297: _scrub_abort: local type=scrub 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:299: _scrub_abort: TESTDATA=testdata.897552 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:300: _scrub_abort: test scrub = scrub 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:302: _scrub_abort: stopscrub=noscrub 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:303: _scrub_abort: check=noscrub 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:309: _scrub_abort: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T05:01:37.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T05:01:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:01:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:01:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:01:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T05:01:37.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T05:01:37.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:37.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T05:01:37.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:01:37.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:01:37.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:01:37.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:01:37.269 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:01:37.270 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:01:37.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:01:37.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:01:37.270 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:01:37.271 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T05:01:37.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:01:37.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:01:37.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:01:37.316 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:01:37.317 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.318 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:01:37.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:01:37.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T05:01:37.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:310: _scrub_abort: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T05:01:37.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T05:01:37.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:01:37.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:01:37.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:01:37.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T05:01:37.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.446 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:37.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:01:37.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T05:01:37.462 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: expr 3 - 1 2026-02-17T05:01:37.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: seq 0 2 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 0 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:37.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:37.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:37.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:37.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:37.472 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5403eaaf-8839-4b7c-a30e-271b84453ea3 2026-02-17T05:01:37.473 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5403eaaf-8839-4b7c-a30e-271b84453ea3' 2026-02-17T05:01:37.473 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 5403eaaf-8839-4b7c-a30e-271b84453ea3 2026-02-17T05:01:37.473 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:37.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAx9pNpq656HBAA0QYXwQVJktgF4wGxaEa3gw== 2026-02-17T05:01:37.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAx9pNpq656HBAA0QYXwQVJktgF4wGxaEa3gw=="}' 2026-02-17T05:01:37.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5403eaaf-8839-4b7c-a30e-271b84453ea3 -i td/osd-scrub-test/0/new.json 2026-02-17T05:01:37.559 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:37.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T05:01:37.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQAx9pNpq656HBAA0QYXwQVJktgF4wGxaEa3gw== --osd-uuid 5403eaaf-8839-4b7c-a30e-271b84453ea3 2026-02-17T05:01:37.585 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:37.584+0000 7f6a1ca53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:37.586 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:37.586+0000 7f6a1ca53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:37.588 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:37.587+0000 7f6a1ca53780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:37.588 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:37.587+0000 7f6a1ca53780 -1 bdev(0x2e32c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:37.588 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:37.587+0000 7f6a1ca53780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T05:01:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T05:01:37.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:37.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:01:37.989 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:01:37.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:38.074 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:01:38.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:01:38.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:38.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:38.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:38.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:38.089 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:38.089+0000 7f30f4818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:38.090 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:38.090+0000 7f30f4818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:38.091 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:38.091+0000 7f30f4818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:38.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:38.154 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:38.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:38.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:01:38.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:38.290 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:38.290+0000 7f30f4818780 -1 Falling back to public interface 2026-02-17T05:01:38.619 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:38.619+0000 7f30f4818780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:01:39.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:39.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:39.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:39.237 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:39.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:39.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:01:39.313 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1297142261,v1:127.0.0.1:6801/1297142261] [v2:127.0.0.1:6802/1297142261,v1:127.0.0.1:6803/1297142261] exists,up 5403eaaf-8839-4b7c-a30e-271b84453ea3 2026-02-17T05:01:39.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 1 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:39.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:39.319 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:39.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ba0c2017-3112-4eeb-af0d-5ed97591d8db 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ba0c2017-3112-4eeb-af0d-5ed97591d8db' 2026-02-17T05:01:39.321 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 ba0c2017-3112-4eeb-af0d-5ed97591d8db 2026-02-17T05:01:39.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAz9pNpVS9yExAAhG470Mol2fL/6t031q6iZQ== 2026-02-17T05:01:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAz9pNpVS9yExAAhG470Mol2fL/6t031q6iZQ=="}' 2026-02-17T05:01:39.327 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ba0c2017-3112-4eeb-af0d-5ed97591d8db -i td/osd-scrub-test/1/new.json 2026-02-17T05:01:39.405 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:39.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T05:01:39.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQAz9pNpVS9yExAAhG470Mol2fL/6t031q6iZQ== --osd-uuid ba0c2017-3112-4eeb-af0d-5ed97591d8db 2026-02-17T05:01:39.428 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:39.428+0000 7f598be64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:39.430 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:39.430+0000 7f598be64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:39.431 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:39.430+0000 7f598be64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:39.431 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:39.431+0000 7f598be64780 -1 bdev(0x2548c00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:39.431 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:39.431+0000 7f598be64780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T05:01:39.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T05:01:39.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:39.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:01:39.794 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:01:39.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:40.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:01:40.016 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:01:40.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:40.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:40.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:40.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:40.031 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:40.030+0000 7ff1b0c3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:40.032 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:40.032+0000 7ff1b0c3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:40.033 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:40.032+0000 7ff1b0c3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:40.180 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:40.179+0000 7ff1b0c3f780 -1 Falling back to public interface 2026-02-17T05:01:40.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:40.182 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:40.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:40.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:01:40.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:40.470 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:40.469+0000 7ff1b0c3f780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:01:41.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:41.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:41.347 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:41.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:41.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:01:41.512 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3340626050,v1:127.0.0.1:6811/3340626050] [v2:127.0.0.1:6812/3340626050,v1:127.0.0.1:6813/3340626050] exists,up ba0c2017-3112-4eeb-af0d-5ed97591d8db 2026-02-17T05:01:41.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:41.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:41.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:41.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 2 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:01:41.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:01:41.518 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:01:41.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2' 2026-02-17T05:01:41.520 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2 2026-02-17T05:01:41.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:01:41.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA19pNpcvs9HxAAC3yVC9Thdt0BxmH7I+dB9Q== 2026-02-17T05:01:41.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA19pNpcvs9HxAAC3yVC9Thdt0BxmH7I+dB9Q=="}' 2026-02-17T05:01:41.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2 -i td/osd-scrub-test/2/new.json 2026-02-17T05:01:41.688 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:01:41.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T05:01:41.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQA19pNpcvs9HxAAC3yVC9Thdt0BxmH7I+dB9Q== --osd-uuid 28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2 2026-02-17T05:01:41.714 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:41.713+0000 7f5305031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:41.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:41.714+0000 7f5305031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:41.715 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:41.715+0000 7f5305031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:41.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:41.716+0000 7f5305031780 -1 bdev(0x39c6c00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:01:41.716 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:41.716+0000 7f5305031780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T05:01:42.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T05:01:42.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:01:42.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:01:42.071 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:01:42.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:01:42.284 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:01:42.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:01:42.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-17T05:01:42.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:01:42.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:01:42.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:01:42.301 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:42.301+0000 7f44b8664780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:42.302 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:42.302+0000 7f44b8664780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:42.303 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:42.303+0000 7f44b8664780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:01:42.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:42.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:01:42.451 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:01:42.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:42.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:01:42.506 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:42.506+0000 7f44b8664780 -1 Falling back to public interface 2026-02-17T05:01:42.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:01:42.825 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:01:42.824+0000 7f44b8664780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:01:43.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:01:43.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:01:43.614 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:01:43.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:01:43.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:01:43.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:01:43.785 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1669875322,v1:127.0.0.1:6819/1669875322] [v2:127.0.0.1:6820/1669875322,v1:127.0.0.1:6821/1669875322] exists,up 28e7a8bb-8e90-4d90-8d82-d24bfc60d6e2 2026-02-17T05:01:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:01:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:01:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:01:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:325: _scrub_abort: create_pool test 1 1 2026-02-17T05:01:43.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:01:43.999 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T05:01:44.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:01:45.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:326: _scrub_abort: wait_for_clean 2026-02-17T05:01:45.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:01:45.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:01:45.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:01:45.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:01:45.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:01:45.010 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:01:45.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:01:45.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:01:45.010 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:01:45.098 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:45.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:01:45.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:01:45.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:01:45.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:01:45.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:45.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:01:45.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T05:01:45.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T05:01:45.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T05:01:45.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:01:45.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:01:45.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:01:45.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:01:45.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542147' 2026-02-17T05:01:45.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:45.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:01:45.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:45.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:01:45.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:01:45.437 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:45.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:01:45.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:01:45.439 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:01:45.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:01:45.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:01:45.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:45.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T05:01:45.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:45.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:01:45.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T05:01:45.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:45.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T05:01:45.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T05:01:45.605 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672966 2026-02-17T05:01:45.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:01:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T05:01:45.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:01:45.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:01:45.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:01:45.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:01:45.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:01:45.780 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:01:45.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:01:45.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:01:45.782 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:01:45.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:01:45.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:01:45.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:01:45.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:01:45.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:01:46.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:01:46.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:01:46.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:01:46.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:01:46.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:01:46.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:01:46.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:01:46.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:01:46.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:01:46.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: ceph osd dump 2026-02-17T05:01:46.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: grep '^pool.*['\'']test['\'']' 2026-02-17T05:01:46.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: awk '{ print $2 }' 2026-02-17T05:01:46.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: poolid=1 2026-02-17T05:01:46.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:329: _scrub_abort: dd if=/dev/urandom of=testdata.897552 bs=1032 count=1 2026-02-17T05:01:46.692 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T05:01:46.692 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T05:01:46.693 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 3.9935e-05 s, 25.8 MB/s 2026-02-17T05:01:46.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: seq 1 1000 2026-02-17T05:01:46.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1 testdata.897552 2026-02-17T05:01:46.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj2 testdata.897552 2026-02-17T05:01:46.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj3 testdata.897552 2026-02-17T05:01:46.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj4 testdata.897552 2026-02-17T05:01:46.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj5 testdata.897552 2026-02-17T05:01:46.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj6 testdata.897552 2026-02-17T05:01:46.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj7 testdata.897552 2026-02-17T05:01:46.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj8 testdata.897552 2026-02-17T05:01:46.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj9 testdata.897552 2026-02-17T05:01:46.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj10 testdata.897552 2026-02-17T05:01:46.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj11 testdata.897552 2026-02-17T05:01:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj12 testdata.897552 2026-02-17T05:01:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj13 testdata.897552 2026-02-17T05:01:46.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj14 testdata.897552 2026-02-17T05:01:46.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj15 testdata.897552 2026-02-17T05:01:46.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj16 testdata.897552 2026-02-17T05:01:46.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj17 testdata.897552 2026-02-17T05:01:46.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.967 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj18 testdata.897552 2026-02-17T05:01:46.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj19 testdata.897552 2026-02-17T05:01:46.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:46.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj20 testdata.897552 2026-02-17T05:01:47.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj21 testdata.897552 2026-02-17T05:01:47.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj22 testdata.897552 2026-02-17T05:01:47.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj23 testdata.897552 2026-02-17T05:01:47.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj24 testdata.897552 2026-02-17T05:01:47.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj25 testdata.897552 2026-02-17T05:01:47.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.092 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj26 testdata.897552 2026-02-17T05:01:47.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj27 testdata.897552 2026-02-17T05:01:47.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj28 testdata.897552 2026-02-17T05:01:47.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj29 testdata.897552 2026-02-17T05:01:47.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj30 testdata.897552 2026-02-17T05:01:47.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj31 testdata.897552 2026-02-17T05:01:47.186 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj32 testdata.897552 2026-02-17T05:01:47.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj33 testdata.897552 2026-02-17T05:01:47.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj34 testdata.897552 2026-02-17T05:01:47.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj35 testdata.897552 2026-02-17T05:01:47.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj36 testdata.897552 2026-02-17T05:01:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj37 testdata.897552 2026-02-17T05:01:47.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj38 testdata.897552 2026-02-17T05:01:47.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj39 testdata.897552 2026-02-17T05:01:47.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj40 testdata.897552 2026-02-17T05:01:47.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj41 testdata.897552 2026-02-17T05:01:47.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj42 testdata.897552 2026-02-17T05:01:47.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj43 testdata.897552 2026-02-17T05:01:47.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj44 testdata.897552 2026-02-17T05:01:47.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj45 testdata.897552 2026-02-17T05:01:47.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj46 testdata.897552 2026-02-17T05:01:47.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj47 testdata.897552 2026-02-17T05:01:47.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj48 testdata.897552 2026-02-17T05:01:47.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj49 testdata.897552 2026-02-17T05:01:47.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj50 testdata.897552 2026-02-17T05:01:47.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj51 testdata.897552 2026-02-17T05:01:47.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj52 testdata.897552 2026-02-17T05:01:47.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj53 testdata.897552 2026-02-17T05:01:47.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj54 testdata.897552 2026-02-17T05:01:47.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj55 testdata.897552 2026-02-17T05:01:47.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj56 testdata.897552 2026-02-17T05:01:47.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj57 testdata.897552 2026-02-17T05:01:47.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj58 testdata.897552 2026-02-17T05:01:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj59 testdata.897552 2026-02-17T05:01:47.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj60 testdata.897552 2026-02-17T05:01:47.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj61 testdata.897552 2026-02-17T05:01:47.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj62 testdata.897552 2026-02-17T05:01:47.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj63 testdata.897552 2026-02-17T05:01:47.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj64 testdata.897552 2026-02-17T05:01:47.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj65 testdata.897552 2026-02-17T05:01:47.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj66 testdata.897552 2026-02-17T05:01:47.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj67 testdata.897552 2026-02-17T05:01:47.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj68 testdata.897552 2026-02-17T05:01:47.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj69 testdata.897552 2026-02-17T05:01:47.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.780 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj70 testdata.897552 2026-02-17T05:01:47.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj71 testdata.897552 2026-02-17T05:01:47.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj72 testdata.897552 2026-02-17T05:01:47.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj73 testdata.897552 2026-02-17T05:01:47.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj74 testdata.897552 2026-02-17T05:01:47.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj75 testdata.897552 2026-02-17T05:01:47.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj76 testdata.897552 2026-02-17T05:01:47.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj77 testdata.897552 2026-02-17T05:01:47.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj78 testdata.897552 2026-02-17T05:01:47.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj79 testdata.897552 2026-02-17T05:01:47.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj80 testdata.897552 2026-02-17T05:01:47.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj81 testdata.897552 2026-02-17T05:01:47.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj82 testdata.897552 2026-02-17T05:01:47.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:47.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj83 testdata.897552 2026-02-17T05:01:48.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj84 testdata.897552 2026-02-17T05:01:48.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj85 testdata.897552 2026-02-17T05:01:48.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj86 testdata.897552 2026-02-17T05:01:48.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj87 testdata.897552 2026-02-17T05:01:48.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj88 testdata.897552 2026-02-17T05:01:48.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj89 testdata.897552 2026-02-17T05:01:48.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj90 testdata.897552 2026-02-17T05:01:48.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj91 testdata.897552 2026-02-17T05:01:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj92 testdata.897552 2026-02-17T05:01:48.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj93 testdata.897552 2026-02-17T05:01:48.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj94 testdata.897552 2026-02-17T05:01:48.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj95 testdata.897552 2026-02-17T05:01:48.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj96 testdata.897552 2026-02-17T05:01:48.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj97 testdata.897552 2026-02-17T05:01:48.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj98 testdata.897552 2026-02-17T05:01:48.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj99 testdata.897552 2026-02-17T05:01:48.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj100 testdata.897552 2026-02-17T05:01:48.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj101 testdata.897552 2026-02-17T05:01:48.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj102 testdata.897552 2026-02-17T05:01:48.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj103 testdata.897552 2026-02-17T05:01:48.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj104 testdata.897552 2026-02-17T05:01:48.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj105 testdata.897552 2026-02-17T05:01:48.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj106 testdata.897552 2026-02-17T05:01:48.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj107 testdata.897552 2026-02-17T05:01:48.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj108 testdata.897552 2026-02-17T05:01:48.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj109 testdata.897552 2026-02-17T05:01:48.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj110 testdata.897552 2026-02-17T05:01:48.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj111 testdata.897552 2026-02-17T05:01:48.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.435 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj112 testdata.897552 2026-02-17T05:01:48.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj113 testdata.897552 2026-02-17T05:01:48.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj114 testdata.897552 2026-02-17T05:01:48.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj115 testdata.897552 2026-02-17T05:01:48.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj116 testdata.897552 2026-02-17T05:01:48.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj117 testdata.897552 2026-02-17T05:01:48.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj118 testdata.897552 2026-02-17T05:01:48.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj119 testdata.897552 2026-02-17T05:01:48.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj120 testdata.897552 2026-02-17T05:01:48.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj121 testdata.897552 2026-02-17T05:01:48.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj122 testdata.897552 2026-02-17T05:01:48.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj123 testdata.897552 2026-02-17T05:01:48.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj124 testdata.897552 2026-02-17T05:01:48.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj125 testdata.897552 2026-02-17T05:01:48.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj126 testdata.897552 2026-02-17T05:01:48.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj127 testdata.897552 2026-02-17T05:01:48.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj128 testdata.897552 2026-02-17T05:01:48.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj129 testdata.897552 2026-02-17T05:01:48.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj130 testdata.897552 2026-02-17T05:01:48.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj131 testdata.897552 2026-02-17T05:01:48.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj132 testdata.897552 2026-02-17T05:01:48.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj133 testdata.897552 2026-02-17T05:01:48.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj134 testdata.897552 2026-02-17T05:01:48.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj135 testdata.897552 2026-02-17T05:01:48.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj136 testdata.897552 2026-02-17T05:01:48.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj137 testdata.897552 2026-02-17T05:01:48.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj138 testdata.897552 2026-02-17T05:01:48.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj139 testdata.897552 2026-02-17T05:01:48.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj140 testdata.897552 2026-02-17T05:01:48.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj141 testdata.897552 2026-02-17T05:01:48.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj142 testdata.897552 2026-02-17T05:01:48.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj143 testdata.897552 2026-02-17T05:01:48.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj144 testdata.897552 2026-02-17T05:01:48.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj145 testdata.897552 2026-02-17T05:01:48.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj146 testdata.897552 2026-02-17T05:01:48.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.971 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj147 testdata.897552 2026-02-17T05:01:48.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:48.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj148 testdata.897552 2026-02-17T05:01:49.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.002 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj149 testdata.897552 2026-02-17T05:01:49.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj150 testdata.897552 2026-02-17T05:01:49.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj151 testdata.897552 2026-02-17T05:01:49.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj152 testdata.897552 2026-02-17T05:01:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj153 testdata.897552 2026-02-17T05:01:49.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj154 testdata.897552 2026-02-17T05:01:49.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.095 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj155 testdata.897552 2026-02-17T05:01:49.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.111 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj156 testdata.897552 2026-02-17T05:01:49.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj157 testdata.897552 2026-02-17T05:01:49.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj158 testdata.897552 2026-02-17T05:01:49.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj159 testdata.897552 2026-02-17T05:01:49.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj160 testdata.897552 2026-02-17T05:01:49.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj161 testdata.897552 2026-02-17T05:01:49.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj162 testdata.897552 2026-02-17T05:01:49.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj163 testdata.897552 2026-02-17T05:01:49.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj164 testdata.897552 2026-02-17T05:01:49.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj165 testdata.897552 2026-02-17T05:01:49.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj166 testdata.897552 2026-02-17T05:01:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj167 testdata.897552 2026-02-17T05:01:49.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj168 testdata.897552 2026-02-17T05:01:49.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj169 testdata.897552 2026-02-17T05:01:49.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj170 testdata.897552 2026-02-17T05:01:49.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj171 testdata.897552 2026-02-17T05:01:49.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj172 testdata.897552 2026-02-17T05:01:49.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj173 testdata.897552 2026-02-17T05:01:49.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj174 testdata.897552 2026-02-17T05:01:49.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj175 testdata.897552 2026-02-17T05:01:49.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj176 testdata.897552 2026-02-17T05:01:49.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj177 testdata.897552 2026-02-17T05:01:49.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj178 testdata.897552 2026-02-17T05:01:49.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj179 testdata.897552 2026-02-17T05:01:49.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj180 testdata.897552 2026-02-17T05:01:49.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj181 testdata.897552 2026-02-17T05:01:49.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj182 testdata.897552 2026-02-17T05:01:49.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj183 testdata.897552 2026-02-17T05:01:49.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj184 testdata.897552 2026-02-17T05:01:49.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj185 testdata.897552 2026-02-17T05:01:49.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj186 testdata.897552 2026-02-17T05:01:49.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj187 testdata.897552 2026-02-17T05:01:49.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj188 testdata.897552 2026-02-17T05:01:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.630 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj189 testdata.897552 2026-02-17T05:01:49.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj190 testdata.897552 2026-02-17T05:01:49.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj191 testdata.897552 2026-02-17T05:01:49.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj192 testdata.897552 2026-02-17T05:01:49.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj193 testdata.897552 2026-02-17T05:01:49.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj194 testdata.897552 2026-02-17T05:01:49.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj195 testdata.897552 2026-02-17T05:01:49.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj196 testdata.897552 2026-02-17T05:01:49.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj197 testdata.897552 2026-02-17T05:01:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj198 testdata.897552 2026-02-17T05:01:49.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj199 testdata.897552 2026-02-17T05:01:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj200 testdata.897552 2026-02-17T05:01:49.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj201 testdata.897552 2026-02-17T05:01:49.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj202 testdata.897552 2026-02-17T05:01:49.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj203 testdata.897552 2026-02-17T05:01:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj204 testdata.897552 2026-02-17T05:01:49.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj205 testdata.897552 2026-02-17T05:01:49.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj206 testdata.897552 2026-02-17T05:01:49.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj207 testdata.897552 2026-02-17T05:01:49.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj208 testdata.897552 2026-02-17T05:01:49.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj209 testdata.897552 2026-02-17T05:01:49.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj210 testdata.897552 2026-02-17T05:01:49.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj211 testdata.897552 2026-02-17T05:01:49.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:49.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj212 testdata.897552 2026-02-17T05:01:50.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj213 testdata.897552 2026-02-17T05:01:50.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj214 testdata.897552 2026-02-17T05:01:50.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj215 testdata.897552 2026-02-17T05:01:50.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj216 testdata.897552 2026-02-17T05:01:50.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj217 testdata.897552 2026-02-17T05:01:50.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj218 testdata.897552 2026-02-17T05:01:50.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj219 testdata.897552 2026-02-17T05:01:50.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj220 testdata.897552 2026-02-17T05:01:50.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj221 testdata.897552 2026-02-17T05:01:50.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj222 testdata.897552 2026-02-17T05:01:50.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj223 testdata.897552 2026-02-17T05:01:50.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj224 testdata.897552 2026-02-17T05:01:50.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj225 testdata.897552 2026-02-17T05:01:50.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj226 testdata.897552 2026-02-17T05:01:50.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj227 testdata.897552 2026-02-17T05:01:50.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj228 testdata.897552 2026-02-17T05:01:50.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj229 testdata.897552 2026-02-17T05:01:50.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj230 testdata.897552 2026-02-17T05:01:50.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj231 testdata.897552 2026-02-17T05:01:50.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj232 testdata.897552 2026-02-17T05:01:50.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj233 testdata.897552 2026-02-17T05:01:50.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj234 testdata.897552 2026-02-17T05:01:50.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj235 testdata.897552 2026-02-17T05:01:50.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj236 testdata.897552 2026-02-17T05:01:50.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj237 testdata.897552 2026-02-17T05:01:50.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj238 testdata.897552 2026-02-17T05:01:50.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj239 testdata.897552 2026-02-17T05:01:50.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj240 testdata.897552 2026-02-17T05:01:50.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj241 testdata.897552 2026-02-17T05:01:50.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj242 testdata.897552 2026-02-17T05:01:50.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj243 testdata.897552 2026-02-17T05:01:50.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj244 testdata.897552 2026-02-17T05:01:50.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj245 testdata.897552 2026-02-17T05:01:50.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj246 testdata.897552 2026-02-17T05:01:50.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj247 testdata.897552 2026-02-17T05:01:50.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj248 testdata.897552 2026-02-17T05:01:50.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj249 testdata.897552 2026-02-17T05:01:50.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj250 testdata.897552 2026-02-17T05:01:50.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj251 testdata.897552 2026-02-17T05:01:50.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj252 testdata.897552 2026-02-17T05:01:50.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj253 testdata.897552 2026-02-17T05:01:50.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.652 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj254 testdata.897552 2026-02-17T05:01:50.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj255 testdata.897552 2026-02-17T05:01:50.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj256 testdata.897552 2026-02-17T05:01:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj257 testdata.897552 2026-02-17T05:01:50.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj258 testdata.897552 2026-02-17T05:01:50.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj259 testdata.897552 2026-02-17T05:01:50.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj260 testdata.897552 2026-02-17T05:01:50.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj261 testdata.897552 2026-02-17T05:01:50.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj262 testdata.897552 2026-02-17T05:01:50.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj263 testdata.897552 2026-02-17T05:01:50.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj264 testdata.897552 2026-02-17T05:01:50.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj265 testdata.897552 2026-02-17T05:01:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj266 testdata.897552 2026-02-17T05:01:50.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj267 testdata.897552 2026-02-17T05:01:50.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj268 testdata.897552 2026-02-17T05:01:50.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj269 testdata.897552 2026-02-17T05:01:50.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj270 testdata.897552 2026-02-17T05:01:50.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj271 testdata.897552 2026-02-17T05:01:50.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj272 testdata.897552 2026-02-17T05:01:50.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj273 testdata.897552 2026-02-17T05:01:50.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj274 testdata.897552 2026-02-17T05:01:50.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj275 testdata.897552 2026-02-17T05:01:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:50.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj276 testdata.897552 2026-02-17T05:01:51.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.012 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj277 testdata.897552 2026-02-17T05:01:51.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj278 testdata.897552 2026-02-17T05:01:51.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj279 testdata.897552 2026-02-17T05:01:51.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj280 testdata.897552 2026-02-17T05:01:51.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj281 testdata.897552 2026-02-17T05:01:51.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj282 testdata.897552 2026-02-17T05:01:51.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj283 testdata.897552 2026-02-17T05:01:51.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj284 testdata.897552 2026-02-17T05:01:51.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj285 testdata.897552 2026-02-17T05:01:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.153 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj286 testdata.897552 2026-02-17T05:01:51.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.169 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj287 testdata.897552 2026-02-17T05:01:51.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj288 testdata.897552 2026-02-17T05:01:51.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj289 testdata.897552 2026-02-17T05:01:51.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj290 testdata.897552 2026-02-17T05:01:51.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj291 testdata.897552 2026-02-17T05:01:51.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj292 testdata.897552 2026-02-17T05:01:51.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj293 testdata.897552 2026-02-17T05:01:51.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj294 testdata.897552 2026-02-17T05:01:51.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj295 testdata.897552 2026-02-17T05:01:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj296 testdata.897552 2026-02-17T05:01:51.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj297 testdata.897552 2026-02-17T05:01:51.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj298 testdata.897552 2026-02-17T05:01:51.355 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj299 testdata.897552 2026-02-17T05:01:51.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj300 testdata.897552 2026-02-17T05:01:51.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj301 testdata.897552 2026-02-17T05:01:51.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj302 testdata.897552 2026-02-17T05:01:51.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj303 testdata.897552 2026-02-17T05:01:51.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj304 testdata.897552 2026-02-17T05:01:51.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj305 testdata.897552 2026-02-17T05:01:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj306 testdata.897552 2026-02-17T05:01:51.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj307 testdata.897552 2026-02-17T05:01:51.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj308 testdata.897552 2026-02-17T05:01:51.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj309 testdata.897552 2026-02-17T05:01:51.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj310 testdata.897552 2026-02-17T05:01:51.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj311 testdata.897552 2026-02-17T05:01:51.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj312 testdata.897552 2026-02-17T05:01:51.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj313 testdata.897552 2026-02-17T05:01:51.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj314 testdata.897552 2026-02-17T05:01:51.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj315 testdata.897552 2026-02-17T05:01:51.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj316 testdata.897552 2026-02-17T05:01:51.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj317 testdata.897552 2026-02-17T05:01:51.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.654 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj318 testdata.897552 2026-02-17T05:01:51.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj319 testdata.897552 2026-02-17T05:01:51.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.685 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj320 testdata.897552 2026-02-17T05:01:51.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj321 testdata.897552 2026-02-17T05:01:51.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj322 testdata.897552 2026-02-17T05:01:51.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj323 testdata.897552 2026-02-17T05:01:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj324 testdata.897552 2026-02-17T05:01:51.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj325 testdata.897552 2026-02-17T05:01:51.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj326 testdata.897552 2026-02-17T05:01:51.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj327 testdata.897552 2026-02-17T05:01:51.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj328 testdata.897552 2026-02-17T05:01:51.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj329 testdata.897552 2026-02-17T05:01:51.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj330 testdata.897552 2026-02-17T05:01:51.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj331 testdata.897552 2026-02-17T05:01:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj332 testdata.897552 2026-02-17T05:01:51.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj333 testdata.897552 2026-02-17T05:01:51.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj334 testdata.897552 2026-02-17T05:01:51.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj335 testdata.897552 2026-02-17T05:01:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj336 testdata.897552 2026-02-17T05:01:51.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj337 testdata.897552 2026-02-17T05:01:51.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.966 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj338 testdata.897552 2026-02-17T05:01:51.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj339 testdata.897552 2026-02-17T05:01:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:51.996 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj340 testdata.897552 2026-02-17T05:01:52.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj341 testdata.897552 2026-02-17T05:01:52.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj342 testdata.897552 2026-02-17T05:01:52.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj343 testdata.897552 2026-02-17T05:01:52.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj344 testdata.897552 2026-02-17T05:01:52.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj345 testdata.897552 2026-02-17T05:01:52.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj346 testdata.897552 2026-02-17T05:01:52.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj347 testdata.897552 2026-02-17T05:01:52.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj348 testdata.897552 2026-02-17T05:01:52.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj349 testdata.897552 2026-02-17T05:01:52.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj350 testdata.897552 2026-02-17T05:01:52.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj351 testdata.897552 2026-02-17T05:01:52.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj352 testdata.897552 2026-02-17T05:01:52.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj353 testdata.897552 2026-02-17T05:01:52.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj354 testdata.897552 2026-02-17T05:01:52.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj355 testdata.897552 2026-02-17T05:01:52.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj356 testdata.897552 2026-02-17T05:01:52.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj357 testdata.897552 2026-02-17T05:01:52.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj358 testdata.897552 2026-02-17T05:01:52.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj359 testdata.897552 2026-02-17T05:01:52.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj360 testdata.897552 2026-02-17T05:01:52.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj361 testdata.897552 2026-02-17T05:01:52.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj362 testdata.897552 2026-02-17T05:01:52.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj363 testdata.897552 2026-02-17T05:01:52.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj364 testdata.897552 2026-02-17T05:01:52.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj365 testdata.897552 2026-02-17T05:01:52.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj366 testdata.897552 2026-02-17T05:01:52.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj367 testdata.897552 2026-02-17T05:01:52.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj368 testdata.897552 2026-02-17T05:01:52.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj369 testdata.897552 2026-02-17T05:01:52.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj370 testdata.897552 2026-02-17T05:01:52.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj371 testdata.897552 2026-02-17T05:01:52.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj372 testdata.897552 2026-02-17T05:01:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.514 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj373 testdata.897552 2026-02-17T05:01:52.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj374 testdata.897552 2026-02-17T05:01:52.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj375 testdata.897552 2026-02-17T05:01:52.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj376 testdata.897552 2026-02-17T05:01:52.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj377 testdata.897552 2026-02-17T05:01:52.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj378 testdata.897552 2026-02-17T05:01:52.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj379 testdata.897552 2026-02-17T05:01:52.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj380 testdata.897552 2026-02-17T05:01:52.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.641 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj381 testdata.897552 2026-02-17T05:01:52.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj382 testdata.897552 2026-02-17T05:01:52.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj383 testdata.897552 2026-02-17T05:01:52.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj384 testdata.897552 2026-02-17T05:01:52.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj385 testdata.897552 2026-02-17T05:01:52.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj386 testdata.897552 2026-02-17T05:01:52.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj387 testdata.897552 2026-02-17T05:01:52.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.750 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj388 testdata.897552 2026-02-17T05:01:52.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj389 testdata.897552 2026-02-17T05:01:52.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.781 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj390 testdata.897552 2026-02-17T05:01:52.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.796 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj391 testdata.897552 2026-02-17T05:01:52.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj392 testdata.897552 2026-02-17T05:01:52.827 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj393 testdata.897552 2026-02-17T05:01:52.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj394 testdata.897552 2026-02-17T05:01:52.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj395 testdata.897552 2026-02-17T05:01:52.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj396 testdata.897552 2026-02-17T05:01:52.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj397 testdata.897552 2026-02-17T05:01:52.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj398 testdata.897552 2026-02-17T05:01:52.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj399 testdata.897552 2026-02-17T05:01:52.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj400 testdata.897552 2026-02-17T05:01:52.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj401 testdata.897552 2026-02-17T05:01:52.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.969 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj402 testdata.897552 2026-02-17T05:01:52.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:52.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj403 testdata.897552 2026-02-17T05:01:53.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj404 testdata.897552 2026-02-17T05:01:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj405 testdata.897552 2026-02-17T05:01:53.031 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj406 testdata.897552 2026-02-17T05:01:53.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj407 testdata.897552 2026-02-17T05:01:53.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj408 testdata.897552 2026-02-17T05:01:53.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj409 testdata.897552 2026-02-17T05:01:53.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj410 testdata.897552 2026-02-17T05:01:53.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj411 testdata.897552 2026-02-17T05:01:53.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj412 testdata.897552 2026-02-17T05:01:53.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj413 testdata.897552 2026-02-17T05:01:53.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj414 testdata.897552 2026-02-17T05:01:53.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj415 testdata.897552 2026-02-17T05:01:53.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj416 testdata.897552 2026-02-17T05:01:53.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj417 testdata.897552 2026-02-17T05:01:53.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj418 testdata.897552 2026-02-17T05:01:53.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj419 testdata.897552 2026-02-17T05:01:53.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj420 testdata.897552 2026-02-17T05:01:53.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj421 testdata.897552 2026-02-17T05:01:53.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj422 testdata.897552 2026-02-17T05:01:53.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj423 testdata.897552 2026-02-17T05:01:53.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj424 testdata.897552 2026-02-17T05:01:53.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj425 testdata.897552 2026-02-17T05:01:53.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.347 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj426 testdata.897552 2026-02-17T05:01:53.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj427 testdata.897552 2026-02-17T05:01:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj428 testdata.897552 2026-02-17T05:01:53.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj429 testdata.897552 2026-02-17T05:01:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj430 testdata.897552 2026-02-17T05:01:53.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj431 testdata.897552 2026-02-17T05:01:53.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj432 testdata.897552 2026-02-17T05:01:53.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj433 testdata.897552 2026-02-17T05:01:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj434 testdata.897552 2026-02-17T05:01:53.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj435 testdata.897552 2026-02-17T05:01:53.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj436 testdata.897552 2026-02-17T05:01:53.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj437 testdata.897552 2026-02-17T05:01:53.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj438 testdata.897552 2026-02-17T05:01:53.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj439 testdata.897552 2026-02-17T05:01:53.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj440 testdata.897552 2026-02-17T05:01:53.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj441 testdata.897552 2026-02-17T05:01:53.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj442 testdata.897552 2026-02-17T05:01:53.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj443 testdata.897552 2026-02-17T05:01:53.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj444 testdata.897552 2026-02-17T05:01:53.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj445 testdata.897552 2026-02-17T05:01:53.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj446 testdata.897552 2026-02-17T05:01:53.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj447 testdata.897552 2026-02-17T05:01:53.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj448 testdata.897552 2026-02-17T05:01:53.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj449 testdata.897552 2026-02-17T05:01:53.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj450 testdata.897552 2026-02-17T05:01:53.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj451 testdata.897552 2026-02-17T05:01:53.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj452 testdata.897552 2026-02-17T05:01:53.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj453 testdata.897552 2026-02-17T05:01:53.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj454 testdata.897552 2026-02-17T05:01:53.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj455 testdata.897552 2026-02-17T05:01:53.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj456 testdata.897552 2026-02-17T05:01:53.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj457 testdata.897552 2026-02-17T05:01:53.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj458 testdata.897552 2026-02-17T05:01:53.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj459 testdata.897552 2026-02-17T05:01:53.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj460 testdata.897552 2026-02-17T05:01:53.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj461 testdata.897552 2026-02-17T05:01:53.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj462 testdata.897552 2026-02-17T05:01:53.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj463 testdata.897552 2026-02-17T05:01:53.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj464 testdata.897552 2026-02-17T05:01:53.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj465 testdata.897552 2026-02-17T05:01:53.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.974 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj466 testdata.897552 2026-02-17T05:01:53.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:53.990 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj467 testdata.897552 2026-02-17T05:01:54.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj468 testdata.897552 2026-02-17T05:01:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj469 testdata.897552 2026-02-17T05:01:54.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj470 testdata.897552 2026-02-17T05:01:54.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj471 testdata.897552 2026-02-17T05:01:54.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj472 testdata.897552 2026-02-17T05:01:54.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj473 testdata.897552 2026-02-17T05:01:54.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj474 testdata.897552 2026-02-17T05:01:54.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj475 testdata.897552 2026-02-17T05:01:54.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.131 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj476 testdata.897552 2026-02-17T05:01:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj477 testdata.897552 2026-02-17T05:01:54.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj478 testdata.897552 2026-02-17T05:01:54.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj479 testdata.897552 2026-02-17T05:01:54.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj480 testdata.897552 2026-02-17T05:01:54.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj481 testdata.897552 2026-02-17T05:01:54.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj482 testdata.897552 2026-02-17T05:01:54.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj483 testdata.897552 2026-02-17T05:01:54.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj484 testdata.897552 2026-02-17T05:01:54.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.270 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj485 testdata.897552 2026-02-17T05:01:54.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj486 testdata.897552 2026-02-17T05:01:54.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj487 testdata.897552 2026-02-17T05:01:54.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj488 testdata.897552 2026-02-17T05:01:54.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj489 testdata.897552 2026-02-17T05:01:54.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.348 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj490 testdata.897552 2026-02-17T05:01:54.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj491 testdata.897552 2026-02-17T05:01:54.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj492 testdata.897552 2026-02-17T05:01:54.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj493 testdata.897552 2026-02-17T05:01:54.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj494 testdata.897552 2026-02-17T05:01:54.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj495 testdata.897552 2026-02-17T05:01:54.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj496 testdata.897552 2026-02-17T05:01:54.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.459 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj497 testdata.897552 2026-02-17T05:01:54.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj498 testdata.897552 2026-02-17T05:01:54.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.490 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj499 testdata.897552 2026-02-17T05:01:54.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj500 testdata.897552 2026-02-17T05:01:54.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj501 testdata.897552 2026-02-17T05:01:54.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj502 testdata.897552 2026-02-17T05:01:54.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj503 testdata.897552 2026-02-17T05:01:54.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.569 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj504 testdata.897552 2026-02-17T05:01:54.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.584 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj505 testdata.897552 2026-02-17T05:01:54.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj506 testdata.897552 2026-02-17T05:01:54.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj507 testdata.897552 2026-02-17T05:01:54.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj508 testdata.897552 2026-02-17T05:01:54.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj509 testdata.897552 2026-02-17T05:01:54.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj510 testdata.897552 2026-02-17T05:01:54.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj511 testdata.897552 2026-02-17T05:01:54.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj512 testdata.897552 2026-02-17T05:01:54.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj513 testdata.897552 2026-02-17T05:01:54.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj514 testdata.897552 2026-02-17T05:01:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj515 testdata.897552 2026-02-17T05:01:54.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj516 testdata.897552 2026-02-17T05:01:54.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj517 testdata.897552 2026-02-17T05:01:54.786 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj518 testdata.897552 2026-02-17T05:01:54.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj519 testdata.897552 2026-02-17T05:01:54.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj520 testdata.897552 2026-02-17T05:01:54.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj521 testdata.897552 2026-02-17T05:01:54.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj522 testdata.897552 2026-02-17T05:01:54.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj523 testdata.897552 2026-02-17T05:01:54.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj524 testdata.897552 2026-02-17T05:01:54.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj525 testdata.897552 2026-02-17T05:01:54.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj526 testdata.897552 2026-02-17T05:01:54.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj527 testdata.897552 2026-02-17T05:01:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj528 testdata.897552 2026-02-17T05:01:54.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj529 testdata.897552 2026-02-17T05:01:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj530 testdata.897552 2026-02-17T05:01:54.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:54.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj531 testdata.897552 2026-02-17T05:01:55.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj532 testdata.897552 2026-02-17T05:01:55.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj533 testdata.897552 2026-02-17T05:01:55.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj534 testdata.897552 2026-02-17T05:01:55.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj535 testdata.897552 2026-02-17T05:01:55.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.071 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj536 testdata.897552 2026-02-17T05:01:55.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.087 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj537 testdata.897552 2026-02-17T05:01:55.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj538 testdata.897552 2026-02-17T05:01:55.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.118 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj539 testdata.897552 2026-02-17T05:01:55.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj540 testdata.897552 2026-02-17T05:01:55.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj541 testdata.897552 2026-02-17T05:01:55.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj542 testdata.897552 2026-02-17T05:01:55.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj543 testdata.897552 2026-02-17T05:01:55.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj544 testdata.897552 2026-02-17T05:01:55.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj545 testdata.897552 2026-02-17T05:01:55.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj546 testdata.897552 2026-02-17T05:01:55.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj547 testdata.897552 2026-02-17T05:01:55.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj548 testdata.897552 2026-02-17T05:01:55.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj549 testdata.897552 2026-02-17T05:01:55.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.291 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj550 testdata.897552 2026-02-17T05:01:55.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj551 testdata.897552 2026-02-17T05:01:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj552 testdata.897552 2026-02-17T05:01:55.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj553 testdata.897552 2026-02-17T05:01:55.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj554 testdata.897552 2026-02-17T05:01:55.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj555 testdata.897552 2026-02-17T05:01:55.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj556 testdata.897552 2026-02-17T05:01:55.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj557 testdata.897552 2026-02-17T05:01:55.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj558 testdata.897552 2026-02-17T05:01:55.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.431 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj559 testdata.897552 2026-02-17T05:01:55.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj560 testdata.897552 2026-02-17T05:01:55.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.463 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj561 testdata.897552 2026-02-17T05:01:55.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj562 testdata.897552 2026-02-17T05:01:55.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj563 testdata.897552 2026-02-17T05:01:55.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj564 testdata.897552 2026-02-17T05:01:55.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj565 testdata.897552 2026-02-17T05:01:55.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj566 testdata.897552 2026-02-17T05:01:55.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj567 testdata.897552 2026-02-17T05:01:55.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj568 testdata.897552 2026-02-17T05:01:55.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj569 testdata.897552 2026-02-17T05:01:55.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj570 testdata.897552 2026-02-17T05:01:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.615 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj571 testdata.897552 2026-02-17T05:01:55.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj572 testdata.897552 2026-02-17T05:01:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj573 testdata.897552 2026-02-17T05:01:55.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj574 testdata.897552 2026-02-17T05:01:55.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj575 testdata.897552 2026-02-17T05:01:55.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj576 testdata.897552 2026-02-17T05:01:55.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj577 testdata.897552 2026-02-17T05:01:55.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj578 testdata.897552 2026-02-17T05:01:55.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj579 testdata.897552 2026-02-17T05:01:55.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.758 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj580 testdata.897552 2026-02-17T05:01:55.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj581 testdata.897552 2026-02-17T05:01:55.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj582 testdata.897552 2026-02-17T05:01:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj583 testdata.897552 2026-02-17T05:01:55.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj584 testdata.897552 2026-02-17T05:01:55.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj585 testdata.897552 2026-02-17T05:01:55.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj586 testdata.897552 2026-02-17T05:01:55.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj587 testdata.897552 2026-02-17T05:01:55.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj588 testdata.897552 2026-02-17T05:01:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj589 testdata.897552 2026-02-17T05:01:55.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj590 testdata.897552 2026-02-17T05:01:55.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.931 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj591 testdata.897552 2026-02-17T05:01:55.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj592 testdata.897552 2026-02-17T05:01:55.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj593 testdata.897552 2026-02-17T05:01:55.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj594 testdata.897552 2026-02-17T05:01:55.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:55.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj595 testdata.897552 2026-02-17T05:01:56.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj596 testdata.897552 2026-02-17T05:01:56.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj597 testdata.897552 2026-02-17T05:01:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj598 testdata.897552 2026-02-17T05:01:56.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj599 testdata.897552 2026-02-17T05:01:56.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj600 testdata.897552 2026-02-17T05:01:56.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj601 testdata.897552 2026-02-17T05:01:56.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj602 testdata.897552 2026-02-17T05:01:56.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj603 testdata.897552 2026-02-17T05:01:56.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.130 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj604 testdata.897552 2026-02-17T05:01:56.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.146 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj605 testdata.897552 2026-02-17T05:01:56.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj606 testdata.897552 2026-02-17T05:01:56.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj607 testdata.897552 2026-02-17T05:01:56.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj608 testdata.897552 2026-02-17T05:01:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj609 testdata.897552 2026-02-17T05:01:56.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj610 testdata.897552 2026-02-17T05:01:56.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj611 testdata.897552 2026-02-17T05:01:56.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj612 testdata.897552 2026-02-17T05:01:56.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj613 testdata.897552 2026-02-17T05:01:56.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj614 testdata.897552 2026-02-17T05:01:56.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj615 testdata.897552 2026-02-17T05:01:56.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj616 testdata.897552 2026-02-17T05:01:56.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj617 testdata.897552 2026-02-17T05:01:56.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj618 testdata.897552 2026-02-17T05:01:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj619 testdata.897552 2026-02-17T05:01:56.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj620 testdata.897552 2026-02-17T05:01:56.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj621 testdata.897552 2026-02-17T05:01:56.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj622 testdata.897552 2026-02-17T05:01:56.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.429 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj623 testdata.897552 2026-02-17T05:01:56.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj624 testdata.897552 2026-02-17T05:01:56.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj625 testdata.897552 2026-02-17T05:01:56.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj626 testdata.897552 2026-02-17T05:01:56.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj627 testdata.897552 2026-02-17T05:01:56.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj628 testdata.897552 2026-02-17T05:01:56.524 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj629 testdata.897552 2026-02-17T05:01:56.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj630 testdata.897552 2026-02-17T05:01:56.555 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj631 testdata.897552 2026-02-17T05:01:56.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj632 testdata.897552 2026-02-17T05:01:56.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.587 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj633 testdata.897552 2026-02-17T05:01:56.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj634 testdata.897552 2026-02-17T05:01:56.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj635 testdata.897552 2026-02-17T05:01:56.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj636 testdata.897552 2026-02-17T05:01:56.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj637 testdata.897552 2026-02-17T05:01:56.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj638 testdata.897552 2026-02-17T05:01:56.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj639 testdata.897552 2026-02-17T05:01:56.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj640 testdata.897552 2026-02-17T05:01:56.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj641 testdata.897552 2026-02-17T05:01:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj642 testdata.897552 2026-02-17T05:01:56.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj643 testdata.897552 2026-02-17T05:01:56.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj644 testdata.897552 2026-02-17T05:01:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj645 testdata.897552 2026-02-17T05:01:56.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj646 testdata.897552 2026-02-17T05:01:56.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj647 testdata.897552 2026-02-17T05:01:56.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj648 testdata.897552 2026-02-17T05:01:56.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj649 testdata.897552 2026-02-17T05:01:56.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj650 testdata.897552 2026-02-17T05:01:56.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj651 testdata.897552 2026-02-17T05:01:56.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj652 testdata.897552 2026-02-17T05:01:56.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj653 testdata.897552 2026-02-17T05:01:56.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj654 testdata.897552 2026-02-17T05:01:56.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj655 testdata.897552 2026-02-17T05:01:56.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj656 testdata.897552 2026-02-17T05:01:56.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj657 testdata.897552 2026-02-17T05:01:56.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj658 testdata.897552 2026-02-17T05:01:56.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:56.994 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj659 testdata.897552 2026-02-17T05:01:57.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj660 testdata.897552 2026-02-17T05:01:57.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj661 testdata.897552 2026-02-17T05:01:57.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj662 testdata.897552 2026-02-17T05:01:57.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.056 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj663 testdata.897552 2026-02-17T05:01:57.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj664 testdata.897552 2026-02-17T05:01:57.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.088 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj665 testdata.897552 2026-02-17T05:01:57.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.103 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj666 testdata.897552 2026-02-17T05:01:57.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj667 testdata.897552 2026-02-17T05:01:57.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj668 testdata.897552 2026-02-17T05:01:57.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj669 testdata.897552 2026-02-17T05:01:57.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj670 testdata.897552 2026-02-17T05:01:57.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj671 testdata.897552 2026-02-17T05:01:57.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj672 testdata.897552 2026-02-17T05:01:57.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj673 testdata.897552 2026-02-17T05:01:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj674 testdata.897552 2026-02-17T05:01:57.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj675 testdata.897552 2026-02-17T05:01:57.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj676 testdata.897552 2026-02-17T05:01:57.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj677 testdata.897552 2026-02-17T05:01:57.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj678 testdata.897552 2026-02-17T05:01:57.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.312 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj679 testdata.897552 2026-02-17T05:01:57.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj680 testdata.897552 2026-02-17T05:01:57.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj681 testdata.897552 2026-02-17T05:01:57.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj682 testdata.897552 2026-02-17T05:01:57.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj683 testdata.897552 2026-02-17T05:01:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj684 testdata.897552 2026-02-17T05:01:57.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj685 testdata.897552 2026-02-17T05:01:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj686 testdata.897552 2026-02-17T05:01:57.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj687 testdata.897552 2026-02-17T05:01:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj688 testdata.897552 2026-02-17T05:01:57.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj689 testdata.897552 2026-02-17T05:01:57.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj690 testdata.897552 2026-02-17T05:01:57.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj691 testdata.897552 2026-02-17T05:01:57.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj692 testdata.897552 2026-02-17T05:01:57.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj693 testdata.897552 2026-02-17T05:01:57.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj694 testdata.897552 2026-02-17T05:01:57.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj695 testdata.897552 2026-02-17T05:01:57.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj696 testdata.897552 2026-02-17T05:01:57.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj697 testdata.897552 2026-02-17T05:01:57.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj698 testdata.897552 2026-02-17T05:01:57.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj699 testdata.897552 2026-02-17T05:01:57.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.644 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj700 testdata.897552 2026-02-17T05:01:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj701 testdata.897552 2026-02-17T05:01:57.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj702 testdata.897552 2026-02-17T05:01:57.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj703 testdata.897552 2026-02-17T05:01:57.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj704 testdata.897552 2026-02-17T05:01:57.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj705 testdata.897552 2026-02-17T05:01:57.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj706 testdata.897552 2026-02-17T05:01:57.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj707 testdata.897552 2026-02-17T05:01:57.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj708 testdata.897552 2026-02-17T05:01:57.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj709 testdata.897552 2026-02-17T05:01:57.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj710 testdata.897552 2026-02-17T05:01:57.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj711 testdata.897552 2026-02-17T05:01:57.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj712 testdata.897552 2026-02-17T05:01:57.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj713 testdata.897552 2026-02-17T05:01:57.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj714 testdata.897552 2026-02-17T05:01:57.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj715 testdata.897552 2026-02-17T05:01:57.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj716 testdata.897552 2026-02-17T05:01:57.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj717 testdata.897552 2026-02-17T05:01:57.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj718 testdata.897552 2026-02-17T05:01:57.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.943 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj719 testdata.897552 2026-02-17T05:01:57.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj720 testdata.897552 2026-02-17T05:01:57.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj721 testdata.897552 2026-02-17T05:01:57.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:57.992 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj722 testdata.897552 2026-02-17T05:01:58.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj723 testdata.897552 2026-02-17T05:01:58.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj724 testdata.897552 2026-02-17T05:01:58.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj725 testdata.897552 2026-02-17T05:01:58.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj726 testdata.897552 2026-02-17T05:01:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj727 testdata.897552 2026-02-17T05:01:58.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj728 testdata.897552 2026-02-17T05:01:58.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj729 testdata.897552 2026-02-17T05:01:58.116 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj730 testdata.897552 2026-02-17T05:01:58.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj731 testdata.897552 2026-02-17T05:01:58.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj732 testdata.897552 2026-02-17T05:01:58.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj733 testdata.897552 2026-02-17T05:01:58.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj734 testdata.897552 2026-02-17T05:01:58.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj735 testdata.897552 2026-02-17T05:01:58.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj736 testdata.897552 2026-02-17T05:01:58.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj737 testdata.897552 2026-02-17T05:01:58.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj738 testdata.897552 2026-02-17T05:01:58.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj739 testdata.897552 2026-02-17T05:01:58.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj740 testdata.897552 2026-02-17T05:01:58.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj741 testdata.897552 2026-02-17T05:01:58.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj742 testdata.897552 2026-02-17T05:01:58.322 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.323 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj743 testdata.897552 2026-02-17T05:01:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj744 testdata.897552 2026-02-17T05:01:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj745 testdata.897552 2026-02-17T05:01:58.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj746 testdata.897552 2026-02-17T05:01:58.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj747 testdata.897552 2026-02-17T05:01:58.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj748 testdata.897552 2026-02-17T05:01:58.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj749 testdata.897552 2026-02-17T05:01:58.433 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj750 testdata.897552 2026-02-17T05:01:58.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.449 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj751 testdata.897552 2026-02-17T05:01:58.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj752 testdata.897552 2026-02-17T05:01:58.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.481 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj753 testdata.897552 2026-02-17T05:01:58.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj754 testdata.897552 2026-02-17T05:01:58.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.513 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj755 testdata.897552 2026-02-17T05:01:58.528 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj756 testdata.897552 2026-02-17T05:01:58.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj757 testdata.897552 2026-02-17T05:01:58.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj758 testdata.897552 2026-02-17T05:01:58.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj759 testdata.897552 2026-02-17T05:01:58.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj760 testdata.897552 2026-02-17T05:01:58.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj761 testdata.897552 2026-02-17T05:01:58.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj762 testdata.897552 2026-02-17T05:01:58.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj763 testdata.897552 2026-02-17T05:01:58.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj764 testdata.897552 2026-02-17T05:01:58.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj765 testdata.897552 2026-02-17T05:01:58.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj766 testdata.897552 2026-02-17T05:01:58.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj767 testdata.897552 2026-02-17T05:01:58.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj768 testdata.897552 2026-02-17T05:01:58.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj769 testdata.897552 2026-02-17T05:01:58.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj770 testdata.897552 2026-02-17T05:01:58.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj771 testdata.897552 2026-02-17T05:01:58.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj772 testdata.897552 2026-02-17T05:01:58.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj773 testdata.897552 2026-02-17T05:01:58.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj774 testdata.897552 2026-02-17T05:01:58.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj775 testdata.897552 2026-02-17T05:01:58.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj776 testdata.897552 2026-02-17T05:01:58.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj777 testdata.897552 2026-02-17T05:01:58.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj778 testdata.897552 2026-02-17T05:01:58.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj779 testdata.897552 2026-02-17T05:01:58.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj780 testdata.897552 2026-02-17T05:01:58.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj781 testdata.897552 2026-02-17T05:01:58.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj782 testdata.897552 2026-02-17T05:01:58.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj783 testdata.897552 2026-02-17T05:01:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj784 testdata.897552 2026-02-17T05:01:58.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj785 testdata.897552 2026-02-17T05:01:58.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj786 testdata.897552 2026-02-17T05:01:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:58.993 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj787 testdata.897552 2026-02-17T05:01:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj788 testdata.897552 2026-02-17T05:01:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj789 testdata.897552 2026-02-17T05:01:59.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.040 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj790 testdata.897552 2026-02-17T05:01:59.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj791 testdata.897552 2026-02-17T05:01:59.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj792 testdata.897552 2026-02-17T05:01:59.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj793 testdata.897552 2026-02-17T05:01:59.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.102 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj794 testdata.897552 2026-02-17T05:01:59.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj795 testdata.897552 2026-02-17T05:01:59.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj796 testdata.897552 2026-02-17T05:01:59.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj797 testdata.897552 2026-02-17T05:01:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj798 testdata.897552 2026-02-17T05:01:59.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj799 testdata.897552 2026-02-17T05:01:59.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj800 testdata.897552 2026-02-17T05:01:59.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj801 testdata.897552 2026-02-17T05:01:59.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj802 testdata.897552 2026-02-17T05:01:59.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj803 testdata.897552 2026-02-17T05:01:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj804 testdata.897552 2026-02-17T05:01:59.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj805 testdata.897552 2026-02-17T05:01:59.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj806 testdata.897552 2026-02-17T05:01:59.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj807 testdata.897552 2026-02-17T05:01:59.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj808 testdata.897552 2026-02-17T05:01:59.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj809 testdata.897552 2026-02-17T05:01:59.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj810 testdata.897552 2026-02-17T05:01:59.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj811 testdata.897552 2026-02-17T05:01:59.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj812 testdata.897552 2026-02-17T05:01:59.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.389 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj813 testdata.897552 2026-02-17T05:01:59.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj814 testdata.897552 2026-02-17T05:01:59.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj815 testdata.897552 2026-02-17T05:01:59.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj816 testdata.897552 2026-02-17T05:01:59.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj817 testdata.897552 2026-02-17T05:01:59.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj818 testdata.897552 2026-02-17T05:01:59.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj819 testdata.897552 2026-02-17T05:01:59.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj820 testdata.897552 2026-02-17T05:01:59.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj821 testdata.897552 2026-02-17T05:01:59.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj822 testdata.897552 2026-02-17T05:01:59.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj823 testdata.897552 2026-02-17T05:01:59.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj824 testdata.897552 2026-02-17T05:01:59.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.572 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj825 testdata.897552 2026-02-17T05:01:59.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj826 testdata.897552 2026-02-17T05:01:59.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj827 testdata.897552 2026-02-17T05:01:59.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj828 testdata.897552 2026-02-17T05:01:59.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj829 testdata.897552 2026-02-17T05:01:59.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj830 testdata.897552 2026-02-17T05:01:59.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj831 testdata.897552 2026-02-17T05:01:59.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj832 testdata.897552 2026-02-17T05:01:59.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj833 testdata.897552 2026-02-17T05:01:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj834 testdata.897552 2026-02-17T05:01:59.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj835 testdata.897552 2026-02-17T05:01:59.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj836 testdata.897552 2026-02-17T05:01:59.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj837 testdata.897552 2026-02-17T05:01:59.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.778 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj838 testdata.897552 2026-02-17T05:01:59.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj839 testdata.897552 2026-02-17T05:01:59.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj840 testdata.897552 2026-02-17T05:01:59.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj841 testdata.897552 2026-02-17T05:01:59.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj842 testdata.897552 2026-02-17T05:01:59.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj843 testdata.897552 2026-02-17T05:01:59.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj844 testdata.897552 2026-02-17T05:01:59.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj845 testdata.897552 2026-02-17T05:01:59.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj846 testdata.897552 2026-02-17T05:01:59.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj847 testdata.897552 2026-02-17T05:01:59.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj848 testdata.897552 2026-02-17T05:01:59.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj849 testdata.897552 2026-02-17T05:01:59.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj850 testdata.897552 2026-02-17T05:01:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:01:59.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj851 testdata.897552 2026-02-17T05:02:00.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj852 testdata.897552 2026-02-17T05:02:00.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj853 testdata.897552 2026-02-17T05:02:00.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj854 testdata.897552 2026-02-17T05:02:00.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj855 testdata.897552 2026-02-17T05:02:00.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj856 testdata.897552 2026-02-17T05:02:00.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj857 testdata.897552 2026-02-17T05:02:00.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj858 testdata.897552 2026-02-17T05:02:00.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj859 testdata.897552 2026-02-17T05:02:00.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj860 testdata.897552 2026-02-17T05:02:00.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.145 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj861 testdata.897552 2026-02-17T05:02:00.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.160 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj862 testdata.897552 2026-02-17T05:02:00.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj863 testdata.897552 2026-02-17T05:02:00.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj864 testdata.897552 2026-02-17T05:02:00.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj865 testdata.897552 2026-02-17T05:02:00.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj866 testdata.897552 2026-02-17T05:02:00.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj867 testdata.897552 2026-02-17T05:02:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj868 testdata.897552 2026-02-17T05:02:00.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.268 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj869 testdata.897552 2026-02-17T05:02:00.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj870 testdata.897552 2026-02-17T05:02:00.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj871 testdata.897552 2026-02-17T05:02:00.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.314 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj872 testdata.897552 2026-02-17T05:02:00.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.329 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj873 testdata.897552 2026-02-17T05:02:00.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj874 testdata.897552 2026-02-17T05:02:00.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj875 testdata.897552 2026-02-17T05:02:00.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj876 testdata.897552 2026-02-17T05:02:00.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj877 testdata.897552 2026-02-17T05:02:00.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj878 testdata.897552 2026-02-17T05:02:00.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj879 testdata.897552 2026-02-17T05:02:00.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj880 testdata.897552 2026-02-17T05:02:00.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj881 testdata.897552 2026-02-17T05:02:00.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj882 testdata.897552 2026-02-17T05:02:00.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj883 testdata.897552 2026-02-17T05:02:00.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.504 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj884 testdata.897552 2026-02-17T05:02:00.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj885 testdata.897552 2026-02-17T05:02:00.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj886 testdata.897552 2026-02-17T05:02:00.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj887 testdata.897552 2026-02-17T05:02:00.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj888 testdata.897552 2026-02-17T05:02:00.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj889 testdata.897552 2026-02-17T05:02:00.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.599 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj890 testdata.897552 2026-02-17T05:02:00.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj891 testdata.897552 2026-02-17T05:02:00.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj892 testdata.897552 2026-02-17T05:02:00.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj893 testdata.897552 2026-02-17T05:02:00.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj894 testdata.897552 2026-02-17T05:02:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj895 testdata.897552 2026-02-17T05:02:00.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj896 testdata.897552 2026-02-17T05:02:00.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj897 testdata.897552 2026-02-17T05:02:00.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj898 testdata.897552 2026-02-17T05:02:00.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj899 testdata.897552 2026-02-17T05:02:00.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj900 testdata.897552 2026-02-17T05:02:00.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.770 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj901 testdata.897552 2026-02-17T05:02:00.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.785 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj902 testdata.897552 2026-02-17T05:02:00.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj903 testdata.897552 2026-02-17T05:02:00.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj904 testdata.897552 2026-02-17T05:02:00.831 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj905 testdata.897552 2026-02-17T05:02:00.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj906 testdata.897552 2026-02-17T05:02:00.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj907 testdata.897552 2026-02-17T05:02:00.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj908 testdata.897552 2026-02-17T05:02:00.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj909 testdata.897552 2026-02-17T05:02:00.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj910 testdata.897552 2026-02-17T05:02:00.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj911 testdata.897552 2026-02-17T05:02:00.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj912 testdata.897552 2026-02-17T05:02:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj913 testdata.897552 2026-02-17T05:02:00.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj914 testdata.897552 2026-02-17T05:02:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:00.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj915 testdata.897552 2026-02-17T05:02:01.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj916 testdata.897552 2026-02-17T05:02:01.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj917 testdata.897552 2026-02-17T05:02:01.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj918 testdata.897552 2026-02-17T05:02:01.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj919 testdata.897552 2026-02-17T05:02:01.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj920 testdata.897552 2026-02-17T05:02:01.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj921 testdata.897552 2026-02-17T05:02:01.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.094 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj922 testdata.897552 2026-02-17T05:02:01.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj923 testdata.897552 2026-02-17T05:02:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.124 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj924 testdata.897552 2026-02-17T05:02:01.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj925 testdata.897552 2026-02-17T05:02:01.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj926 testdata.897552 2026-02-17T05:02:01.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj927 testdata.897552 2026-02-17T05:02:01.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj928 testdata.897552 2026-02-17T05:02:01.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj929 testdata.897552 2026-02-17T05:02:01.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj930 testdata.897552 2026-02-17T05:02:01.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj931 testdata.897552 2026-02-17T05:02:01.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj932 testdata.897552 2026-02-17T05:02:01.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj933 testdata.897552 2026-02-17T05:02:01.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj934 testdata.897552 2026-02-17T05:02:01.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj935 testdata.897552 2026-02-17T05:02:01.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj936 testdata.897552 2026-02-17T05:02:01.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.330 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj937 testdata.897552 2026-02-17T05:02:01.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.346 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj938 testdata.897552 2026-02-17T05:02:01.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj939 testdata.897552 2026-02-17T05:02:01.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj940 testdata.897552 2026-02-17T05:02:01.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj941 testdata.897552 2026-02-17T05:02:01.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj942 testdata.897552 2026-02-17T05:02:01.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj943 testdata.897552 2026-02-17T05:02:01.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj944 testdata.897552 2026-02-17T05:02:01.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.458 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj945 testdata.897552 2026-02-17T05:02:01.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj946 testdata.897552 2026-02-17T05:02:01.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj947 testdata.897552 2026-02-17T05:02:01.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj948 testdata.897552 2026-02-17T05:02:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.523 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj949 testdata.897552 2026-02-17T05:02:01.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj950 testdata.897552 2026-02-17T05:02:01.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj951 testdata.897552 2026-02-17T05:02:01.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj952 testdata.897552 2026-02-17T05:02:01.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.585 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj953 testdata.897552 2026-02-17T05:02:01.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj954 testdata.897552 2026-02-17T05:02:01.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj955 testdata.897552 2026-02-17T05:02:01.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj956 testdata.897552 2026-02-17T05:02:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj957 testdata.897552 2026-02-17T05:02:01.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.666 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj958 testdata.897552 2026-02-17T05:02:01.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj959 testdata.897552 2026-02-17T05:02:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj960 testdata.897552 2026-02-17T05:02:01.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj961 testdata.897552 2026-02-17T05:02:01.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj962 testdata.897552 2026-02-17T05:02:01.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj963 testdata.897552 2026-02-17T05:02:01.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj964 testdata.897552 2026-02-17T05:02:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj965 testdata.897552 2026-02-17T05:02:01.790 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj966 testdata.897552 2026-02-17T05:02:01.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj967 testdata.897552 2026-02-17T05:02:01.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj968 testdata.897552 2026-02-17T05:02:01.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj969 testdata.897552 2026-02-17T05:02:01.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj970 testdata.897552 2026-02-17T05:02:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj971 testdata.897552 2026-02-17T05:02:01.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj972 testdata.897552 2026-02-17T05:02:01.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj973 testdata.897552 2026-02-17T05:02:01.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj974 testdata.897552 2026-02-17T05:02:01.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj975 testdata.897552 2026-02-17T05:02:01.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj976 testdata.897552 2026-02-17T05:02:01.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj977 testdata.897552 2026-02-17T05:02:01.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj978 testdata.897552 2026-02-17T05:02:01.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:01.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj979 testdata.897552 2026-02-17T05:02:02.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj980 testdata.897552 2026-02-17T05:02:02.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj981 testdata.897552 2026-02-17T05:02:02.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj982 testdata.897552 2026-02-17T05:02:02.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj983 testdata.897552 2026-02-17T05:02:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj984 testdata.897552 2026-02-17T05:02:02.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj985 testdata.897552 2026-02-17T05:02:02.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj986 testdata.897552 2026-02-17T05:02:02.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj987 testdata.897552 2026-02-17T05:02:02.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj988 testdata.897552 2026-02-17T05:02:02.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj989 testdata.897552 2026-02-17T05:02:02.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj990 testdata.897552 2026-02-17T05:02:02.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj991 testdata.897552 2026-02-17T05:02:02.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj992 testdata.897552 2026-02-17T05:02:02.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj993 testdata.897552 2026-02-17T05:02:02.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj994 testdata.897552 2026-02-17T05:02:02.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj995 testdata.897552 2026-02-17T05:02:02.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.262 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj996 testdata.897552 2026-02-17T05:02:02.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj997 testdata.897552 2026-02-17T05:02:02.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.293 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj998 testdata.897552 2026-02-17T05:02:02.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj999 testdata.897552 2026-02-17T05:02:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-17T05:02:02.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1000 testdata.897552 2026-02-17T05:02:02.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:334: _scrub_abort: rm -f testdata.897552 2026-02-17T05:02:02.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: get_primary test obj1 2026-02-17T05:02:02.342 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T05:02:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T05:02:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T05:02:02.343 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T05:02:02.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: local primary=1 2026-02-17T05:02:02.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:337: _scrub_abort: local pgid=1.0 2026-02-17T05:02:02.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:339: _scrub_abort: ceph tell 1.0 schedule-scrub 2026-02-17T05:02:02.560 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:02:02.560 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T05:02:02.560 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T05:02:02.560 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-15T05:02:02.560118+0000" 2026-02-17T05:02:02.560 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:02:02.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:342: _scrub_abort: set -o pipefail 2026-02-17T05:02:02.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:343: _scrub_abort: found=no 2026-02-17T05:02:02.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: seq 0 200 2026-02-17T05:02:02.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:02.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-17T05:02:02.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:02.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:02.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:02.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-17T05:02:02.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-17T05:02:02.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T05:02:02.791 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:02.791 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:02.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672985 2026-02-17T05:02:02.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672985 2026-02-17T05:02:02.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-42949672985' 2026-02-17T05:02:02.850 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:02.850 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542165 2026-02-17T05:02:02.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542165 2026-02-17T05:02:02.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-42949672985 2-60129542165' 2026-02-17T05:02:02.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:02.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836506 2026-02-17T05:02:02.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:02.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:02.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-17T05:02:02.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:02.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-17T05:02:02.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T05:02:02.910 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836506 2026-02-17T05:02:02.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:03.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836506 2026-02-17T05:02:03.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:04.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:04.077 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:04.242 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-17T05:02:04.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:04.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672985 2026-02-17T05:02:04.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:04.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:04.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672985 2026-02-17T05:02:04.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:04.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672985 2026-02-17T05:02:04.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672985' 2026-02-17T05:02:04.246 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672985 2026-02-17T05:02:04.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:04.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672985 -lt 42949672985 2026-02-17T05:02:04.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:04.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542165 2026-02-17T05:02:04.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:04.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:04.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542165 2026-02-17T05:02:04.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:04.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542165 2026-02-17T05:02:04.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542165' 2026-02-17T05:02:04.413 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542165 2026-02-17T05:02:04.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:04.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542166 -lt 60129542165 2026-02-17T05:02:04.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:04.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-17T05:02:04.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:04.731 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:04.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:04.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-17T05:02:04.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:04.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:04.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:04.902 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:04.903 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:04.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:04.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:04.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836509 2026-02-17T05:02:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836509 2026-02-17T05:02:04.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509' 2026-02-17T05:02:04.963 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:04.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:05.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672988 2026-02-17T05:02:05.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672988 2026-02-17T05:02:05.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-42949672988' 2026-02-17T05:02:05.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:05.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542169 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542169 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-42949672988 2-60129542169' 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836509 2026-02-17T05:02:05.078 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:05.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:05.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836509 2026-02-17T05:02:05.080 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836509 2026-02-17T05:02:05.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-17T05:02:05.081 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836509 2026-02-17T05:02:05.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:05.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836509 2026-02-17T05:02:05.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:06.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:06.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:06.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836509 2026-02-17T05:02:06.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:06.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672988 2026-02-17T05:02:06.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:06.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:06.413 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672988 2026-02-17T05:02:06.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:06.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672988 2026-02-17T05:02:06.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672988' 2026-02-17T05:02:06.415 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672988 2026-02-17T05:02:06.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672988 -lt 42949672988 2026-02-17T05:02:06.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:06.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542169 2026-02-17T05:02:06.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:06.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:06.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542169 2026-02-17T05:02:06.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:06.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542169 2026-02-17T05:02:06.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542169' 2026-02-17T05:02:06.583 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542169 2026-02-17T05:02:06.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:06.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542169 -lt 60129542169 2026-02-17T05:02:06.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:06.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-17T05:02:06.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:06.909 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:06.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:349: _scrub_abort: found=yes 2026-02-17T05:02:06.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:351: _scrub_abort: break 2026-02-17T05:02:06.917 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:354: _scrub_abort: set +o pipefail 2026-02-17T05:02:06.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:356: _scrub_abort: test yes = no 2026-02-17T05:02:06.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:362: _scrub_abort: ceph osd set noscrub 2026-02-17T05:02:07.127 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is set 2026-02-17T05:02:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:363: _scrub_abort: '[' scrub = deep-scrub ']' 2026-02-17T05:02:07.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:369: _scrub_abort: set -o pipefail 2026-02-17T05:02:07.137 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: seq 0 200 2026-02-17T05:02:07.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:07.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:07.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:07.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:07.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:07.302 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:07.302 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:07.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:07.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:07.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:07.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836512 2026-02-17T05:02:07.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836512 2026-02-17T05:02:07.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512' 2026-02-17T05:02:07.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:07.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:07.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672991 2026-02-17T05:02:07.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672991 2026-02-17T05:02:07.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-42949672991' 2026-02-17T05:02:07.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:07.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542172 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542172 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836512 1-42949672991 2-60129542172' 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836512 2026-02-17T05:02:07.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:07.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:07.476 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836512 2026-02-17T05:02:07.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:07.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836512 2026-02-17T05:02:07.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836512' 2026-02-17T05:02:07.478 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836512 2026-02-17T05:02:07.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:07.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836512 2026-02-17T05:02:07.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:07.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672991 2026-02-17T05:02:07.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:07.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:07.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672991 2026-02-17T05:02:07.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:07.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672991 2026-02-17T05:02:07.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672991' 2026-02-17T05:02:07.700 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672991 2026-02-17T05:02:07.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:07.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672991 -lt 42949672991 2026-02-17T05:02:07.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:07.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542172 2026-02-17T05:02:07.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:07.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:07.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542172 2026-02-17T05:02:07.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542172 2026-02-17T05:02:07.864 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542172 2026-02-17T05:02:07.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542172' 2026-02-17T05:02:07.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:08.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542172 -lt 60129542172 2026-02-17T05:02:08.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:08.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:08.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:08.186 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:08.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:08.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:08.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:08.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:08.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:08.356 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:08.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-17T05:02:08.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-17T05:02:08.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514' 2026-02-17T05:02:08.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:08.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:08.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672993 2026-02-17T05:02:08.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672993 2026-02-17T05:02:08.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-42949672993' 2026-02-17T05:02:08.474 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:08.474 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542174 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542174 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-42949672993 2-60129542174' 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836514 2026-02-17T05:02:08.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:08.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:08.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-17T05:02:08.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:08.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836514 2026-02-17T05:02:08.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-17T05:02:08.534 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836514 2026-02-17T05:02:08.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:08.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836512 -lt 21474836514 2026-02-17T05:02:08.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:09.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:09.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:09.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836514 2026-02-17T05:02:09.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:09.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672993 2026-02-17T05:02:09.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:09.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:09.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672993 2026-02-17T05:02:09.877 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:09.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672993 2026-02-17T05:02:09.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672993' 2026-02-17T05:02:09.878 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672993 2026-02-17T05:02:09.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:10.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672994 -lt 42949672993 2026-02-17T05:02:10.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:10.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542174 2026-02-17T05:02:10.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:10.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:10.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542174 2026-02-17T05:02:10.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:10.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542174 2026-02-17T05:02:10.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542174' 2026-02-17T05:02:10.046 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542174 2026-02-17T05:02:10.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:10.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542175 -lt 60129542174 2026-02-17T05:02:10.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:10.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:10.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:10.366 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:10.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:10.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:10.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:10.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:10.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:10.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:10.538 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:10.539 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:10.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:10.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:10.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:10.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-17T05:02:10.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-17T05:02:10.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517' 2026-02-17T05:02:10.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:10.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:10.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672997 2026-02-17T05:02:10.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672997 2026-02-17T05:02:10.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-42949672997' 2026-02-17T05:02:10.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:10.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:10.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542177 2026-02-17T05:02:10.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542177 2026-02-17T05:02:10.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-42949672997 2-60129542177' 2026-02-17T05:02:10.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:10.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836517 2026-02-17T05:02:10.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:10.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:10.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-17T05:02:10.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836517 2026-02-17T05:02:10.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-17T05:02:10.717 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836517 2026-02-17T05:02:10.717 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836517 2026-02-17T05:02:10.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:11.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:11.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:12.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836518 -lt 21474836517 2026-02-17T05:02:12.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:12.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672997 2026-02-17T05:02:12.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:12.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:12.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672997 2026-02-17T05:02:12.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:12.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672997 2026-02-17T05:02:12.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672997' 2026-02-17T05:02:12.048 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672997 2026-02-17T05:02:12.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:12.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672997 -lt 42949672997 2026-02-17T05:02:12.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:12.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542177 2026-02-17T05:02:12.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:12.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:12.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542177 2026-02-17T05:02:12.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:12.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542177 2026-02-17T05:02:12.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542177' 2026-02-17T05:02:12.217 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542177 2026-02-17T05:02:12.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:12.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542178 -lt 60129542177 2026-02-17T05:02:12.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:12.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:12.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:12.544 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:12.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:12.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:12.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:12.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:12.552 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:12.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:12.716 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:12.716 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:12.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:12.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:12.716 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836521 2026-02-17T05:02:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836521 2026-02-17T05:02:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836521' 2026-02-17T05:02:12.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:12.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:12.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673000 2026-02-17T05:02:12.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673000 2026-02-17T05:02:12.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836521 1-42949673000' 2026-02-17T05:02:12.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:12.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:12.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542180 2026-02-17T05:02:12.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542180 2026-02-17T05:02:12.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836521 1-42949673000 2-60129542180' 2026-02-17T05:02:12.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:12.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836521 2026-02-17T05:02:12.891 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:12.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:12.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836521 2026-02-17T05:02:12.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:12.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836521 2026-02-17T05:02:12.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836521' 2026-02-17T05:02:12.894 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836521 2026-02-17T05:02:12.894 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:13.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836518 -lt 21474836521 2026-02-17T05:02:13.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:14.060 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:14.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:14.225 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836521 -lt 21474836521 2026-02-17T05:02:14.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:14.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673000 2026-02-17T05:02:14.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:14.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:14.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673000 2026-02-17T05:02:14.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:14.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673000 2026-02-17T05:02:14.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2026-02-17T05:02:14.229 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673000 2026-02-17T05:02:14.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:14.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673000 -lt 42949673000 2026-02-17T05:02:14.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:14.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542180 2026-02-17T05:02:14.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:14.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:14.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542180 2026-02-17T05:02:14.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:14.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542180 2026-02-17T05:02:14.398 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542180 2026-02-17T05:02:14.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542180' 2026-02-17T05:02:14.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542181 -lt 60129542180 2026-02-17T05:02:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:14.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:14.716 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:14.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:14.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:14.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:14.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:14.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:14.887 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:14.887 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:14.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:14.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:14.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:14.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836524 2026-02-17T05:02:14.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836524 2026-02-17T05:02:14.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524' 2026-02-17T05:02:14.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:14.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:15.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673003 2026-02-17T05:02:15.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673003 2026-02-17T05:02:15.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524 1-42949673003' 2026-02-17T05:02:15.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:15.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:15.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542184 2026-02-17T05:02:15.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542184 2026-02-17T05:02:15.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524 1-42949673003 2-60129542184' 2026-02-17T05:02:15.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:15.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836524 2026-02-17T05:02:15.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:15.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:15.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836524 2026-02-17T05:02:15.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:15.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836524 2026-02-17T05:02:15.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836524' 2026-02-17T05:02:15.066 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836524 2026-02-17T05:02:15.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:15.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836521 -lt 21474836524 2026-02-17T05:02:15.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:16.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:16.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:16.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836524 -lt 21474836524 2026-02-17T05:02:16.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:16.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673003 2026-02-17T05:02:16.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:16.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:16.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673003 2026-02-17T05:02:16.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673003 2026-02-17T05:02:16.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673003' 2026-02-17T05:02:16.401 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673003 2026-02-17T05:02:16.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:16.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673003 -lt 42949673003 2026-02-17T05:02:16.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:16.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542184 2026-02-17T05:02:16.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:16.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:16.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542184 2026-02-17T05:02:16.569 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:16.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542184 2026-02-17T05:02:16.570 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542184' 2026-02-17T05:02:16.570 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542184 2026-02-17T05:02:16.571 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:16.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542184 -lt 60129542184 2026-02-17T05:02:16.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:16.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:16.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:16.895 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:16.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:16.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:16.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:16.903 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:16.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:17.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:17.072 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:17.072 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:17.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:17.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:17.073 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:17.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836527 2026-02-17T05:02:17.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836527 2026-02-17T05:02:17.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836527' 2026-02-17T05:02:17.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:17.132 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:17.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673006 2026-02-17T05:02:17.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673006 2026-02-17T05:02:17.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836527 1-42949673006' 2026-02-17T05:02:17.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:17.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:17.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542187 2026-02-17T05:02:17.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542187 2026-02-17T05:02:17.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836527 1-42949673006 2-60129542187' 2026-02-17T05:02:17.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:17.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836527 2026-02-17T05:02:17.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:17.251 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:17.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836527 2026-02-17T05:02:17.252 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:17.252 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836527 2026-02-17T05:02:17.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836527' 2026-02-17T05:02:17.253 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836527 2026-02-17T05:02:17.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:17.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836524 -lt 21474836527 2026-02-17T05:02:17.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:18.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:18.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:18.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836527 -lt 21474836527 2026-02-17T05:02:18.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:18.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673006 2026-02-17T05:02:18.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:18.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:18.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673006 2026-02-17T05:02:18.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:18.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673006 2026-02-17T05:02:18.583 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673006' 2026-02-17T05:02:18.583 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673006 2026-02-17T05:02:18.584 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:18.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673006 -lt 42949673006 2026-02-17T05:02:18.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:18.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542187 2026-02-17T05:02:18.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:18.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:18.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542187 2026-02-17T05:02:18.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:18.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542187 2026-02-17T05:02:18.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542187' 2026-02-17T05:02:18.751 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542187 2026-02-17T05:02:18.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542187 -lt 60129542187 2026-02-17T05:02:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:18.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:19.073 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:19.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:19.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:19.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:19.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:19.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:19.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:19.249 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:19.249 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:19.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:19.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:19.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836530 2026-02-17T05:02:19.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836530 2026-02-17T05:02:19.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836530' 2026-02-17T05:02:19.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:19.307 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:19.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673009 2026-02-17T05:02:19.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673009 2026-02-17T05:02:19.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836530 1-42949673009' 2026-02-17T05:02:19.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:19.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:19.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542190 2026-02-17T05:02:19.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542190 2026-02-17T05:02:19.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836530 1-42949673009 2-60129542190' 2026-02-17T05:02:19.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:19.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836530 2026-02-17T05:02:19.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:19.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:19.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836530 2026-02-17T05:02:19.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:19.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836530 2026-02-17T05:02:19.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836530' 2026-02-17T05:02:19.426 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836530 2026-02-17T05:02:19.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:19.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836527 -lt 21474836530 2026-02-17T05:02:19.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:20.590 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:20.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:20.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836530 -lt 21474836530 2026-02-17T05:02:20.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:20.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673009 2026-02-17T05:02:20.757 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:20.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673009 2026-02-17T05:02:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:20.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673009 2026-02-17T05:02:20.759 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2026-02-17T05:02:20.760 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673009 2026-02-17T05:02:20.760 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:20.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673009 -lt 42949673009 2026-02-17T05:02:20.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:20.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542190 2026-02-17T05:02:20.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:20.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:20.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542190 2026-02-17T05:02:20.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542190 2026-02-17T05:02:20.926 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542190' 2026-02-17T05:02:20.926 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542190 2026-02-17T05:02:20.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:21.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542190 -lt 60129542190 2026-02-17T05:02:21.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:21.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:21.093 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:21.250 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:21.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:21.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:21.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:21.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:21.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:21.423 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:21.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836533 2026-02-17T05:02:21.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836533 2026-02-17T05:02:21.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836533' 2026-02-17T05:02:21.483 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:21.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673012 2026-02-17T05:02:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673012 2026-02-17T05:02:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836533 1-42949673012' 2026-02-17T05:02:21.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:21.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542193 2026-02-17T05:02:21.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542193 2026-02-17T05:02:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836533 1-42949673012 2-60129542193' 2026-02-17T05:02:21.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:21.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836533 2026-02-17T05:02:21.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:21.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:21.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836533 2026-02-17T05:02:21.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:21.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836533 2026-02-17T05:02:21.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836533' 2026-02-17T05:02:21.604 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836533 2026-02-17T05:02:21.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:21.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836533 -lt 21474836533 2026-02-17T05:02:21.768 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:21.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673012 2026-02-17T05:02:21.769 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:21.769 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:21.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673012 2026-02-17T05:02:21.770 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:21.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673012 2026-02-17T05:02:21.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2026-02-17T05:02:21.771 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673012 2026-02-17T05:02:21.772 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:21.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673011 -lt 42949673012 2026-02-17T05:02:21.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:22.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:22.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:23.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673011 -lt 42949673012 2026-02-17T05:02:23.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:24.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:02:24.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:24.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673014 -lt 42949673012 2026-02-17T05:02:24.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:24.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542193 2026-02-17T05:02:24.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:24.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:24.276 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542193 2026-02-17T05:02:24.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:24.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542193 2026-02-17T05:02:24.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542193' 2026-02-17T05:02:24.278 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542193 2026-02-17T05:02:24.278 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542195 -lt 60129542193 2026-02-17T05:02:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:24.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:24.604 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:24.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:24.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:24.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:24.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:24.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:24.779 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:24.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836538 2026-02-17T05:02:24.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836538 2026-02-17T05:02:24.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836538' 2026-02-17T05:02:24.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:24.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:24.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673017 2026-02-17T05:02:24.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673017 2026-02-17T05:02:24.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836538 1-42949673017' 2026-02-17T05:02:24.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:24.893 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542197 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542197 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836538 1-42949673017 2-60129542197' 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836538 2026-02-17T05:02:24.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:24.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:24.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836538 2026-02-17T05:02:24.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:24.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836538 2026-02-17T05:02:24.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836538' 2026-02-17T05:02:24.953 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836538 2026-02-17T05:02:24.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:25.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836535 -lt 21474836538 2026-02-17T05:02:25.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:26.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:26.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:26.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836538 -lt 21474836538 2026-02-17T05:02:26.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:26.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673017 2026-02-17T05:02:26.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:26.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:26.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673017 2026-02-17T05:02:26.282 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:26.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673017 2026-02-17T05:02:26.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673017' 2026-02-17T05:02:26.284 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673017 2026-02-17T05:02:26.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:26.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673017 -lt 42949673017 2026-02-17T05:02:26.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:26.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542197 2026-02-17T05:02:26.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:26.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:26.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542197 2026-02-17T05:02:26.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:26.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542197 2026-02-17T05:02:26.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542197' 2026-02-17T05:02:26.450 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542197 2026-02-17T05:02:26.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:26.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542198 -lt 60129542197 2026-02-17T05:02:26.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:26.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:26.616 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:26.768 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:26.777 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:26.777 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:26.944 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:27.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836541 2026-02-17T05:02:27.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836541 2026-02-17T05:02:27.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836541' 2026-02-17T05:02:27.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:27.003 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673020 2026-02-17T05:02:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673020 2026-02-17T05:02:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836541 1-42949673020' 2026-02-17T05:02:27.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:27.061 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542201 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542201 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836541 1-42949673020 2-60129542201' 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836541 2026-02-17T05:02:27.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:27.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:27.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836541 2026-02-17T05:02:27.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:27.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836541 2026-02-17T05:02:27.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836541' 2026-02-17T05:02:27.123 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836541 2026-02-17T05:02:27.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:27.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836538 -lt 21474836541 2026-02-17T05:02:27.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:28.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:28.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:28.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836541 -lt 21474836541 2026-02-17T05:02:28.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:28.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673020 2026-02-17T05:02:28.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:28.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:28.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673020 2026-02-17T05:02:28.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:28.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673020 2026-02-17T05:02:28.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673020' 2026-02-17T05:02:28.457 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673020 2026-02-17T05:02:28.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:28.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673020 -lt 42949673020 2026-02-17T05:02:28.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:28.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542201 2026-02-17T05:02:28.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:28.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:28.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542201 2026-02-17T05:02:28.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:28.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542201 2026-02-17T05:02:28.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542201' 2026-02-17T05:02:28.628 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542201 2026-02-17T05:02:28.628 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:28.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542201 -lt 60129542201 2026-02-17T05:02:28.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:28.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:28.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:28.947 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:28.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:28.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:28.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:28.955 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:28.955 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:29.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:29.121 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:29.122 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:29.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:29.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:29.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:29.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836544 2026-02-17T05:02:29.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836544 2026-02-17T05:02:29.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836544' 2026-02-17T05:02:29.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:29.181 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:29.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673023 2026-02-17T05:02:29.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673023 2026-02-17T05:02:29.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836544 1-42949673023' 2026-02-17T05:02:29.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:29.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:29.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542204 2026-02-17T05:02:29.294 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542204 2026-02-17T05:02:29.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836544 1-42949673023 2-60129542204' 2026-02-17T05:02:29.295 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:29.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836544 2026-02-17T05:02:29.295 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:29.296 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:29.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836544 2026-02-17T05:02:29.297 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:29.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836544 2026-02-17T05:02:29.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836544' 2026-02-17T05:02:29.298 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836544 2026-02-17T05:02:29.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:29.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836541 -lt 21474836544 2026-02-17T05:02:29.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:30.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:30.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:30.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836544 -lt 21474836544 2026-02-17T05:02:30.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:30.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673023 2026-02-17T05:02:30.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:30.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:30.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673023 2026-02-17T05:02:30.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:30.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673023 2026-02-17T05:02:30.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673023' 2026-02-17T05:02:30.637 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673023 2026-02-17T05:02:30.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:30.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673023 -lt 42949673023 2026-02-17T05:02:30.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:30.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542204 2026-02-17T05:02:30.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:30.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:30.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542204 2026-02-17T05:02:30.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:30.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542204 2026-02-17T05:02:30.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542204' 2026-02-17T05:02:30.806 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542204 2026-02-17T05:02:30.806 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:30.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542204 -lt 60129542204 2026-02-17T05:02:30.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:30.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:30.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:31.129 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:31.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:31.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:31.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:31.139 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:31.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:31.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:31.305 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:31.305 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:31.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:31.305 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:31.305 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836547 2026-02-17T05:02:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836547 2026-02-17T05:02:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836547' 2026-02-17T05:02:31.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:31.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:31.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673026 2026-02-17T05:02:31.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673026 2026-02-17T05:02:31.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836547 1-42949673026' 2026-02-17T05:02:31.421 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:31.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:31.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542207 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542207 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836547 1-42949673026 2-60129542207' 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836547 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:31.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:31.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836547 2026-02-17T05:02:31.479 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:31.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836547 2026-02-17T05:02:31.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836547' 2026-02-17T05:02:31.480 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836547 2026-02-17T05:02:31.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:31.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836547 -lt 21474836547 2026-02-17T05:02:31.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:31.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673026 2026-02-17T05:02:31.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:31.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:31.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673026 2026-02-17T05:02:31.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:31.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673026 2026-02-17T05:02:31.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673026' 2026-02-17T05:02:31.650 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673026 2026-02-17T05:02:31.650 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:31.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673026 -lt 42949673026 2026-02-17T05:02:31.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:31.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542207 2026-02-17T05:02:31.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:31.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:31.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542207 2026-02-17T05:02:31.816 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:31.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542207 2026-02-17T05:02:31.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542207' 2026-02-17T05:02:31.818 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542207 2026-02-17T05:02:31.818 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:31.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542207 -lt 60129542207 2026-02-17T05:02:31.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:31.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:31.985 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:32.140 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:32.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:32.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:32.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:32.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:32.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:32.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:32.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836549 2026-02-17T05:02:32.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836549 2026-02-17T05:02:32.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549' 2026-02-17T05:02:32.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:32.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:32.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673028 2026-02-17T05:02:32.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673028 2026-02-17T05:02:32.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549 1-42949673028' 2026-02-17T05:02:32.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:32.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:32.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542209 2026-02-17T05:02:32.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542209 2026-02-17T05:02:32.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836549 1-42949673028 2-60129542209' 2026-02-17T05:02:32.491 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:32.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836549 2026-02-17T05:02:32.492 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:32.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:32.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836549 2026-02-17T05:02:32.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:32.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836549 2026-02-17T05:02:32.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836549' 2026-02-17T05:02:32.495 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836549 2026-02-17T05:02:32.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:32.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836547 -lt 21474836549 2026-02-17T05:02:32.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:33.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:33.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:33.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836550 -lt 21474836549 2026-02-17T05:02:33.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:33.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673028 2026-02-17T05:02:33.823 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:33.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:33.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673028 2026-02-17T05:02:33.824 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:33.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673028 2026-02-17T05:02:33.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673028' 2026-02-17T05:02:33.826 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673028 2026-02-17T05:02:33.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:33.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673029 -lt 42949673028 2026-02-17T05:02:33.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:33.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542209 2026-02-17T05:02:33.998 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:33.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:34.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542209 2026-02-17T05:02:34.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:34.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542209 2026-02-17T05:02:34.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542209' 2026-02-17T05:02:34.001 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542209 2026-02-17T05:02:34.002 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:34.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542210 -lt 60129542209 2026-02-17T05:02:34.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:34.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:34.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:34.321 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:34.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:34.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:34.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:34.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:34.331 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:34.495 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:34.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836552 2026-02-17T05:02:34.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836552 2026-02-17T05:02:34.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552' 2026-02-17T05:02:34.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:34.554 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673031 2026-02-17T05:02:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673031 2026-02-17T05:02:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552 1-42949673031' 2026-02-17T05:02:34.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:34.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:34.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542212 2026-02-17T05:02:34.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542212 2026-02-17T05:02:34.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836552 1-42949673031 2-60129542212' 2026-02-17T05:02:34.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:34.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836552 2026-02-17T05:02:34.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:34.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:34.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836552 2026-02-17T05:02:34.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:34.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836552 2026-02-17T05:02:34.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836552' 2026-02-17T05:02:34.673 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836552 2026-02-17T05:02:34.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:34.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836550 -lt 21474836552 2026-02-17T05:02:34.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:35.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:35.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:36.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836553 -lt 21474836552 2026-02-17T05:02:36.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:36.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673031 2026-02-17T05:02:36.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:36.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:36.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673031 2026-02-17T05:02:36.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:36.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673031 2026-02-17T05:02:36.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673031' 2026-02-17T05:02:36.007 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673031 2026-02-17T05:02:36.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:36.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673032 -lt 42949673031 2026-02-17T05:02:36.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:36.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542212 2026-02-17T05:02:36.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:36.172 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:36.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542212 2026-02-17T05:02:36.172 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:36.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542212 2026-02-17T05:02:36.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542212' 2026-02-17T05:02:36.174 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542212 2026-02-17T05:02:36.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:36.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542213 -lt 60129542212 2026-02-17T05:02:36.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:36.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:36.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:36.502 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:36.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:36.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:36.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:36.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:36.512 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:36.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:36.680 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:36.681 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:36.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:36.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:36.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:36.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836556 2026-02-17T05:02:36.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836556 2026-02-17T05:02:36.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556' 2026-02-17T05:02:36.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:36.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673035 2026-02-17T05:02:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673035 2026-02-17T05:02:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556 1-42949673035' 2026-02-17T05:02:36.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:36.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:36.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542215 2026-02-17T05:02:36.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542215 2026-02-17T05:02:36.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556 1-42949673035 2-60129542215' 2026-02-17T05:02:36.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:36.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836556 2026-02-17T05:02:36.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:36.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:36.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836556 2026-02-17T05:02:36.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:36.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836556 2026-02-17T05:02:36.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836556' 2026-02-17T05:02:36.860 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836556 2026-02-17T05:02:36.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:37.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836553 -lt 21474836556 2026-02-17T05:02:37.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:38.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:38.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:38.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836556 -lt 21474836556 2026-02-17T05:02:38.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:38.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673035 2026-02-17T05:02:38.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:38.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:38.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673035 2026-02-17T05:02:38.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:38.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673035 2026-02-17T05:02:38.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673035' 2026-02-17T05:02:38.195 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673035 2026-02-17T05:02:38.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:38.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673035 -lt 42949673035 2026-02-17T05:02:38.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:38.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542215 2026-02-17T05:02:38.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:38.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:38.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542215 2026-02-17T05:02:38.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542215 2026-02-17T05:02:38.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542215' 2026-02-17T05:02:38.364 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542215 2026-02-17T05:02:38.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:38.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542216 -lt 60129542215 2026-02-17T05:02:38.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:38.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:38.527 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:38.682 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:38.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:38.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:38.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:38.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:38.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:38.859 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836559 2026-02-17T05:02:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836559 2026-02-17T05:02:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836559' 2026-02-17T05:02:38.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:38.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:38.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673038 2026-02-17T05:02:38.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673038 2026-02-17T05:02:38.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836559 1-42949673038' 2026-02-17T05:02:38.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:38.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542219 2026-02-17T05:02:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542219 2026-02-17T05:02:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836559 1-42949673038 2-60129542219' 2026-02-17T05:02:39.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:39.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836559 2026-02-17T05:02:39.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:39.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:39.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836559 2026-02-17T05:02:39.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:39.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836559 2026-02-17T05:02:39.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836559' 2026-02-17T05:02:39.038 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836559 2026-02-17T05:02:39.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:39.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836556 -lt 21474836559 2026-02-17T05:02:39.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:40.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:40.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836559 -lt 21474836559 2026-02-17T05:02:40.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:40.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673038 2026-02-17T05:02:40.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:40.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:40.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673038 2026-02-17T05:02:40.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673038 2026-02-17T05:02:40.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673038' 2026-02-17T05:02:40.372 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673038 2026-02-17T05:02:40.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:40.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673038 -lt 42949673038 2026-02-17T05:02:40.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:40.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542219 2026-02-17T05:02:40.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:40.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:40.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542219 2026-02-17T05:02:40.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:40.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542219 2026-02-17T05:02:40.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542219' 2026-02-17T05:02:40.539 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542219 2026-02-17T05:02:40.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:40.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542219 -lt 60129542219 2026-02-17T05:02:40.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:40.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:40.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:40.864 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:40.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:40.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:41.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:41.037 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:41.038 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:41.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:41.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:41.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:41.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836562 2026-02-17T05:02:41.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836562 2026-02-17T05:02:41.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836562' 2026-02-17T05:02:41.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:41.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:41.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673041 2026-02-17T05:02:41.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673041 2026-02-17T05:02:41.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836562 1-42949673041' 2026-02-17T05:02:41.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:41.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:41.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542222 2026-02-17T05:02:41.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542222 2026-02-17T05:02:41.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836562 1-42949673041 2-60129542222' 2026-02-17T05:02:41.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:41.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836562 2026-02-17T05:02:41.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:41.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:41.215 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836562 2026-02-17T05:02:41.216 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:41.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836562 2026-02-17T05:02:41.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836562' 2026-02-17T05:02:41.217 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836562 2026-02-17T05:02:41.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836559 -lt 21474836562 2026-02-17T05:02:41.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:42.380 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:42.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:42.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836562 -lt 21474836562 2026-02-17T05:02:42.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:42.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673041 2026-02-17T05:02:42.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:42.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:42.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673041 2026-02-17T05:02:42.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:42.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673041 2026-02-17T05:02:42.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673041' 2026-02-17T05:02:42.550 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673041 2026-02-17T05:02:42.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:42.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673041 -lt 42949673041 2026-02-17T05:02:42.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:42.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542222 2026-02-17T05:02:42.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:42.721 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:42.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542222 2026-02-17T05:02:42.721 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:42.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542222 2026-02-17T05:02:42.722 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542222' 2026-02-17T05:02:42.722 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542222 2026-02-17T05:02:42.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:42.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542222 -lt 60129542222 2026-02-17T05:02:42.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:42.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:42.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:43.049 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:43.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:43.057 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:43.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:43.221 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:43.221 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:43.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:43.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:43.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:43.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836565 2026-02-17T05:02:43.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836565 2026-02-17T05:02:43.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565' 2026-02-17T05:02:43.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:43.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:43.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673044 2026-02-17T05:02:43.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673044 2026-02-17T05:02:43.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565 1-42949673044' 2026-02-17T05:02:43.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:43.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542225 2026-02-17T05:02:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542225 2026-02-17T05:02:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565 1-42949673044 2-60129542225' 2026-02-17T05:02:43.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:43.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836565 2026-02-17T05:02:43.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:43.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:43.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836565 2026-02-17T05:02:43.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:43.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836565 2026-02-17T05:02:43.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836565' 2026-02-17T05:02:43.401 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836565 2026-02-17T05:02:43.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:43.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836562 -lt 21474836565 2026-02-17T05:02:43.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:44.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:44.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:44.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836565 -lt 21474836565 2026-02-17T05:02:44.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:44.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673044 2026-02-17T05:02:44.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:44.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:44.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673044 2026-02-17T05:02:44.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:44.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673044 2026-02-17T05:02:44.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673044' 2026-02-17T05:02:44.740 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673044 2026-02-17T05:02:44.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:44.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673044 -lt 42949673044 2026-02-17T05:02:44.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:44.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542225 2026-02-17T05:02:44.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:44.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:44.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542225 2026-02-17T05:02:44.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:44.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542225 2026-02-17T05:02:44.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542225' 2026-02-17T05:02:44.909 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542225 2026-02-17T05:02:44.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:45.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542225 -lt 60129542225 2026-02-17T05:02:45.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:45.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:45.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:45.227 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:45.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:45.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:45.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:45.236 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:45.236 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:45.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:45.402 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:45.402 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:45.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:45.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:45.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:45.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836568 2026-02-17T05:02:45.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836568 2026-02-17T05:02:45.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568' 2026-02-17T05:02:45.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:45.462 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:45.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673047 2026-02-17T05:02:45.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673047 2026-02-17T05:02:45.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568 1-42949673047' 2026-02-17T05:02:45.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:45.521 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:45.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542228 2026-02-17T05:02:45.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542228 2026-02-17T05:02:45.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568 1-42949673047 2-60129542228' 2026-02-17T05:02:45.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:45.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836568 2026-02-17T05:02:45.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:45.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:45.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836568 2026-02-17T05:02:45.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:45.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836568 2026-02-17T05:02:45.582 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836568' 2026-02-17T05:02:45.583 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836568 2026-02-17T05:02:45.583 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:45.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836568 -lt 21474836568 2026-02-17T05:02:45.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:45.746 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673047 2026-02-17T05:02:45.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:45.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:45.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673047 2026-02-17T05:02:45.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:45.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673047 2026-02-17T05:02:45.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673047' 2026-02-17T05:02:45.750 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673047 2026-02-17T05:02:45.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:45.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673047 -lt 42949673047 2026-02-17T05:02:45.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:45.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542228 2026-02-17T05:02:45.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:45.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:45.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542228 2026-02-17T05:02:45.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:45.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542228 2026-02-17T05:02:45.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542228' 2026-02-17T05:02:45.925 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542228 2026-02-17T05:02:45.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:46.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542227 -lt 60129542228 2026-02-17T05:02:46.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:47.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:47.090 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:47.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542227 -lt 60129542228 2026-02-17T05:02:47.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:48.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:02:48.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:48.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542230 -lt 60129542228 2026-02-17T05:02:48.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:48.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:48.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:48.584 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:48.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:48.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:48.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836573 2026-02-17T05:02:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836573 2026-02-17T05:02:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573' 2026-02-17T05:02:48.820 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:48.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:48.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673052 2026-02-17T05:02:48.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673052 2026-02-17T05:02:48.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573 1-42949673052' 2026-02-17T05:02:48.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:48.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:48.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542232 2026-02-17T05:02:48.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542232 2026-02-17T05:02:48.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573 1-42949673052 2-60129542232' 2026-02-17T05:02:48.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:48.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836573 2026-02-17T05:02:48.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:48.938 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:48.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836573 2026-02-17T05:02:48.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:48.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836573 2026-02-17T05:02:48.940 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836573' 2026-02-17T05:02:48.940 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836573 2026-02-17T05:02:48.941 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:49.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836570 -lt 21474836573 2026-02-17T05:02:49.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:50.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:50.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:50.273 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836573 -lt 21474836573 2026-02-17T05:02:50.274 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:50.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673052 2026-02-17T05:02:50.274 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:50.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:50.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673052 2026-02-17T05:02:50.275 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:50.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673052 2026-02-17T05:02:50.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673052' 2026-02-17T05:02:50.277 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673052 2026-02-17T05:02:50.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:50.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673052 -lt 42949673052 2026-02-17T05:02:50.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:50.445 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542232 2026-02-17T05:02:50.446 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:50.446 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:50.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542232 2026-02-17T05:02:50.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:50.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542232 2026-02-17T05:02:50.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542232' 2026-02-17T05:02:50.448 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542232 2026-02-17T05:02:50.449 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:50.612 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542233 -lt 60129542232 2026-02-17T05:02:50.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:50.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:50.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:50.765 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:50.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:50.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:50.773 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:50.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:50.774 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:50.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:50.934 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:50.934 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:50.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:50.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:50.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836576 2026-02-17T05:02:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836576 2026-02-17T05:02:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576' 2026-02-17T05:02:50.995 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:50.995 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:51.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673055 2026-02-17T05:02:51.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673055 2026-02-17T05:02:51.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576 1-42949673055' 2026-02-17T05:02:51.055 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:51.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:51.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542236 2026-02-17T05:02:51.114 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542236 2026-02-17T05:02:51.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576 1-42949673055 2-60129542236' 2026-02-17T05:02:51.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:51.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836576 2026-02-17T05:02:51.115 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:51.115 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:51.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836576 2026-02-17T05:02:51.116 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:51.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836576 2026-02-17T05:02:51.117 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836576' 2026-02-17T05:02:51.118 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836576 2026-02-17T05:02:51.118 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:51.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836573 -lt 21474836576 2026-02-17T05:02:51.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:52.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:52.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:52.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836576 -lt 21474836576 2026-02-17T05:02:52.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:52.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673055 2026-02-17T05:02:52.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:52.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:52.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673055 2026-02-17T05:02:52.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:52.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673055 2026-02-17T05:02:52.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673055' 2026-02-17T05:02:52.455 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673055 2026-02-17T05:02:52.455 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:52.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673055 -lt 42949673055 2026-02-17T05:02:52.625 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:52.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542236 2026-02-17T05:02:52.626 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:52.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:52.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542236 2026-02-17T05:02:52.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:52.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542236 2026-02-17T05:02:52.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542236' 2026-02-17T05:02:52.629 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542236 2026-02-17T05:02:52.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:52.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542236 -lt 60129542236 2026-02-17T05:02:52.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:52.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:52.794 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:52.949 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:52.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:52.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:52.958 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:52.959 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:52.959 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:53.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:53.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836579 2026-02-17T05:02:53.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836579 2026-02-17T05:02:53.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836579' 2026-02-17T05:02:53.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:53.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:53.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673058 2026-02-17T05:02:53.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673058 2026-02-17T05:02:53.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836579 1-42949673058' 2026-02-17T05:02:53.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:53.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:53.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542239 2026-02-17T05:02:53.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542239 2026-02-17T05:02:53.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836579 1-42949673058 2-60129542239' 2026-02-17T05:02:53.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:53.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836579 2026-02-17T05:02:53.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:53.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:53.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836579 2026-02-17T05:02:53.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:53.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836579 2026-02-17T05:02:53.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836579' 2026-02-17T05:02:53.303 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836579 2026-02-17T05:02:53.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:53.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836576 -lt 21474836579 2026-02-17T05:02:53.465 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:54.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:54.466 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:54.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836579 -lt 21474836579 2026-02-17T05:02:54.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:54.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673058 2026-02-17T05:02:54.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:54.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:54.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673058 2026-02-17T05:02:54.638 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:54.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673058 2026-02-17T05:02:54.639 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673058' 2026-02-17T05:02:54.639 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673058 2026-02-17T05:02:54.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:54.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673058 -lt 42949673058 2026-02-17T05:02:54.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:54.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542239 2026-02-17T05:02:54.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:54.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:54.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542239 2026-02-17T05:02:54.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:54.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542239 2026-02-17T05:02:54.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542239' 2026-02-17T05:02:54.811 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542239 2026-02-17T05:02:54.811 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:54.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542239 -lt 60129542239 2026-02-17T05:02:54.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:54.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:54.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:55.134 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:55.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:55.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:55.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:55.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:55.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:55.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:55.310 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:55.311 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:55.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:55.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:55.311 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:55.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836582 2026-02-17T05:02:55.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836582 2026-02-17T05:02:55.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836582' 2026-02-17T05:02:55.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:55.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:55.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673061 2026-02-17T05:02:55.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673061 2026-02-17T05:02:55.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836582 1-42949673061' 2026-02-17T05:02:55.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:55.424 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:55.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542242 2026-02-17T05:02:55.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542242 2026-02-17T05:02:55.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836582 1-42949673061 2-60129542242' 2026-02-17T05:02:55.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:55.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836582 2026-02-17T05:02:55.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:55.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:55.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836582 2026-02-17T05:02:55.486 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:55.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836582 2026-02-17T05:02:55.488 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836582' 2026-02-17T05:02:55.488 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836582 2026-02-17T05:02:55.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:55.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836582 -lt 21474836582 2026-02-17T05:02:55.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:55.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673061 2026-02-17T05:02:55.653 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:55.655 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:55.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673061 2026-02-17T05:02:55.656 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:55.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673061 2026-02-17T05:02:55.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673061' 2026-02-17T05:02:55.657 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673061 2026-02-17T05:02:55.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:55.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673061 -lt 42949673061 2026-02-17T05:02:55.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:55.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542242 2026-02-17T05:02:55.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:55.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:55.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542242 2026-02-17T05:02:55.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:55.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542242 2026-02-17T05:02:55.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542242' 2026-02-17T05:02:55.828 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542242 2026-02-17T05:02:55.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:55.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542242 -lt 60129542242 2026-02-17T05:02:55.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:55.997 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:55.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:56.153 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:56.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:56.161 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:56.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:56.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:56.162 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:56.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:56.325 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:56.325 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:56.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:56.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:56.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836584 2026-02-17T05:02:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836584 2026-02-17T05:02:56.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584' 2026-02-17T05:02:56.386 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:56.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673063 2026-02-17T05:02:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673063 2026-02-17T05:02:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584 1-42949673063' 2026-02-17T05:02:56.444 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:56.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542244 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542244 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836584 1-42949673063 2-60129542244' 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836584 2026-02-17T05:02:56.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:56.503 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:56.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836584 2026-02-17T05:02:56.504 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:56.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836584 2026-02-17T05:02:56.506 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836584 2026-02-17T05:02:56.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836584' 2026-02-17T05:02:56.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:56.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836582 -lt 21474836584 2026-02-17T05:02:56.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:57.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:57.671 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:57.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836585 -lt 21474836584 2026-02-17T05:02:57.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:57.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673063 2026-02-17T05:02:57.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:57.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:02:57.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673063 2026-02-17T05:02:57.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:57.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673063 2026-02-17T05:02:57.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673063' 2026-02-17T05:02:57.840 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673063 2026-02-17T05:02:57.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:02:58.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673064 -lt 42949673063 2026-02-17T05:02:58.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:58.004 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542244 2026-02-17T05:02:58.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:58.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:02:58.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542244 2026-02-17T05:02:58.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:58.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542244 2026-02-17T05:02:58.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542244' 2026-02-17T05:02:58.007 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542244 2026-02-17T05:02:58.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:02:58.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542245 -lt 60129542244 2026-02-17T05:02:58.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:02:58.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:02:58.171 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:02:58.330 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:02:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:02:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:02:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:02:58.338 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:02:58.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:58.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:02:58.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836587 2026-02-17T05:02:58.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836587 2026-02-17T05:02:58.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587' 2026-02-17T05:02:58.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:58.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:02:58.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673066 2026-02-17T05:02:58.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673066 2026-02-17T05:02:58.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587 1-42949673066' 2026-02-17T05:02:58.617 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:02:58.617 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:02:58.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542247 2026-02-17T05:02:58.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542247 2026-02-17T05:02:58.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836587 1-42949673066 2-60129542247' 2026-02-17T05:02:58.678 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:02:58.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836587 2026-02-17T05:02:58.678 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:02:58.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:02:58.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836587 2026-02-17T05:02:58.679 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:02:58.680 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836587 2026-02-17T05:02:58.681 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836587' 2026-02-17T05:02:58.681 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836587 2026-02-17T05:02:58.681 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:02:58.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836585 -lt 21474836587 2026-02-17T05:02:58.847 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:02:59.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:02:59.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:00.015 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836588 -lt 21474836587 2026-02-17T05:03:00.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:00.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673066 2026-02-17T05:03:00.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:00.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:00.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673066 2026-02-17T05:03:00.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:00.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673066 2026-02-17T05:03:00.019 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673066' 2026-02-17T05:03:00.019 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673066 2026-02-17T05:03:00.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:00.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673067 -lt 42949673066 2026-02-17T05:03:00.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:00.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542247 2026-02-17T05:03:00.188 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:00.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:00.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542247 2026-02-17T05:03:00.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:00.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542247 2026-02-17T05:03:00.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542247' 2026-02-17T05:03:00.190 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542247 2026-02-17T05:03:00.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:00.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542248 -lt 60129542247 2026-02-17T05:03:00.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:00.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:00.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:00.510 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:00.518 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:00.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:00.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:00.519 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:00.519 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:00.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:00.683 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:00.683 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:00.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:00.683 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:00.683 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:00.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836591 2026-02-17T05:03:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836591 2026-02-17T05:03:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836591' 2026-02-17T05:03:00.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:00.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:00.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673070 2026-02-17T05:03:00.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673070 2026-02-17T05:03:00.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836591 1-42949673070' 2026-02-17T05:03:00.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:00.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:00.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542250 2026-02-17T05:03:00.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542250 2026-02-17T05:03:00.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836591 1-42949673070 2-60129542250' 2026-02-17T05:03:00.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:00.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836591 2026-02-17T05:03:00.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:00.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:00.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836591 2026-02-17T05:03:00.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:00.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836591 2026-02-17T05:03:00.863 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836591 2026-02-17T05:03:00.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836591' 2026-02-17T05:03:00.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:01.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836588 -lt 21474836591 2026-02-17T05:03:01.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:02.027 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:02.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:02.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836591 -lt 21474836591 2026-02-17T05:03:02.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:02.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673070 2026-02-17T05:03:02.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:02.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:02.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673070 2026-02-17T05:03:02.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:02.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673070 2026-02-17T05:03:02.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673070' 2026-02-17T05:03:02.198 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673070 2026-02-17T05:03:02.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:02.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673070 -lt 42949673070 2026-02-17T05:03:02.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:02.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542250 2026-02-17T05:03:02.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:02.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:02.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542250 2026-02-17T05:03:02.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:02.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542250 2026-02-17T05:03:02.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542250' 2026-02-17T05:03:02.365 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542250 2026-02-17T05:03:02.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:02.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542251 -lt 60129542250 2026-02-17T05:03:02.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:02.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:02.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:02.683 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:02.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:02.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:02.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:02.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:02.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:02.859 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:02.859 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:02.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:02.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:02.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836594 2026-02-17T05:03:02.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836594 2026-02-17T05:03:02.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594' 2026-02-17T05:03:02.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:02.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:02.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673073 2026-02-17T05:03:02.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673073 2026-02-17T05:03:02.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594 1-42949673073' 2026-02-17T05:03:02.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:02.978 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542254 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542254 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594 1-42949673073 2-60129542254' 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836594 2026-02-17T05:03:03.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:03.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:03.036 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836594 2026-02-17T05:03:03.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:03.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836594 2026-02-17T05:03:03.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836594' 2026-02-17T05:03:03.038 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836594 2026-02-17T05:03:03.039 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:03.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836591 -lt 21474836594 2026-02-17T05:03:03.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:04.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:04.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:04.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836594 -lt 21474836594 2026-02-17T05:03:04.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:04.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673073 2026-02-17T05:03:04.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:04.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:04.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673073 2026-02-17T05:03:04.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:04.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673073 2026-02-17T05:03:04.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673073' 2026-02-17T05:03:04.375 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673073 2026-02-17T05:03:04.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:04.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673073 -lt 42949673073 2026-02-17T05:03:04.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:04.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542254 2026-02-17T05:03:04.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:04.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:04.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542254 2026-02-17T05:03:04.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:04.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542254 2026-02-17T05:03:04.546 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542254' 2026-02-17T05:03:04.546 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542254 2026-02-17T05:03:04.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:04.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542254 -lt 60129542254 2026-02-17T05:03:04.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:04.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:04.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:04.875 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:04.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:04.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:04.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:04.883 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:04.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:05.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:05.046 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:05.046 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:05.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:05.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:05.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:05.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836597 2026-02-17T05:03:05.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836597 2026-02-17T05:03:05.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597' 2026-02-17T05:03:05.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:05.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:05.162 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673076 2026-02-17T05:03:05.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673076 2026-02-17T05:03:05.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597 1-42949673076' 2026-02-17T05:03:05.163 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:05.163 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542257 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542257 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597 1-42949673076 2-60129542257' 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836597 2026-02-17T05:03:05.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:05.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:05.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836597 2026-02-17T05:03:05.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:05.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836597 2026-02-17T05:03:05.223 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836597' 2026-02-17T05:03:05.223 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836597 2026-02-17T05:03:05.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:05.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836594 -lt 21474836597 2026-02-17T05:03:05.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:06.392 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:06.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:06.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836597 -lt 21474836597 2026-02-17T05:03:06.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:06.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673076 2026-02-17T05:03:06.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:06.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:06.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673076 2026-02-17T05:03:06.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:06.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673076 2026-02-17T05:03:06.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673076' 2026-02-17T05:03:06.562 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673076 2026-02-17T05:03:06.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:06.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673076 -lt 42949673076 2026-02-17T05:03:06.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:06.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542257 2026-02-17T05:03:06.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:06.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:06.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542257 2026-02-17T05:03:06.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:06.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542257 2026-02-17T05:03:06.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542257' 2026-02-17T05:03:06.731 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542257 2026-02-17T05:03:06.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:06.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542257 -lt 60129542257 2026-02-17T05:03:06.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:06.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:06.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:07.049 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:07.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:07.058 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:07.058 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:07.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:07.227 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:07.227 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:07.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:07.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:07.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:07.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836600 2026-02-17T05:03:07.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836600 2026-02-17T05:03:07.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600' 2026-02-17T05:03:07.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:07.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:07.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673079 2026-02-17T05:03:07.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673079 2026-02-17T05:03:07.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600 1-42949673079' 2026-02-17T05:03:07.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:07.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542260 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542260 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600 1-42949673079 2-60129542260' 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836600 2026-02-17T05:03:07.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:07.405 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:07.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836600 2026-02-17T05:03:07.406 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:07.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836600 2026-02-17T05:03:07.407 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836600 2026-02-17T05:03:07.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836600' 2026-02-17T05:03:07.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:07.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836597 -lt 21474836600 2026-02-17T05:03:07.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:08.571 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:08.572 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:08.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836600 -lt 21474836600 2026-02-17T05:03:08.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:08.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673079 2026-02-17T05:03:08.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:08.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:08.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673079 2026-02-17T05:03:08.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:08.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673079 2026-02-17T05:03:08.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673079' 2026-02-17T05:03:08.740 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673079 2026-02-17T05:03:08.740 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673079 -lt 42949673079 2026-02-17T05:03:08.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:08.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542260 2026-02-17T05:03:08.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:08.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:08.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542260 2026-02-17T05:03:08.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:08.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542260 2026-02-17T05:03:08.911 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542260' 2026-02-17T05:03:08.911 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542260 2026-02-17T05:03:08.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:09.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542260 -lt 60129542260 2026-02-17T05:03:09.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:09.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:09.240 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:09.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:09.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:09.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:09.416 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:09.416 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:09.416 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:09.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:09.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:09.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836603 2026-02-17T05:03:09.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836603 2026-02-17T05:03:09.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836603' 2026-02-17T05:03:09.475 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:09.475 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:09.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673082 2026-02-17T05:03:09.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673082 2026-02-17T05:03:09.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836603 1-42949673082' 2026-02-17T05:03:09.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:09.531 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:09.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542263 2026-02-17T05:03:09.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542263 2026-02-17T05:03:09.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836603 1-42949673082 2-60129542263' 2026-02-17T05:03:09.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:09.589 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836603 2026-02-17T05:03:09.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:09.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:09.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836603 2026-02-17T05:03:09.591 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:09.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836603 2026-02-17T05:03:09.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836603' 2026-02-17T05:03:09.593 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836603 2026-02-17T05:03:09.593 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:09.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836603 -lt 21474836603 2026-02-17T05:03:09.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:09.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673082 2026-02-17T05:03:09.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:09.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:09.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673082 2026-02-17T05:03:09.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:09.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673082 2026-02-17T05:03:09.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673082' 2026-02-17T05:03:09.765 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673082 2026-02-17T05:03:09.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:09.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673082 -lt 42949673082 2026-02-17T05:03:09.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:09.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542263 2026-02-17T05:03:09.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:09.930 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:09.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542263 2026-02-17T05:03:09.931 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:09.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542263 2026-02-17T05:03:09.932 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542263 2026-02-17T05:03:09.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542263' 2026-02-17T05:03:09.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:10.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542262 -lt 60129542263 2026-02-17T05:03:10.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:11.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:11.100 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:11.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542262 -lt 60129542263 2026-02-17T05:03:11.266 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:12.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:03:12.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:12.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542265 -lt 60129542263 2026-02-17T05:03:12.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:12.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:12.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:12.594 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:12.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:12.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:12.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:12.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:12.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:12.771 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:12.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836608 2026-02-17T05:03:12.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836608 2026-02-17T05:03:12.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836608' 2026-02-17T05:03:12.830 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:12.830 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:12.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673087 2026-02-17T05:03:12.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673087 2026-02-17T05:03:12.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836608 1-42949673087' 2026-02-17T05:03:12.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:12.887 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:12.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542267 2026-02-17T05:03:12.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542267 2026-02-17T05:03:12.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836608 1-42949673087 2-60129542267' 2026-02-17T05:03:12.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:12.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836608 2026-02-17T05:03:12.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:12.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:12.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836608 2026-02-17T05:03:12.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:12.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836608 2026-02-17T05:03:12.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836608' 2026-02-17T05:03:12.949 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836608 2026-02-17T05:03:12.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:13.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836605 -lt 21474836608 2026-02-17T05:03:13.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:14.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:14.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:14.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836608 -lt 21474836608 2026-02-17T05:03:14.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:14.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673087 2026-02-17T05:03:14.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:14.286 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:14.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673087 2026-02-17T05:03:14.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:14.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673087 2026-02-17T05:03:14.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673087' 2026-02-17T05:03:14.288 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673087 2026-02-17T05:03:14.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:14.450 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673087 -lt 42949673087 2026-02-17T05:03:14.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:14.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542267 2026-02-17T05:03:14.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:14.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:14.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542267 2026-02-17T05:03:14.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:14.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542267 2026-02-17T05:03:14.454 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542267' 2026-02-17T05:03:14.454 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542267 2026-02-17T05:03:14.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:14.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542268 -lt 60129542267 2026-02-17T05:03:14.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:14.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:14.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:14.780 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:14.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:14.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:14.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:14.789 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:14.789 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:14.960 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836611 2026-02-17T05:03:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836611 2026-02-17T05:03:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836611' 2026-02-17T05:03:15.020 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:15.020 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673090 2026-02-17T05:03:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673090 2026-02-17T05:03:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836611 1-42949673090' 2026-02-17T05:03:15.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:15.079 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542271 2026-02-17T05:03:15.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542271 2026-02-17T05:03:15.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836611 1-42949673090 2-60129542271' 2026-02-17T05:03:15.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:15.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836611 2026-02-17T05:03:15.138 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:15.138 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:15.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836611 2026-02-17T05:03:15.139 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:15.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836611 2026-02-17T05:03:15.140 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836611' 2026-02-17T05:03:15.140 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836611 2026-02-17T05:03:15.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:15.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836608 -lt 21474836611 2026-02-17T05:03:15.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:16.307 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:16.308 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:16.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836611 -lt 21474836611 2026-02-17T05:03:16.479 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:16.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673090 2026-02-17T05:03:16.480 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:16.480 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:16.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673090 2026-02-17T05:03:16.481 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:16.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673090 2026-02-17T05:03:16.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673090' 2026-02-17T05:03:16.483 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673090 2026-02-17T05:03:16.483 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:16.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673090 -lt 42949673090 2026-02-17T05:03:16.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:16.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542271 2026-02-17T05:03:16.648 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:16.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:16.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542271 2026-02-17T05:03:16.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:16.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542271 2026-02-17T05:03:16.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542271' 2026-02-17T05:03:16.651 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542271 2026-02-17T05:03:16.651 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:16.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542271 -lt 60129542271 2026-02-17T05:03:16.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:16.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:16.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:16.969 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:16.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:16.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:16.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:16.977 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:16.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:17.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:17.141 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:17.141 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:17.141 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:17.142 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:17.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:17.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836614 2026-02-17T05:03:17.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836614 2026-02-17T05:03:17.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836614' 2026-02-17T05:03:17.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:17.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:17.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673093 2026-02-17T05:03:17.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673093 2026-02-17T05:03:17.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836614 1-42949673093' 2026-02-17T05:03:17.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:17.260 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:17.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542274 2026-02-17T05:03:17.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542274 2026-02-17T05:03:17.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836614 1-42949673093 2-60129542274' 2026-02-17T05:03:17.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:17.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836614 2026-02-17T05:03:17.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:17.319 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:17.319 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836614 2026-02-17T05:03:17.320 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:17.320 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836614 2026-02-17T05:03:17.321 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836614 2026-02-17T05:03:17.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836614' 2026-02-17T05:03:17.321 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:17.486 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836611 -lt 21474836614 2026-02-17T05:03:17.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:18.487 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:18.488 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:18.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836614 -lt 21474836614 2026-02-17T05:03:18.656 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:18.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673093 2026-02-17T05:03:18.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:18.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:18.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673093 2026-02-17T05:03:18.658 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:18.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673093 2026-02-17T05:03:18.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673093' 2026-02-17T05:03:18.660 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673093 2026-02-17T05:03:18.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:18.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673093 -lt 42949673093 2026-02-17T05:03:18.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:18.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542274 2026-02-17T05:03:18.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:18.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:18.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542274 2026-02-17T05:03:18.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:18.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542274 2026-02-17T05:03:18.828 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542274' 2026-02-17T05:03:18.828 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542274 2026-02-17T05:03:18.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:18.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542274 -lt 60129542274 2026-02-17T05:03:18.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:18.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:18.991 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:19.147 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:19.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:19.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:19.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:19.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:19.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:19.317 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:19.318 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:19.318 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:19.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:19.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:19.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:19.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836617 2026-02-17T05:03:19.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836617 2026-02-17T05:03:19.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836617' 2026-02-17T05:03:19.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:19.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:19.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673096 2026-02-17T05:03:19.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673096 2026-02-17T05:03:19.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836617 1-42949673096' 2026-02-17T05:03:19.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:19.434 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:19.492 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542277 2026-02-17T05:03:19.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542277 2026-02-17T05:03:19.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836617 1-42949673096 2-60129542277' 2026-02-17T05:03:19.493 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:19.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836617 2026-02-17T05:03:19.493 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:19.494 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:19.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836617 2026-02-17T05:03:19.494 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:19.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836617 2026-02-17T05:03:19.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836617' 2026-02-17T05:03:19.496 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836617 2026-02-17T05:03:19.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:19.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836617 -lt 21474836617 2026-02-17T05:03:19.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:19.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673096 2026-02-17T05:03:19.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:19.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:19.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673096 2026-02-17T05:03:19.663 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:19.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673096 2026-02-17T05:03:19.664 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673096 2026-02-17T05:03:19.664 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673096' 2026-02-17T05:03:19.665 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:19.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673096 -lt 42949673096 2026-02-17T05:03:19.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:19.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542277 2026-02-17T05:03:19.832 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:19.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:19.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542277 2026-02-17T05:03:19.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542277 2026-02-17T05:03:19.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542277' 2026-02-17T05:03:19.835 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542277 2026-02-17T05:03:19.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:20.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542277 -lt 60129542277 2026-02-17T05:03:20.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:20.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:20.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:20.158 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:20.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:20.167 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:20.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:20.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:20.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:20.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:20.331 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:20.332 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:20.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:20.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:20.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:20.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836619 2026-02-17T05:03:20.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836619 2026-02-17T05:03:20.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619' 2026-02-17T05:03:20.391 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:20.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:20.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673098 2026-02-17T05:03:20.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673098 2026-02-17T05:03:20.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619 1-42949673098' 2026-02-17T05:03:20.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:20.448 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:20.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542279 2026-02-17T05:03:20.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542279 2026-02-17T05:03:20.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836619 1-42949673098 2-60129542279' 2026-02-17T05:03:20.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:20.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836619 2026-02-17T05:03:20.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:20.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:20.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836619 2026-02-17T05:03:20.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:20.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836619 2026-02-17T05:03:20.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836619' 2026-02-17T05:03:20.509 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836619 2026-02-17T05:03:20.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836617 -lt 21474836619 2026-02-17T05:03:20.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:21.674 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:21.675 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:21.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836620 -lt 21474836619 2026-02-17T05:03:21.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:21.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673098 2026-02-17T05:03:21.846 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:21.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:21.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673098 2026-02-17T05:03:21.847 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:21.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673098 2026-02-17T05:03:21.849 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673098 2026-02-17T05:03:21.849 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673098' 2026-02-17T05:03:21.849 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:22.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673099 -lt 42949673098 2026-02-17T05:03:22.014 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:22.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542279 2026-02-17T05:03:22.015 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:22.016 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:22.016 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542279 2026-02-17T05:03:22.017 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542279 2026-02-17T05:03:22.018 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542279 2026-02-17T05:03:22.018 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542279' 2026-02-17T05:03:22.019 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542280 -lt 60129542279 2026-02-17T05:03:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:22.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:22.340 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:22.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:22.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:22.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:22.349 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:22.349 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:22.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:22.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836622 2026-02-17T05:03:22.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836622 2026-02-17T05:03:22.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622' 2026-02-17T05:03:22.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:22.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:22.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673102 2026-02-17T05:03:22.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673102 2026-02-17T05:03:22.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622 1-42949673102' 2026-02-17T05:03:22.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:22.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:22.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542282 2026-02-17T05:03:22.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542282 2026-02-17T05:03:22.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836622 1-42949673102 2-60129542282' 2026-02-17T05:03:22.690 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:22.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836622 2026-02-17T05:03:22.691 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:22.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:22.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836622 2026-02-17T05:03:22.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:22.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836622 2026-02-17T05:03:22.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836622' 2026-02-17T05:03:22.694 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836622 2026-02-17T05:03:22.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836620 -lt 21474836622 2026-02-17T05:03:22.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:23.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:23.861 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:24.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836623 -lt 21474836622 2026-02-17T05:03:24.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:24.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673102 2026-02-17T05:03:24.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:24.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:24.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673102 2026-02-17T05:03:24.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:24.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673102 2026-02-17T05:03:24.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673102' 2026-02-17T05:03:24.030 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673102 2026-02-17T05:03:24.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:24.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673102 -lt 42949673102 2026-02-17T05:03:24.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:24.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542282 2026-02-17T05:03:24.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:24.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:24.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542282 2026-02-17T05:03:24.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542282 2026-02-17T05:03:24.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542282' 2026-02-17T05:03:24.196 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542282 2026-02-17T05:03:24.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:24.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542283 -lt 60129542282 2026-02-17T05:03:24.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:24.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:24.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:24.517 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:24.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:24.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:24.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:24.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:24.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:24.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:24.688 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:24.688 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:24.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:24.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:24.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:24.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836626 2026-02-17T05:03:24.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836626 2026-02-17T05:03:24.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626' 2026-02-17T05:03:24.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:24.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:24.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673105 2026-02-17T05:03:24.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673105 2026-02-17T05:03:24.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626 1-42949673105' 2026-02-17T05:03:24.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:24.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:24.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542285 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542285 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626 1-42949673105 2-60129542285' 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836626 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:24.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:24.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836626 2026-02-17T05:03:24.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:24.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836626 2026-02-17T05:03:24.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836626' 2026-02-17T05:03:24.869 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836626 2026-02-17T05:03:24.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836623 -lt 21474836626 2026-02-17T05:03:25.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:26.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:26.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:26.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836626 -lt 21474836626 2026-02-17T05:03:26.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:26.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673105 2026-02-17T05:03:26.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:26.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:26.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673105 2026-02-17T05:03:26.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:26.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673105 2026-02-17T05:03:26.205 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673105 2026-02-17T05:03:26.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673105' 2026-02-17T05:03:26.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:26.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673105 -lt 42949673105 2026-02-17T05:03:26.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:26.372 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542285 2026-02-17T05:03:26.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:26.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:26.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542285 2026-02-17T05:03:26.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:26.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542285 2026-02-17T05:03:26.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542285' 2026-02-17T05:03:26.375 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542285 2026-02-17T05:03:26.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:26.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542286 -lt 60129542285 2026-02-17T05:03:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:26.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:26.696 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:26.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:26.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:26.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:26.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:26.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:26.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:26.869 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:26.869 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:26.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:26.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:26.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836629 2026-02-17T05:03:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836629 2026-02-17T05:03:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629' 2026-02-17T05:03:26.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:26.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:26.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673108 2026-02-17T05:03:26.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673108 2026-02-17T05:03:26.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629 1-42949673108' 2026-02-17T05:03:26.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:26.986 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:27.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542289 2026-02-17T05:03:27.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542289 2026-02-17T05:03:27.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629 1-42949673108 2-60129542289' 2026-02-17T05:03:27.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:27.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836629 2026-02-17T05:03:27.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:27.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:27.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836629 2026-02-17T05:03:27.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:27.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836629 2026-02-17T05:03:27.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836629' 2026-02-17T05:03:27.047 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836629 2026-02-17T05:03:27.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836626 -lt 21474836629 2026-02-17T05:03:27.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:28.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:28.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:28.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836629 -lt 21474836629 2026-02-17T05:03:28.381 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:28.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673108 2026-02-17T05:03:28.382 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:28.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:28.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673108 2026-02-17T05:03:28.383 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:28.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673108 2026-02-17T05:03:28.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673108' 2026-02-17T05:03:28.385 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673108 2026-02-17T05:03:28.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:28.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673108 -lt 42949673108 2026-02-17T05:03:28.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:28.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542289 2026-02-17T05:03:28.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:28.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:28.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542289 2026-02-17T05:03:28.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:28.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542289 2026-02-17T05:03:28.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542289' 2026-02-17T05:03:28.556 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542289 2026-02-17T05:03:28.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:28.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542289 -lt 60129542289 2026-02-17T05:03:28.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:28.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:28.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:28.879 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:28.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:28.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:28.887 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:28.888 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:28.888 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:29.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:29.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836632 2026-02-17T05:03:29.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836632 2026-02-17T05:03:29.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836632' 2026-02-17T05:03:29.110 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:29.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:29.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673111 2026-02-17T05:03:29.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673111 2026-02-17T05:03:29.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836632 1-42949673111' 2026-02-17T05:03:29.170 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:29.171 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:29.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542292 2026-02-17T05:03:29.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542292 2026-02-17T05:03:29.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836632 1-42949673111 2-60129542292' 2026-02-17T05:03:29.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:29.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836632 2026-02-17T05:03:29.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:29.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:29.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836632 2026-02-17T05:03:29.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:29.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836632 2026-02-17T05:03:29.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836632' 2026-02-17T05:03:29.230 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836632 2026-02-17T05:03:29.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:29.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836629 -lt 21474836632 2026-02-17T05:03:29.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:30.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:30.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:30.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836632 -lt 21474836632 2026-02-17T05:03:30.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:30.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673111 2026-02-17T05:03:30.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:30.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:30.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673111 2026-02-17T05:03:30.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:30.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673111 2026-02-17T05:03:30.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673111' 2026-02-17T05:03:30.564 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673111 2026-02-17T05:03:30.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:30.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673111 -lt 42949673111 2026-02-17T05:03:30.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:30.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542292 2026-02-17T05:03:30.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:30.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:30.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542292 2026-02-17T05:03:30.729 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:30.730 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542292 2026-02-17T05:03:30.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542292' 2026-02-17T05:03:30.731 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542292 2026-02-17T05:03:30.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:30.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542292 -lt 60129542292 2026-02-17T05:03:30.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:30.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:30.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:31.057 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:31.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:31.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:31.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:31.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:31.066 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:31.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:31.230 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:31.230 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:31.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:31.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:31.231 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:31.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836635 2026-02-17T05:03:31.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836635 2026-02-17T05:03:31.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836635' 2026-02-17T05:03:31.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:31.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:31.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673114 2026-02-17T05:03:31.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673114 2026-02-17T05:03:31.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836635 1-42949673114' 2026-02-17T05:03:31.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:31.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:31.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542295 2026-02-17T05:03:31.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542295 2026-02-17T05:03:31.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836635 1-42949673114 2-60129542295' 2026-02-17T05:03:31.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836635 2026-02-17T05:03:31.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:31.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:31.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836635 2026-02-17T05:03:31.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:31.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836635 2026-02-17T05:03:31.412 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836635' 2026-02-17T05:03:31.412 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836635 2026-02-17T05:03:31.412 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:31.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836632 -lt 21474836635 2026-02-17T05:03:31.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:32.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:32.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:32.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836635 -lt 21474836635 2026-02-17T05:03:32.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:32.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673114 2026-02-17T05:03:32.749 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:32.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:32.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673114 2026-02-17T05:03:32.750 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:32.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673114 2026-02-17T05:03:32.751 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673114' 2026-02-17T05:03:32.752 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673114 2026-02-17T05:03:32.752 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:32.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673114 -lt 42949673114 2026-02-17T05:03:32.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:32.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542295 2026-02-17T05:03:32.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:32.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:32.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542295 2026-02-17T05:03:32.920 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:32.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542295 2026-02-17T05:03:32.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542295' 2026-02-17T05:03:32.922 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542295 2026-02-17T05:03:32.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:33.089 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542295 -lt 60129542295 2026-02-17T05:03:33.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:33.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:33.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:33.246 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:33.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:33.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:33.417 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:33.418 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:33.418 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:33.418 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:33.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:33.476 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836638 2026-02-17T05:03:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836638 2026-02-17T05:03:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638' 2026-02-17T05:03:33.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:33.477 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:33.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673117 2026-02-17T05:03:33.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673117 2026-02-17T05:03:33.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638 1-42949673117' 2026-02-17T05:03:33.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:33.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:33.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542298 2026-02-17T05:03:33.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542298 2026-02-17T05:03:33.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638 1-42949673117 2-60129542298' 2026-02-17T05:03:33.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:33.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836638 2026-02-17T05:03:33.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:33.595 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:33.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836638 2026-02-17T05:03:33.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:33.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836638 2026-02-17T05:03:33.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836638' 2026-02-17T05:03:33.597 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836638 2026-02-17T05:03:33.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:33.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836638 -lt 21474836638 2026-02-17T05:03:33.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:33.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673117 2026-02-17T05:03:33.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:33.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:33.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673117 2026-02-17T05:03:33.764 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:33.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673117 2026-02-17T05:03:33.765 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673117' 2026-02-17T05:03:33.766 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673117 2026-02-17T05:03:33.766 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:33.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673117 -lt 42949673117 2026-02-17T05:03:33.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:33.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542298 2026-02-17T05:03:33.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:33.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:33.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542298 2026-02-17T05:03:33.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:33.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542298 2026-02-17T05:03:33.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542298' 2026-02-17T05:03:33.937 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542298 2026-02-17T05:03:33.938 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:34.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542297 -lt 60129542298 2026-02-17T05:03:34.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:35.109 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:35.110 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:35.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542297 -lt 60129542298 2026-02-17T05:03:35.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:36.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:03:36.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:36.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542300 -lt 60129542298 2026-02-17T05:03:36.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:36.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:36.445 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:36.601 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:36.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:36.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:36.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:36.775 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:36.775 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:36.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:36.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:36.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:36.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836643 2026-02-17T05:03:36.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836643 2026-02-17T05:03:36.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836643' 2026-02-17T05:03:36.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:36.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673122 2026-02-17T05:03:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673122 2026-02-17T05:03:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836643 1-42949673122' 2026-02-17T05:03:36.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:36.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:36.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542302 2026-02-17T05:03:36.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542302 2026-02-17T05:03:36.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836643 1-42949673122 2-60129542302' 2026-02-17T05:03:36.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:36.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836643 2026-02-17T05:03:36.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:36.952 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:36.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836643 2026-02-17T05:03:36.952 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:36.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836643 2026-02-17T05:03:36.953 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836643' 2026-02-17T05:03:36.954 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836643 2026-02-17T05:03:36.954 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:37.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836640 -lt 21474836643 2026-02-17T05:03:37.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:38.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:38.121 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:38.283 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836643 -lt 21474836643 2026-02-17T05:03:38.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:38.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673122 2026-02-17T05:03:38.284 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:38.285 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:38.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673122 2026-02-17T05:03:38.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:38.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673122 2026-02-17T05:03:38.287 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673122' 2026-02-17T05:03:38.287 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673122 2026-02-17T05:03:38.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:38.451 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673122 -lt 42949673122 2026-02-17T05:03:38.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:38.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542302 2026-02-17T05:03:38.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:38.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:38.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542302 2026-02-17T05:03:38.454 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:38.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542302 2026-02-17T05:03:38.455 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542302' 2026-02-17T05:03:38.455 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542302 2026-02-17T05:03:38.456 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:38.618 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542303 -lt 60129542302 2026-02-17T05:03:38.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:38.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:38.619 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:38.775 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:38.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:38.783 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:38.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:38.784 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:38.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:38.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:39.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836646 2026-02-17T05:03:39.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836646 2026-02-17T05:03:39.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836646' 2026-02-17T05:03:39.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:39.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:39.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673125 2026-02-17T05:03:39.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673125 2026-02-17T05:03:39.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836646 1-42949673125' 2026-02-17T05:03:39.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:39.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542306 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542306 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836646 1-42949673125 2-60129542306' 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836646 2026-02-17T05:03:39.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:39.121 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:39.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836646 2026-02-17T05:03:39.122 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:39.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836646 2026-02-17T05:03:39.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836646' 2026-02-17T05:03:39.123 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836646 2026-02-17T05:03:39.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836643 -lt 21474836646 2026-02-17T05:03:39.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:40.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:40.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:40.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836646 -lt 21474836646 2026-02-17T05:03:40.461 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:40.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673125 2026-02-17T05:03:40.461 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:40.462 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:40.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673125 2026-02-17T05:03:40.463 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:40.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673125 2026-02-17T05:03:40.464 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673125' 2026-02-17T05:03:40.464 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673125 2026-02-17T05:03:40.465 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673125 -lt 42949673125 2026-02-17T05:03:40.635 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:40.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542306 2026-02-17T05:03:40.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:40.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:40.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542306 2026-02-17T05:03:40.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542306 2026-02-17T05:03:40.638 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542306' 2026-02-17T05:03:40.639 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542306 2026-02-17T05:03:40.639 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:40.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542306 -lt 60129542306 2026-02-17T05:03:40.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:40.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:40.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:40.962 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:40.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:40.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:40.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:40.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:40.970 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:41.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:41.135 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:41.135 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:41.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:41.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:41.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836649 2026-02-17T05:03:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836649 2026-02-17T05:03:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836649' 2026-02-17T05:03:41.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:41.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:41.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673128 2026-02-17T05:03:41.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673128 2026-02-17T05:03:41.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836649 1-42949673128' 2026-02-17T05:03:41.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:41.253 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542309 2026-02-17T05:03:41.309 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542309 2026-02-17T05:03:41.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836649 1-42949673128 2-60129542309' 2026-02-17T05:03:41.310 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:41.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836649 2026-02-17T05:03:41.310 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:41.311 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:41.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836649 2026-02-17T05:03:41.312 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:41.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836649 2026-02-17T05:03:41.313 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836649' 2026-02-17T05:03:41.313 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836649 2026-02-17T05:03:41.313 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:41.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836646 -lt 21474836649 2026-02-17T05:03:41.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:42.478 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:42.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:42.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836649 -lt 21474836649 2026-02-17T05:03:42.645 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:42.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673128 2026-02-17T05:03:42.646 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:42.646 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:42.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673128 2026-02-17T05:03:42.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:42.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673128 2026-02-17T05:03:42.648 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673128' 2026-02-17T05:03:42.649 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673128 2026-02-17T05:03:42.649 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:42.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673128 -lt 42949673128 2026-02-17T05:03:42.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542309 2026-02-17T05:03:42.814 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:42.815 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:42.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542309 2026-02-17T05:03:42.815 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:42.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542309 2026-02-17T05:03:42.816 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542309' 2026-02-17T05:03:42.817 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542309 2026-02-17T05:03:42.817 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:42.986 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542309 -lt 60129542309 2026-02-17T05:03:42.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:42.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:42.987 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:43.143 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:43.151 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:43.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:43.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:43.152 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:43.152 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:43.318 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:43.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836652 2026-02-17T05:03:43.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836652 2026-02-17T05:03:43.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652' 2026-02-17T05:03:43.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:43.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:43.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673131 2026-02-17T05:03:43.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673131 2026-02-17T05:03:43.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652 1-42949673131' 2026-02-17T05:03:43.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:43.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:43.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542312 2026-02-17T05:03:43.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542312 2026-02-17T05:03:43.498 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652 1-42949673131 2-60129542312' 2026-02-17T05:03:43.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:43.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836652 2026-02-17T05:03:43.499 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:43.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:43.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836652 2026-02-17T05:03:43.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836652 2026-02-17T05:03:43.501 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836652' 2026-02-17T05:03:43.501 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836652 2026-02-17T05:03:43.502 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:43.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836652 -lt 21474836652 2026-02-17T05:03:43.670 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:43.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673131 2026-02-17T05:03:43.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:43.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:43.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673131 2026-02-17T05:03:43.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:43.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673131 2026-02-17T05:03:43.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673131' 2026-02-17T05:03:43.674 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673131 2026-02-17T05:03:43.674 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:43.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673131 -lt 42949673131 2026-02-17T05:03:43.837 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:43.837 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542312 2026-02-17T05:03:43.838 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:43.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:43.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542312 2026-02-17T05:03:43.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:43.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542312 2026-02-17T05:03:43.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542312' 2026-02-17T05:03:43.840 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542312 2026-02-17T05:03:43.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:44.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542312 -lt 60129542312 2026-02-17T05:03:44.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:44.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:44.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:44.159 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:44.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:44.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:44.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:44.168 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:44.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:44.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:44.332 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:44.332 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:44.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:44.333 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:44.333 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:44.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836654 2026-02-17T05:03:44.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836654 2026-02-17T05:03:44.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654' 2026-02-17T05:03:44.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:44.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:44.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673133 2026-02-17T05:03:44.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673133 2026-02-17T05:03:44.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654 1-42949673133' 2026-02-17T05:03:44.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:44.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542314 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542314 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836654 1-42949673133 2-60129542314' 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836654 2026-02-17T05:03:44.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:44.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:44.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836654 2026-02-17T05:03:44.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:44.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836654 2026-02-17T05:03:44.512 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836654' 2026-02-17T05:03:44.513 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836654 2026-02-17T05:03:44.513 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:44.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836652 -lt 21474836654 2026-02-17T05:03:44.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:45.677 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:45.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:45.840 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836655 -lt 21474836654 2026-02-17T05:03:45.841 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:45.841 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673133 2026-02-17T05:03:45.842 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:45.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:45.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673133 2026-02-17T05:03:45.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:45.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673133 2026-02-17T05:03:45.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673133' 2026-02-17T05:03:45.844 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673133 2026-02-17T05:03:45.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:46.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673134 -lt 42949673133 2026-02-17T05:03:46.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:46.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542314 2026-02-17T05:03:46.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:46.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:46.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542314 2026-02-17T05:03:46.009 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:46.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542314 2026-02-17T05:03:46.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542314' 2026-02-17T05:03:46.011 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542314 2026-02-17T05:03:46.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:46.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542315 -lt 60129542314 2026-02-17T05:03:46.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:46.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:46.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:46.333 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:46.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:46.341 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:46.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:46.509 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:46.509 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:46.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:46.510 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:46.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836657 2026-02-17T05:03:46.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836657 2026-02-17T05:03:46.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657' 2026-02-17T05:03:46.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:46.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:46.628 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673136 2026-02-17T05:03:46.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673136 2026-02-17T05:03:46.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657 1-42949673136' 2026-02-17T05:03:46.629 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:46.629 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:46.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542317 2026-02-17T05:03:46.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542317 2026-02-17T05:03:46.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836657 1-42949673136 2-60129542317' 2026-02-17T05:03:46.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:46.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836657 2026-02-17T05:03:46.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:46.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:46.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836657 2026-02-17T05:03:46.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:46.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836657 2026-02-17T05:03:46.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836657' 2026-02-17T05:03:46.689 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836657 2026-02-17T05:03:46.690 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:46.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836655 -lt 21474836657 2026-02-17T05:03:46.859 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:47.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:47.860 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:48.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836658 -lt 21474836657 2026-02-17T05:03:48.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:48.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673136 2026-02-17T05:03:48.027 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:48.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:48.028 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673136 2026-02-17T05:03:48.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:48.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673136 2026-02-17T05:03:48.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673136' 2026-02-17T05:03:48.030 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673136 2026-02-17T05:03:48.030 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:48.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673137 -lt 42949673136 2026-02-17T05:03:48.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:48.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542317 2026-02-17T05:03:48.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:48.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:48.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542317 2026-02-17T05:03:48.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:48.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542317 2026-02-17T05:03:48.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542317' 2026-02-17T05:03:48.198 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542317 2026-02-17T05:03:48.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:48.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542318 -lt 60129542317 2026-02-17T05:03:48.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:48.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:48.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:48.517 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:48.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:48.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:48.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:48.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:48.526 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:48.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:48.691 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:48.691 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:48.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:48.691 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:48.692 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:48.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836661 2026-02-17T05:03:48.752 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836661 2026-02-17T05:03:48.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836661' 2026-02-17T05:03:48.753 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:48.753 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:48.809 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673140 2026-02-17T05:03:48.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673140 2026-02-17T05:03:48.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836661 1-42949673140' 2026-02-17T05:03:48.810 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:48.810 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542320 2026-02-17T05:03:48.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542320 2026-02-17T05:03:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836661 1-42949673140 2-60129542320' 2026-02-17T05:03:48.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836661 2026-02-17T05:03:48.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:48.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:48.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836661 2026-02-17T05:03:48.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:48.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836661 2026-02-17T05:03:48.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836661' 2026-02-17T05:03:48.871 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836661 2026-02-17T05:03:48.872 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:49.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836658 -lt 21474836661 2026-02-17T05:03:49.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:50.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:50.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:50.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836661 -lt 21474836661 2026-02-17T05:03:50.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:50.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673140 2026-02-17T05:03:50.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:50.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:50.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673140 2026-02-17T05:03:50.206 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:50.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673140 2026-02-17T05:03:50.207 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673140' 2026-02-17T05:03:50.207 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673140 2026-02-17T05:03:50.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:50.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673140 -lt 42949673140 2026-02-17T05:03:50.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:50.370 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542320 2026-02-17T05:03:50.371 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:50.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:50.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542320 2026-02-17T05:03:50.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:50.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542320 2026-02-17T05:03:50.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542320' 2026-02-17T05:03:50.375 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542320 2026-02-17T05:03:50.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:50.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542321 -lt 60129542320 2026-02-17T05:03:50.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:50.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:50.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:50.693 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:50.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:50.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:50.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:50.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:50.701 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:50.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:50.863 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:50.863 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:50.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:50.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:50.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:50.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836664 2026-02-17T05:03:50.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836664 2026-02-17T05:03:50.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836664' 2026-02-17T05:03:50.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:50.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:50.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673143 2026-02-17T05:03:50.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673143 2026-02-17T05:03:50.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836664 1-42949673143' 2026-02-17T05:03:50.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:50.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542324 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542324 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836664 1-42949673143 2-60129542324' 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836664 2026-02-17T05:03:51.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:51.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:51.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836664 2026-02-17T05:03:51.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:51.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836664 2026-02-17T05:03:51.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836664' 2026-02-17T05:03:51.038 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836664 2026-02-17T05:03:51.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:51.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836661 -lt 21474836664 2026-02-17T05:03:51.205 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:52.206 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:52.207 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:52.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836664 -lt 21474836664 2026-02-17T05:03:52.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:52.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673143 2026-02-17T05:03:52.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:52.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:52.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673143 2026-02-17T05:03:52.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:52.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673143 2026-02-17T05:03:52.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673143' 2026-02-17T05:03:52.377 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673143 2026-02-17T05:03:52.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:52.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673143 -lt 42949673143 2026-02-17T05:03:52.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:52.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542324 2026-02-17T05:03:52.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:52.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:52.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542324 2026-02-17T05:03:52.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:52.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542324 2026-02-17T05:03:52.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542324' 2026-02-17T05:03:52.545 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542324 2026-02-17T05:03:52.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:52.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542324 -lt 60129542324 2026-02-17T05:03:52.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:52.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:52.714 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:52.870 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:52.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:52.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:53.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:53.042 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:53.042 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:53.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:53.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:53.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:53.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836667 2026-02-17T05:03:53.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836667 2026-02-17T05:03:53.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667' 2026-02-17T05:03:53.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:53.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:53.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673146 2026-02-17T05:03:53.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673146 2026-02-17T05:03:53.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667 1-42949673146' 2026-02-17T05:03:53.159 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:53.159 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542327 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542327 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667 1-42949673146 2-60129542327' 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836667 2026-02-17T05:03:53.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:53.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:53.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836667 2026-02-17T05:03:53.219 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:53.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836667 2026-02-17T05:03:53.220 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836667 2026-02-17T05:03:53.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836667' 2026-02-17T05:03:53.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:53.383 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836664 -lt 21474836667 2026-02-17T05:03:53.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:54.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:54.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:54.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836667 -lt 21474836667 2026-02-17T05:03:54.553 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:54.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673146 2026-02-17T05:03:54.553 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:54.554 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:54.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673146 2026-02-17T05:03:54.555 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:54.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673146 2026-02-17T05:03:54.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673146' 2026-02-17T05:03:54.557 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673146 2026-02-17T05:03:54.557 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:54.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673146 -lt 42949673146 2026-02-17T05:03:54.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:54.723 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542327 2026-02-17T05:03:54.724 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:54.725 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:54.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542327 2026-02-17T05:03:54.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:54.727 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542327 2026-02-17T05:03:54.727 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542327 2026-02-17T05:03:54.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542327' 2026-02-17T05:03:54.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:54.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542327 -lt 60129542327 2026-02-17T05:03:54.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:54.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:54.892 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:55.046 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:55.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:55.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:55.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:55.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:55.055 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:55.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:55.221 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:55.221 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:55.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:55.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:55.222 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:55.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836670 2026-02-17T05:03:55.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836670 2026-02-17T05:03:55.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670' 2026-02-17T05:03:55.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:55.280 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:55.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673149 2026-02-17T05:03:55.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673149 2026-02-17T05:03:55.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670 1-42949673149' 2026-02-17T05:03:55.337 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:55.338 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:55.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542330 2026-02-17T05:03:55.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542330 2026-02-17T05:03:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670 1-42949673149 2-60129542330' 2026-02-17T05:03:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:55.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836670 2026-02-17T05:03:55.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:55.395 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:55.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836670 2026-02-17T05:03:55.396 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:55.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836670 2026-02-17T05:03:55.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836670' 2026-02-17T05:03:55.397 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836670 2026-02-17T05:03:55.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:55.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836667 -lt 21474836670 2026-02-17T05:03:55.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:56.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:56.564 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:56.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836670 -lt 21474836670 2026-02-17T05:03:56.728 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:56.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673149 2026-02-17T05:03:56.728 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:56.729 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:56.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673149 2026-02-17T05:03:56.730 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:56.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673149 2026-02-17T05:03:56.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673149' 2026-02-17T05:03:56.731 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673149 2026-02-17T05:03:56.731 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:56.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673149 -lt 42949673149 2026-02-17T05:03:56.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:56.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542330 2026-02-17T05:03:56.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:56.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:56.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542330 2026-02-17T05:03:56.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:56.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542330 2026-02-17T05:03:56.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542330' 2026-02-17T05:03:56.900 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542330 2026-02-17T05:03:56.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:57.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542330 -lt 60129542330 2026-02-17T05:03:57.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:03:57.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:03:57.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:03:57.225 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:03:57.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:03:57.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:03:57.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:03:57.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:03:57.234 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:57.397 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:03:57.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836673 2026-02-17T05:03:57.456 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836673 2026-02-17T05:03:57.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673' 2026-02-17T05:03:57.457 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:57.457 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:03:57.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673152 2026-02-17T05:03:57.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673152 2026-02-17T05:03:57.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673 1-42949673152' 2026-02-17T05:03:57.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:03:57.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542333 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542333 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673 1-42949673152 2-60129542333' 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836673 2026-02-17T05:03:57.574 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:57.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:03:57.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836673 2026-02-17T05:03:57.576 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:57.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836673 2026-02-17T05:03:57.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836673' 2026-02-17T05:03:57.577 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836673 2026-02-17T05:03:57.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:03:57.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836673 -lt 21474836673 2026-02-17T05:03:57.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:57.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673152 2026-02-17T05:03:57.742 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:57.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:03:57.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673152 2026-02-17T05:03:57.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:57.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673152 2026-02-17T05:03:57.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673152' 2026-02-17T05:03:57.745 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673152 2026-02-17T05:03:57.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:03:57.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673152 -lt 42949673152 2026-02-17T05:03:57.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:03:57.912 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542333 2026-02-17T05:03:57.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:03:57.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:03:57.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542333 2026-02-17T05:03:57.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:03:57.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542333 2026-02-17T05:03:57.915 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542333 2026-02-17T05:03:57.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542333' 2026-02-17T05:03:57.916 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:58.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542332 -lt 60129542333 2026-02-17T05:03:58.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:03:59.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:03:59.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:03:59.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542332 -lt 60129542333 2026-02-17T05:03:59.249 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:04:00.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:04:00.250 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:04:00.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542335 -lt 60129542333 2026-02-17T05:04:00.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:04:00.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:04:00.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:04:00.571 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:04:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:04:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:04:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:04:00.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:04:00.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:00.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:04:00.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836678 2026-02-17T05:04:00.806 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836678 2026-02-17T05:04:00.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678' 2026-02-17T05:04:00.807 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:00.807 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:04:00.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673157 2026-02-17T05:04:00.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673157 2026-02-17T05:04:00.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678 1-42949673157' 2026-02-17T05:04:00.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:00.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:04:00.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542337 2026-02-17T05:04:00.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542337 2026-02-17T05:04:00.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678 1-42949673157 2-60129542337' 2026-02-17T05:04:00.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:00.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836678 2026-02-17T05:04:00.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:00.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:04:00.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836678 2026-02-17T05:04:00.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:00.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836678 2026-02-17T05:04:00.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836678' 2026-02-17T05:04:00.924 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836678 2026-02-17T05:04:00.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:01.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836675 -lt 21474836678 2026-02-17T05:04:01.090 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:04:02.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:04:02.091 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:02.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836678 -lt 21474836678 2026-02-17T05:04:02.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:02.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673157 2026-02-17T05:04:02.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:02.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:04:02.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673157 2026-02-17T05:04:02.258 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:02.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673157 2026-02-17T05:04:02.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673157' 2026-02-17T05:04:02.259 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673157 2026-02-17T05:04:02.259 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:04:02.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673157 -lt 42949673157 2026-02-17T05:04:02.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:02.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542337 2026-02-17T05:04:02.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:02.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:04:02.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542337 2026-02-17T05:04:02.426 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:02.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542337 2026-02-17T05:04:02.427 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542337' 2026-02-17T05:04:02.428 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542337 2026-02-17T05:04:02.428 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:04:02.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542338 -lt 60129542337 2026-02-17T05:04:02.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:04:02.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:04:02.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:04:02.754 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:04:02.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:04:02.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:04:02.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:04:02.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:04:02.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:04:02.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:04:02.928 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:04:02.928 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:04:02.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:04:02.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:02.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:04:02.988 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836681 2026-02-17T05:04:02.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836681 2026-02-17T05:04:02.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836681' 2026-02-17T05:04:02.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:02.989 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:04:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673160 2026-02-17T05:04:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673160 2026-02-17T05:04:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836681 1-42949673160' 2026-02-17T05:04:03.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:03.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:04:03.104 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542341 2026-02-17T05:04:03.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542341 2026-02-17T05:04:03.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836681 1-42949673160 2-60129542341' 2026-02-17T05:04:03.105 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:03.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836681 2026-02-17T05:04:03.105 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:03.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:04:03.106 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836681 2026-02-17T05:04:03.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:03.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836681 2026-02-17T05:04:03.108 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836681' 2026-02-17T05:04:03.108 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836681 2026-02-17T05:04:03.108 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:03.271 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836678 -lt 21474836681 2026-02-17T05:04:03.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:04:04.272 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:04:04.273 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:04.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836681 -lt 21474836681 2026-02-17T05:04:04.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:04.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673160 2026-02-17T05:04:04.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:04.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:04:04.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673160 2026-02-17T05:04:04.440 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673160 2026-02-17T05:04:04.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673160' 2026-02-17T05:04:04.441 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673160 2026-02-17T05:04:04.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:04:04.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673160 -lt 42949673160 2026-02-17T05:04:04.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:04.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542341 2026-02-17T05:04:04.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:04.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:04:04.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542341 2026-02-17T05:04:04.608 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:04.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542341 2026-02-17T05:04:04.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542341' 2026-02-17T05:04:04.610 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542341 2026-02-17T05:04:04.610 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:04:04.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542341 -lt 60129542341 2026-02-17T05:04:04.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:04:04.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:04:04.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:04:04.931 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:04:04.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-17T05:04:04.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-17T05:04:04.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-17T05:04:04.939 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:04:04.939 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:04:05.106 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:04:05.106 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:04:05.107 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:04:05.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:04:05.107 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:05.107 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:04:05.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836684 2026-02-17T05:04:05.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836684 2026-02-17T05:04:05.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836684' 2026-02-17T05:04:05.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:05.166 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:04:05.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673163 2026-02-17T05:04:05.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673163 2026-02-17T05:04:05.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836684 1-42949673163' 2026-02-17T05:04:05.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:04:05.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542344 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542344 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836684 1-42949673163 2-60129542344' 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836684 2026-02-17T05:04:05.281 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:05.282 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:04:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836684 2026-02-17T05:04:05.283 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:05.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836684 2026-02-17T05:04:05.284 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836684' 2026-02-17T05:04:05.284 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836684 2026-02-17T05:04:05.285 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836681 -lt 21474836684 2026-02-17T05:04:05.452 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:04:06.453 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:04:06.453 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:04:06.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836684 -lt 21474836684 2026-02-17T05:04:06.623 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:06.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673163 2026-02-17T05:04:06.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:06.624 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:04:06.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673163 2026-02-17T05:04:06.625 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:06.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673163 2026-02-17T05:04:06.626 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949673163 2026-02-17T05:04:06.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673163' 2026-02-17T05:04:06.627 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:04:06.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673163 -lt 42949673163 2026-02-17T05:04:06.792 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:04:06.792 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542344 2026-02-17T05:04:06.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:04:06.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:04:06.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542344 2026-02-17T05:04:06.794 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:04:06.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542344 2026-02-17T05:04:06.795 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542344' 2026-02-17T05:04:06.796 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542344 2026-02-17T05:04:06.796 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:04:06.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542344 -lt 60129542344 2026-02-17T05:04:06.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-17T05:04:06.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-17T05:04:06.960 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-17T05:04:07.119 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:04:07.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:378: _scrub_abort: break 2026-02-17T05:04:07.128 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:380: _scrub_abort: set +o pipefail 2026-02-17T05:04:07.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:382: _scrub_abort: sleep 5 2026-02-17T05:04:12.129 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:384: _scrub_abort: grep 'noscrub set, aborting' td/osd-scrub-test/osd.1.log 2026-02-17T05:04:12.140 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:02:08.395+0000 7ff196589640 10 osd.1 pg_epoch: 18 pg[1.0( v 17'1000 (0'0,17'1000] local-lis/les=15/16 n=1000 ec=15/15 lis/c=15/15 les/c/f=16/16/0 sis=15) [1,0,2] r=0 lpr=15 crt=17'1000 lcod 17'999 mlcod 17'999 active+clean+scrubbing(periodic-regular)] scrubber: noscrub set, aborting 2026-02-17T05:04:12.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: get_last_scrub_stamp 1.0 2026-02-17T05:04:12.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:12.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:12.141 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:12.142 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:12.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: local last_scrub=2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:12.304 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:391: _scrub_abort: ceph config set osd osd_scrub_sleep 0.1 2026-02-17T05:04:12.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:393: _scrub_abort: ceph osd unset noscrub 2026-02-17T05:04:12.661 INFO:tasks.workunit.client.0.trial090.stderr:noscrub is unset 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:394: _scrub_abort: '[' scrub = deep-scrub ']' 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:398: _scrub_abort: TIMEOUT=500 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:399: _scrub_abort: wait_for_scrub 1.0 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:12.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:12.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:12.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:12.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:12.673 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:12.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:12.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:13.838 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:13.839 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:13.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:13.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:13.839 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:13.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:13.840 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:14.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:14.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:15.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:15.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:15.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:15.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:15.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:15.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:15.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:15.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:15.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:16.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:16.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:16.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:16.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:16.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:16.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:16.177 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:16.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:16.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:17.343 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:17.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:17.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:17.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:17.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:17.344 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:17.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:17.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:18.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:18.510 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:18.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:18.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:18.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:18.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:18.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:18.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:18.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:19.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:19.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:19.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:19.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:19.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:19.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:19.677 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:19.842 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:19.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:20.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:20.843 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:20.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:20.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:20.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:20.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:20.844 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:21.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:21.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:22.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:22.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:22.011 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:22.182 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:23.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:23.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:23.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:23.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:23.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:23.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:23.184 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:23.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:24.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:24.351 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:24.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:24.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:24.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:24.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:24.352 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:24.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:24.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:25.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:25.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:25.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:25.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:25.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:25.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:25.517 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:25.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:25.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:26.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:26.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:26.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:26.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:26.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:26.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:26.689 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:26.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:26.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:27.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:27.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:27.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:27.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:27.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:27.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:27.856 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:28.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:29.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:29.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:29.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:29.025 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:29.187 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:30.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:30.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:30.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:30.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:30.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:30.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:30.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:30.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:30.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:31.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:31.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:31.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:31.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:31.358 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:31.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:31.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:31.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:31.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:32.525 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:32.526 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:32.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:32.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:32.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:32.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:32.527 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:32.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:32.692 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:33.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:33.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:33.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:33.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:33.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:33.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:33.696 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:33.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:33.860 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:34.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:34.861 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:34.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:34.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:34.862 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:34.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:34.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:35.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:35.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:36.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:36.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:36.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:36.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:36.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:37.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:37.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:37.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:37.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:37.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:37.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:37.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:37.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:37.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:38.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:38.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:38.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:38.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:38.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:38.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:38.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:38.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:39.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:39.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:39.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:39.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:39.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:39.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:39.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:39.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:40.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:40.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:40.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:40.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:40.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:40.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:40.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:40.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:41.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:41.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:41.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:41.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:41.869 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:41.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:41.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:42.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:42.032 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:43.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:43.033 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:43.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:43.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:43.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:43.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:43.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:43.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:43.200 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:44.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:44.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:44.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:44.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:44.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:44.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:44.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:44.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:44.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:45.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:45.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:45.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:45.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:45.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:45.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:45.369 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:45.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:45.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:46.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:46.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:46.534 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:46.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:47.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:47.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:47.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:47.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:47.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:47.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:47.708 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:47.870 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:47.871 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:48.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:48.872 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:48.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:48.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:48.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:48.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:48.873 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:49.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:49.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:50.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:50.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:50.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:50.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:50.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:50.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:50.038 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:50.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:50.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:51.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:51.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:51.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:51.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:51.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:51.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:51.214 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:51.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:51.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:52.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:52.385 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:52.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:52.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:52.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:52.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:52.386 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:52.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:52.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:53.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:53.550 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:53.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:53.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:53.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:53.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:53.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:53.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:53.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:54.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:54.717 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:54.718 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:54.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:54.884 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:55.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:55.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:55.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:55.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:55.885 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:55.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:55.886 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:56.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:56.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:57.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:57.050 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:57.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:57.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:57.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:57.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:57.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:57.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:57.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:58.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:58.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:58.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:58.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:58.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:58.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:58.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:58.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:58.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:04:59.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:04:59.390 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:04:59.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:04:59.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:04:59.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:04:59.391 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:04:59.392 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:04:59.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:04:59.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:00.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:00.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:00.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:00.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:00.558 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:00.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:00.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:00.723 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:01.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:01.724 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:01.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:01.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:01.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:01.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:01.725 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:01.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:01.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:02.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:02.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:02.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:02.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:02.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:02.896 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:02.897 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:03.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:03.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:04.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:04.063 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:04.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:04.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:05.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:05.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:05.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:05.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:05.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:05.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:05.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:05.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:05.393 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:06.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:06.394 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:06.394 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:06.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:06.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:06.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:06.395 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:06.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:06.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:07.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:07.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:07.732 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:08.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:08.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:08.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:08.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:08.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:08.895 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:08.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:09.896 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:09.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:09.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:09.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:09.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:09.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:09.898 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:10.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:10.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:11.063 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:11.064 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:11.064 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:11.065 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:11.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:11.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:12.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:12.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:12.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:12.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:12.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:12.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:12.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:12.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:12.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:13.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:13.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:13.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:13.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:13.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:13.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:13.401 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:13.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:13.566 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:14.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:14.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:14.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:14.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:14.731 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:15.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:15.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:15.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:15.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:15.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:15.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:15.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:15.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:16.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:16.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:16.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:16.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:16.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:16.902 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:17.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:17.065 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:18.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:18.066 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:18.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:18.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:18.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:18.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:18.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:18.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:18.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:19.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:19.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:19.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:19.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:19.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:19.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:19.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:19.406 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:19.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:20.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:20.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:20.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:20.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:20.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:20.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:20.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:20.573 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:20.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:21.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:21.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:21.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:22.740 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:22.741 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:22.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:22.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:23.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:23.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:23.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:23.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:23.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:23.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:23.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:24.072 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:24.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:25.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:25.073 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:25.074 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:25.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:25.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:26.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:26.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:26.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:26.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:26.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:26.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:26.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:26.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:26.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:27.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:27.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:27.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:27.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:27.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:27.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:27.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:27.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:27.577 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:28.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:28.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:28.579 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:28.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:28.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:28.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:28.580 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:28.741 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:28.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:29.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:29.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:29.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:29.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:29.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:29.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:29.743 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:29.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:29.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:30.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:30.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:30.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:30.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:30.910 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:30.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:30.911 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:31.079 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:32.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:32.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:32.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:32.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:32.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:32.247 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:33.248 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:33.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:33.248 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:33.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:33.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:33.249 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:33.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:33.413 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:34.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:34.414 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:34.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:34.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:34.414 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:34.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:34.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:34.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:34.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:35.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:35.581 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:35.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:35.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:35.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:35.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:35.582 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:35.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:36.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:36.747 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:36.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:36.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:36.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:36.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:36.748 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:36.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:36.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:37.913 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:37.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:37.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:37.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:37.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:37.914 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:38.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:39.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:39.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:39.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:39.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:39.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:39.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:39.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:39.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:39.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:40.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:40.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:40.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:40.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:40.255 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:40.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:40.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:40.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:40.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:41.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:41.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:41.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:41.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:41.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:41.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:41.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:41.588 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:41.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:42.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:42.589 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:42.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:42.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:42.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:42.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:42.590 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:42.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:42.754 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:43.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:43.755 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:43.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:43.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:43.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:43.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:43.756 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:43.919 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:43.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:44.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:44.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:44.921 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:44.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:44.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:44.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:44.922 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:45.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-15T05:02:02.560118+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:45.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:05:46.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:05:46.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:05:46.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:05:46.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:46.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:46.086 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:46.087 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:46.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:05:43.399576+0000 '>' 2026-02-15T05:02:02.560118+0000 2026-02-17T05:05:46.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T05:05:46.253 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:400: _scrub_abort: perf_counters td/osd-scrub-test 3 2026-02-17T05:05:46.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:05:46.254 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T05:05:46.254 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T05:05:46.254 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T05:05:46.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:46.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:05:46.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.311 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.312 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.313 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:05:46.314 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:05:46.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:46.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:05:46.315 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:05:46.369 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.370 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.371 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.372 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.373 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.374 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.375 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 11, 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.376 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.377 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.377 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:05:46.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:05:46.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:46.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T05:05:46.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:05:46.427 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.428 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.429 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.430 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.431 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:05:46.432 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:05:46.433 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:05:46.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_abort ------------------' 2026-02-17T05:05:46.434 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_scrub_abort ------------------ 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:05:46.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:05:46.437 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:05:46.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:05:46.536 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:05:46.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:05:46.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:05:46.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:05:46.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:05:46.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:05:46.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:05:46.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:05:46.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:05:46.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:05:46.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:05:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:05:46.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:05:46.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:05:46.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.596 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:05:46.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:05:46.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:05:46.597 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_abort ------------------' 2026-02-17T05:05:46.597 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_scrub_abort ------------------ 2026-02-17T05:05:46.598 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T05:05:46.598 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_scrub_permit_time ------------------- 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_permit_time -------------------' 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:05:46.600 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:05:46.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:05:46.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:05:46.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:05:46.601 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:05:46.601 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:05:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:05:46.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:05:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:05:46.602 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:05:46.602 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:05:46.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:05:46.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:05:46.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:05:46.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:05:46.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:05:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:05:46.605 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:05:46.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:05:46.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.606 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.606 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:05:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:05:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:05:46.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:05:46.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:05:46.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.609 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:05:46.611 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:05:46.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:05:46.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:05:46.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:05:46.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_permit_time -----------------------' 2026-02-17T05:05:46.612 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_scrub_permit_time ----------------------- 2026-02-17T05:05:46.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_permit_time td/osd-scrub-test 2026-02-17T05:05:46.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:414: TEST_scrub_permit_time: local dir=td/osd-scrub-test 2026-02-17T05:05:46.613 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:415: TEST_scrub_permit_time: local poolname=test 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:416: TEST_scrub_permit_time: local OSDS=3 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:417: TEST_scrub_permit_time: local objects=15 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:419: TEST_scrub_permit_time: TESTDATA=testdata.897552 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:421: TEST_scrub_permit_time: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T05:05:46.614 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.630 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.631 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:46.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T05:05:46.653 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:05:46.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:05:46.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:05:46.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:05:46.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:05:46.655 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:05:46.656 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:05:46.656 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:05:46.656 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:05:46.657 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:05:46.702 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:05:46.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T05:05:46.744 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:422: TEST_scrub_permit_time: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T05:05:46.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:05:46.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:05:46.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:05:46.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:05:46.828 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:05:46.828 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.828 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.828 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:46.829 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:05:46.829 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T05:05:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: date -d '2 hour ago' +%H 2026-02-17T05:05:46.843 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: sed 's/^0//' 2026-02-17T05:05:46.844 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: local scrub_begin_hour=3 2026-02-17T05:05:46.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: date -d '1 hour ago' +%H 2026-02-17T05:05:46.845 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: sed 's/^0//' 2026-02-17T05:05:46.846 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: local scrub_end_hour=4 2026-02-17T05:05:46.847 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: expr 3 - 1 2026-02-17T05:05:46.848 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: seq 0 2 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 0 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:05:46.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:05:46.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:05:46.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4' 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T05:05:46.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:05:46.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=947d8290-39b0-494b-92e6-336df543a6b8 2026-02-17T05:05:46.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 947d8290-39b0-494b-92e6-336df543a6b8' 2026-02-17T05:05:46.856 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 947d8290-39b0-494b-92e6-336df543a6b8 2026-02-17T05:05:46.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:05:46.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAq95NpnvpWMxAAZqIcwjaWEBRb2Ar4NubI0Q== 2026-02-17T05:05:46.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAq95NpnvpWMxAAZqIcwjaWEBRb2Ar4NubI0Q=="}' 2026-02-17T05:05:46.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 947d8290-39b0-494b-92e6-336df543a6b8 -i td/osd-scrub-test/0/new.json 2026-02-17T05:05:46.942 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:05:46.950 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T05:05:46.951 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 --mkfs --key AQAq95NpnvpWMxAAZqIcwjaWEBRb2Ar4NubI0Q== --osd-uuid 947d8290-39b0-494b-92e6-336df543a6b8 2026-02-17T05:05:46.967 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:46.966+0000 7f6123a17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:46.968 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:46.967+0000 7f6123a17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:46.969 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:46.968+0000 7f6123a17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:46.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:46.968+0000 7f6123a17780 -1 bdev(0x3902c00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:05:46.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:46.968+0000 7f6123a17780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T05:05:47.399 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T05:05:47.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:05:47.400 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:05:47.400 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:05:47.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:05:47.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:05:47.484 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:05:47.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:47.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:05:47.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:05:47.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:05:47.499 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:47.498+0000 7f7f419d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:47.501 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:47.499+0000 7f7f419d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:47.502 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:47.500+0000 7f7f419d6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:47.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:05:47.649 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:05:47.755 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:47.754+0000 7f7f419d6780 -1 Falling back to public interface 2026-02-17T05:05:48.169 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:48.167+0000 7f7f419d6780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:05:48.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:05:48.650 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:48.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:05:48.651 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:05:48.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:48.651 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:05:48.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:05:49.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:05:49.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:49.735 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:05:49.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T05:05:49.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:49.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:05:49.901 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1032095059,v1:127.0.0.1:6801/1032095059] [v2:127.0.0.1:6802/1032095059,v1:127.0.0.1:6803/1032095059] exists,up 947d8290-39b0-494b-92e6-336df543a6b8 2026-02-17T05:05:49.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:05:49.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:05:49.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:05:49.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:49.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 1 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T05:05:49.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:05:49.907 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4' 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:05:49.908 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7b63552f-4dc4-4ac5-986d-32703c0465c9 2026-02-17T05:05:49.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 7b63552f-4dc4-4ac5-986d-32703c0465c9' 2026-02-17T05:05:49.909 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 7b63552f-4dc4-4ac5-986d-32703c0465c9 2026-02-17T05:05:49.909 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:05:49.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAt95Np81RuNhAAjXNxTSTAQ/kf/1wDnbLsfQ== 2026-02-17T05:05:49.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAt95Np81RuNhAAjXNxTSTAQ/kf/1wDnbLsfQ=="}' 2026-02-17T05:05:49.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7b63552f-4dc4-4ac5-986d-32703c0465c9 -i td/osd-scrub-test/1/new.json 2026-02-17T05:05:50.074 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:05:50.083 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T05:05:50.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 --mkfs --key AQAt95Np81RuNhAAjXNxTSTAQ/kf/1wDnbLsfQ== --osd-uuid 7b63552f-4dc4-4ac5-986d-32703c0465c9 2026-02-17T05:05:50.100 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.098+0000 7fb26bc0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.101 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.100+0000 7fb26bc0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.102 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.101+0000 7fb26bc0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.102 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.101+0000 7fb26bc0b780 -1 bdev(0x276ec00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:05:50.103 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.101+0000 7fb26bc0b780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T05:05:50.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T05:05:50.422 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:05:50.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:05:50.423 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:05:50.423 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:05:50.642 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:05:50.643 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:05:50.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:50.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:05:50.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:05:50.643 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:05:50.658 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.656+0000 7fabd2e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.659 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.658+0000 7fabd2e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.660 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.658+0000 7fabd2e23780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:50.784 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:50.782+0000 7fabd2e23780 -1 Falling back to public interface 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:50.811 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:05:50.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:05:50.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:50.812 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:05:50.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:05:51.096 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:51.095+0000 7fabd2e23780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:05:51.979 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:05:51.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:51.980 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:05:51.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:05:51.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:51.980 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:05:52.145 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3612958257,v1:127.0.0.1:6811/3612958257] [v2:127.0.0.1:6812/3612958257,v1:127.0.0.1:6813/3612958257] exists,up 7b63552f-4dc4-4ac5-986d-32703c0465c9 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 2 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:05:52.147 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:05:52.148 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4' 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T05:05:52.149 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:05:52.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b3dfcf56-2296-433b-91de-0ff4e8029966 2026-02-17T05:05:52.150 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b3dfcf56-2296-433b-91de-0ff4e8029966' 2026-02-17T05:05:52.150 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 b3dfcf56-2296-433b-91de-0ff4e8029966 2026-02-17T05:05:52.150 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:05:52.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAw95NpQMZrCRAA38nfDWZXG9hMcKqlblVg9g== 2026-02-17T05:05:52.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAw95NpQMZrCRAA38nfDWZXG9hMcKqlblVg9g=="}' 2026-02-17T05:05:52.158 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b3dfcf56-2296-433b-91de-0ff4e8029966 -i td/osd-scrub-test/2/new.json 2026-02-17T05:05:52.322 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:05:52.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T05:05:52.332 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 --mkfs --key AQAw95NpQMZrCRAA38nfDWZXG9hMcKqlblVg9g== --osd-uuid b3dfcf56-2296-433b-91de-0ff4e8029966 2026-02-17T05:05:52.348 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.347+0000 7f176a832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:52.349 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.348+0000 7f176a832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:52.350 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.349+0000 7f176a832780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:52.350 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.349+0000 7f176a832780 -1 bdev(0x3beec00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:05:52.351 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.350+0000 7f176a832780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T05:05:52.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T05:05:52.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:05:52.675 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:05:52.676 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:05:52.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:05:52.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:05:52.885 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:05:52.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=3 --osd_scrub_end_hour=4 2026-02-17T05:05:52.885 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:05:52.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:05:52.886 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:05:52.900 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.899+0000 7ffb66e3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:52.901 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.900+0000 7ffb66e3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:52.902 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:52.901+0000 7ffb66e3f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:05:53.052 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:05:53.053 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:05:53.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:53.054 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:05:53.080 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:53.079+0000 7ffb66e3f780 -1 Falling back to public interface 2026-02-17T05:05:53.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:05:53.366 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:05:53.364+0000 7ffb66e3f780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:05:54.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:05:54.218 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:05:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:05:54.219 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:05:54.219 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:05:54.220 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:05:54.386 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3260053329,v1:127.0.0.1:6819/3260053329] [v2:127.0.0.1:6820/3260053329,v1:127.0.0.1:6821/3260053329] exists,up b3dfcf56-2296-433b-91de-0ff4e8029966 2026-02-17T05:05:54.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:05:54.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:05:54.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:05:54.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:435: TEST_scrub_permit_time: create_pool test 1 1 2026-02-17T05:05:54.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:05:54.601 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T05:05:54.610 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:05:55.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:436: TEST_scrub_permit_time: wait_for_clean 2026-02-17T05:05:55.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:05:55.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:05:55.611 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:05:55.612 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:05:55.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:05:55.613 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:05:55.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:05:55.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:05:55.613 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:05:55.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:05:55.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:05:55.864 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:05:55.864 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:05:55.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:05:55.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:05:55.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:05:55.922 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-17T05:05:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-17T05:05:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-17T05:05:55.923 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:05:55.923 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:05:55.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T05:05:55.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T05:05:55.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966' 2026-02-17T05:05:55.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:05:55.982 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966 2-64424509443' 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-17T05:05:56.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:05:56.042 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:05:56.042 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-17T05:05:56.043 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:05:56.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-17T05:05:56.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-17T05:05:56.044 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836488 2026-02-17T05:05:56.044 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:05:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-17T05:05:56.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:05:57.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:05:57.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:05:57.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836488 2026-02-17T05:05:57.373 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:05:57.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T05:05:57.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:05:57.374 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:05:57.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T05:05:57.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:05:57.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T05:05:57.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T05:05:57.377 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672966 2026-02-17T05:05:57.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:05:57.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672966 2026-02-17T05:05:57.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:05:57.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-17T05:05:57.545 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:05:57.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:05:57.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-17T05:05:57.547 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:05:57.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-17T05:05:57.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-17T05:05:57.549 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 64424509443 2026-02-17T05:05:57.549 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:05:57.719 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509443 2026-02-17T05:05:57.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:05:57.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:05:57.720 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:05:57.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:05:57.929 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:05:57.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:05:57.929 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:05:57.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:05:57.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:05:57.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:05:57.930 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:05:58.091 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:05:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:05:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:05:58.092 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:439: TEST_scrub_permit_time: get_pg test SOMETHING 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T05:05:58.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-17T05:05:58.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test SOMETHING 2026-02-17T05:05:58.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T05:05:58.468 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:439: TEST_scrub_permit_time: local pgid=1.0 2026-02-17T05:05:58.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:440: TEST_scrub_permit_time: get_primary test SOMETHING 2026-02-17T05:05:58.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T05:05:58.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-17T05:05:58.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test SOMETHING 2026-02-17T05:05:58.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:440: TEST_scrub_permit_time: local primary=1 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:441: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:58.637 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:58.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:441: TEST_scrub_permit_time: local last_scrub=2026-02-17T05:05:54.600429+0000 2026-02-17T05:05:58.803 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:446: TEST_scrub_permit_time: ceph tell 1.0 schedule-scrub 86400 2026-02-17T05:05:58.859 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:05:58.859 INFO:tasks.workunit.client.0.trial090.stdout: "deep": false, 2026-02-17T05:05:58.859 INFO:tasks.workunit.client.0.trial090.stdout: "must": false, 2026-02-17T05:05:58.859 INFO:tasks.workunit.client.0.trial090.stdout: "stamp": "2026-02-16T05:05:58.858736+0000" 2026-02-17T05:05:58.859 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:05:58.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i=0 )) 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:05:58.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:05:59.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-17T05:05:54.600429+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:05:59.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:00.029 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:00.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:00.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:00.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:00.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:00.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:00.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:00.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-17T05:05:54.600429+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:00.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:01.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:01.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:01.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:01.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:01.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:01.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:01.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:01.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:01.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:02.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:02.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:02.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:02.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:02.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:02.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:02.366 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:02.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:02.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:03.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:03.534 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:03.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:03.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:03.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:03.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:03.535 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:03.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:03.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:04.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:04.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:04.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:04.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:04.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:04.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:04.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:04.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:04.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:05.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:05.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:05.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:05.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:05.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:05.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:05.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:06.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:06.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:07.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:07.036 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:07.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:07.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:07.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:07.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:07.037 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:07.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:07.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:08.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:08.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:08.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:08.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:08.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:08.204 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:08.205 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:08.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:08.371 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:09.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:09.372 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:09.373 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:09.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:09.540 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:10.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:10.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:10.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:10.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:10.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:10.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:10.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:10.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:10.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:11.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:11.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:11.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:11.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:11.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:11.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:11.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:11.876 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:12.877 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:12.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:12.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:12.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:12.878 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:12.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:12.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:13.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:13.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:14.044 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:14.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:14.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:14.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:14.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:14.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:14.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:14.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:14.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:15.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:15.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:15.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:15.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:15.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:15.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:15.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:15.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:15.377 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:16.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:16.379 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:16.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:16.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:16.380 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:16.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:16.381 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:16.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:16.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:17.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:17.547 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:17.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:17.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:17.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:17.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:17.548 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:17.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:17.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:18.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:18.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:18.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:18.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:18.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:18.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:18.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:18.873 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:19.874 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:19.875 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:19.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:19.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:19.875 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:19.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:19.876 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:20.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:20.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:21.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:21.039 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:21.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:21.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:21.040 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:21.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:21.041 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:21.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:21.210 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:22.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:22.212 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:22.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:22.375 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:23.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:23.376 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:23.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:23.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:23.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:23.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:23.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:23.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:24.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:24.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:24.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:25.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:25.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:25.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:25.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:25.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:25.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:26.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:26.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:26.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:26.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:26.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:26.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:26.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:27.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:27.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:28.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:28.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:28.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:28.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:28.047 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:28.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:28.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:28.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:28.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:29.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:29.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:29.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:29.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:29.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:29.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:29.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:29.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:29.382 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:30.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:30.384 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:30.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:30.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:30.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:30.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:30.385 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:30.548 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:30.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:31.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:31.549 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:31.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:31.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:31.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:31.550 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:31.551 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:31.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:31.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:32.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:32.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:32.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-17T05:06:32.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:32.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:06:32.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:32.719 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:06:32.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-16T05:05:58.858736+0000 '>' 2026-02-17T05:05:54.600429+0000 2026-02-17T05:06:32.889 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-17T05:06:33.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-17T05:06:33.890 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-17T05:06:33.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:455: TEST_scrub_permit_time: perf_counters td/osd-scrub-test 3 2026-02-17T05:06:33.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:06:33.891 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T05:06:33.891 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T05:06:33.892 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T05:06:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:06:33.894 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:33.951 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:33.952 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:06:33.953 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:33.954 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:33.955 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:06:33.956 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:33.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:06:33.957 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.007 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:06:34.008 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:06:34.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:34.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T05:06:34.009 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.064 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:06:34.065 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:06:34.066 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_scrub_permit_time ------------------ 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_permit_time ------------------' 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:06:34.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:06:34.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:06:34.174 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:06:34.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:06:34.175 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:06:34.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:06:34.176 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:06:34.176 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:06:34.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:06:34.177 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:06:34.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:06:34.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:06:34.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:06:34.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:06:34.180 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:06:34.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:06:34.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.187 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:06:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:06:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:06:34.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_permit_time ------------------' 2026-02-17T05:06:34.188 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_scrub_permit_time ------------------ 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_test -------------------' 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Prepare Test TEST_scrub_test ------------------- 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:06:34.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:06:34.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:06:34.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:06:34.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:06:34.190 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:06:34.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:06:34.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:06:34.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:06:34.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:06:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:06:34.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:06:34.193 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:06:34.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:06:34.194 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:06:34.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:06:34.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:06:34.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:06:34.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:06:34.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:06:34.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:06:34.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.198 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:06:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:06:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:06:34.199 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-17T05:06:34.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:06:34.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.200 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.201 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.897552 2026-02-17T05:06:34.202 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:06:34.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T05:06:34.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:06:34.202 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-17T05:06:34.202 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Run Test TEST_scrub_test ----------------------- 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_test -----------------------' 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_test td/osd-scrub-test 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:52: TEST_scrub_test: local dir=td/osd-scrub-test 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:53: TEST_scrub_test: local poolname=test 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:54: TEST_scrub_test: local OSDS=3 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:55: TEST_scrub_test: local objects=15 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:57: TEST_scrub_test: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:06:34.203 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-17T05:06:34.204 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-17T05:06:34.220 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:34.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-17T05:06:34.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:06:34.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:06:34.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:06:34.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:06:34.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:06:34.246 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get fsid 2026-02-17T05:06:34.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:06:34.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:06:34.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:06:34.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:06:34.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:06:34.290 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.897552/ceph-mon.a.asok 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:06:34.291 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.897552/ceph-mon.a.asok config get mon_host 2026-02-17T05:06:34.334 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:58: TEST_scrub_test: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-17T05:06:34.335 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:06:34.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:34.418 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:06:34.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-17T05:06:34.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:59: TEST_scrub_test: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-17T05:06:34.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:60: TEST_scrub_test: ceph_osd_args+='--osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 ' 2026-02-17T05:06:34.434 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:61: TEST_scrub_test: ceph_osd_args+=--osd_stats_update_period_scrubbing=2 2026-02-17T05:06:34.435 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: expr 3 - 1 2026-02-17T05:06:34.435 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: seq 0 2 2026-02-17T05:06:34.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:06:34.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:34.441 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:06:34.442 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e6d305ad-b653-464a-8bcf-38b0438c5318 2026-02-17T05:06:34.443 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e6d305ad-b653-464a-8bcf-38b0438c5318' 2026-02-17T05:06:34.444 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 e6d305ad-b653-464a-8bcf-38b0438c5318 2026-02-17T05:06:34.444 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:06:34.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBa95NpItejGhAAs1juZKpLPI9Y/hbyf9Y8hA== 2026-02-17T05:06:34.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBa95NpItejGhAAs1juZKpLPI9Y/hbyf9Y8hA=="}' 2026-02-17T05:06:34.448 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e6d305ad-b653-464a-8bcf-38b0438c5318 -i td/osd-scrub-test/0/new.json 2026-02-17T05:06:34.526 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:06:34.531 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-17T05:06:34.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQBa95NpItejGhAAs1juZKpLPI9Y/hbyf9Y8hA== --osd-uuid e6d305ad-b653-464a-8bcf-38b0438c5318 2026-02-17T05:06:34.548 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:34.548+0000 7f70dc9dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:34.550 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:34.550+0000 7f70dc9dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:34.551 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:34.551+0000 7f70dc9dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:34.551 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:34.551+0000 7f70dc9dd780 -1 bdev(0x295ec00 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:06:34.551 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:34.551+0000 7f70dc9dd780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-17T05:06:34.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-17T05:06:34.975 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:06:34.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:06:34.976 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:06:34.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:06:35.056 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:06:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:06:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:06:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:06:35.057 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:06:35.073 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:35.073+0000 7fb2b6436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:35.075 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:35.075+0000 7fb2b6436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:35.076 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:35.076+0000 7fb2b6436780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:35.135 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:35.136 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:06:35.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:06:35.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:35.137 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:06:35.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:06:35.267 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:35.267+0000 7fb2b6436780 -1 Falling back to public interface 2026-02-17T05:06:35.612 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:35.611+0000 7fb2b6436780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:06:36.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:06:36.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:36.215 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:06:36.215 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:06:36.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:36.216 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:06:36.293 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/689972974,v1:127.0.0.1:6801/689972974] [v2:127.0.0.1:6802/689972974,v1:127.0.0.1:6803/689972974] exists,up e6d305ad-b653-464a-8bcf-38b0438c5318 2026-02-17T05:06:36.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:06:36.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:06:36.299 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:06:36.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6c538ec4-407c-41ad-93ab-efe25d21cb53 2026-02-17T05:06:36.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6c538ec4-407c-41ad-93ab-efe25d21cb53' 2026-02-17T05:06:36.302 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 6c538ec4-407c-41ad-93ab-efe25d21cb53 2026-02-17T05:06:36.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:06:36.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBc95NpEHEvEhAAQdNJxZirA1qkceCPEapWTg== 2026-02-17T05:06:36.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBc95NpEHEvEhAAQdNJxZirA1qkceCPEapWTg=="}' 2026-02-17T05:06:36.306 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6c538ec4-407c-41ad-93ab-efe25d21cb53 -i td/osd-scrub-test/1/new.json 2026-02-17T05:06:36.382 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:06:36.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-17T05:06:36.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQBc95NpEHEvEhAAQdNJxZirA1qkceCPEapWTg== --osd-uuid 6c538ec4-407c-41ad-93ab-efe25d21cb53 2026-02-17T05:06:36.405 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:36.405+0000 7f5830448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:36.407 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:36.406+0000 7f5830448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:36.407 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:36.407+0000 7f5830448780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:36.408 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:36.408+0000 7f5830448780 -1 bdev(0x284ec00 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:06:36.408 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:36.408+0000 7f5830448780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-17T05:06:36.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-17T05:06:36.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:06:36.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:06:36.788 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:06:36.788 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:06:37.007 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:06:37.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:06:37.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:37.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:06:37.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:06:37.008 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:06:37.023 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:37.022+0000 7f206c1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:37.024 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:37.024+0000 7f206c1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:37.025 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:37.024+0000 7f206c1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:37.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:06:37.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:06:37.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:06:37.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:06:37.173 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:06:37.174 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:06:37.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:37.174 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:06:37.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:37.175 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:06:37.212 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:37.210+0000 7f206c1fd780 -1 Falling back to public interface 2026-02-17T05:06:37.340 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:06:37.498 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:37.497+0000 7f206c1fd780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:06:38.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:06:38.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:38.341 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:06:38.341 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:06:38.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:38.342 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:06:38.505 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3872706077,v1:127.0.0.1:6811/3872706077] [v2:127.0.0.1:6812/3872706077,v1:127.0.0.1:6813/3872706077] exists,up 6c538ec4-407c-41ad-93ab-efe25d21cb53 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 2 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T05:06:38.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:38.507 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T05:06:38.508 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:06:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 2026-02-17T05:06:38.509 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 2026-02-17T05:06:38.509 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1' 2026-02-17T05:06:38.509 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:06:38.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBe95NprsjTHhAAOOoB+d807/51tZb6QkkAPg== 2026-02-17T05:06:38.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBe95NprsjTHhAAOOoB+d807/51tZb6QkkAPg=="}' 2026-02-17T05:06:38.517 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 -i td/osd-scrub-test/2/new.json 2026-02-17T05:06:38.679 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:06:38.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-17T05:06:38.689 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQBe95NprsjTHhAAOOoB+d807/51tZb6QkkAPg== --osd-uuid 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 2026-02-17T05:06:38.705 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:38.704+0000 7f0560fd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:38.707 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:38.705+0000 7f0560fd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:38.707 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:38.706+0000 7f0560fd8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:38.708 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:38.707+0000 7f0560fd8780 -1 bdev(0x4376c00 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:06:38.708 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:38.707+0000 7f0560fd8780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-17T05:06:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-17T05:06:39.046 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:06:39.047 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:06:39.048 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:06:39.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:06:39.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:06:39.259 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:06:39.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:39.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:06:39.259 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:06:39.260 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:06:39.275 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:39.274+0000 7f0384887780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:39.277 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:39.275+0000 7f0384887780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:39.277 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:39.276+0000 7f0384887780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:39.413 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:39.412+0000 7f0384887780 -1 Falling back to public interface 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:39.425 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:06:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:06:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:39.426 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:06:39.591 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:06:39.713 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:39.712+0000 7f0384887780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:40.592 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:06:40.760 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4258907452,v1:127.0.0.1:6819/4258907452] [v2:127.0.0.1:6820/4258907452,v1:127.0.0.1:6821/4258907452] exists,up 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 2026-02-17T05:06:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:06:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:06:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:06:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:68: TEST_scrub_test: create_pool test 1 1 2026-02-17T05:06:40.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T05:06:40.972 INFO:tasks.workunit.client.0.trial090.stderr:pool 'test' created 2026-02-17T05:06:40.981 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T05:06:41.982 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:69: TEST_scrub_test: wait_for_clean 2026-02-17T05:06:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:06:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:06:41.983 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:06:41.983 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:06:41.984 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:06:41.984 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:06:41.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:06:41.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:06:41.984 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:06:42.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:06:42.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:06:42.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:06:42.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:06:42.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:06:42.070 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:42.233 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:06:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:06:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:06:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:06:42.292 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:42.292 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:06:42.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T05:06:42.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T05:06:42.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T05:06:42.350 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:42.351 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-60129542147' 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:06:42.407 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:42.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:06:42.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:06:42.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:42.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:06:42.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:06:42.410 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836487 2026-02-17T05:06:42.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:06:42.574 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:06:42.575 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:42.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T05:06:42.575 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:42.576 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:06:42.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T05:06:42.577 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T05:06:42.578 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T05:06:42.578 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705669 2026-02-17T05:06:42.578 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:42.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T05:06:42.743 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:42.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:06:42.744 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:42.745 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:06:42.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:06:42.745 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:42.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:06:42.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:06:42.747 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:06:42.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:06:42.918 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:06:42.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:06:42.918 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:06:42.919 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:06:43.125 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:06:43.126 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:06:43.288 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:06:43.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:06:43.288 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:06:43.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:06:43.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:06:43.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:06:43.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:06:43.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: ceph osd dump 2026-02-17T05:06:43.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: grep '^pool.*['\'']test['\'']' 2026-02-17T05:06:43.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: awk '{ print $2 }' 2026-02-17T05:06:43.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: poolid=1 2026-02-17T05:06:43.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:72: TEST_scrub_test: file_with_random_data 1032 2026-02-17T05:06:43.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1032 2026-02-17T05:06:43.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:06:43.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.RyBjLuGZUj bs=1032 count=1 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 6.6494e-05 s, 15.5 MB/s 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:72: TEST_scrub_test: local testdata_file=/tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.662 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: seq 1 15 2026-02-17T05:06:43.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj1 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.679 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj2 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj3 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj4 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.726 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj5 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.742 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj6 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.757 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj7 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.772 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj8 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.787 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj9 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj10 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.817 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.818 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj11 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj12 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.848 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj13 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.863 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj14 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-17T05:06:43.878 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj15 /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.893 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:77: TEST_scrub_test: rm -f /tmp/tmp.RyBjLuGZUj 2026-02-17T05:06:43.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:79: TEST_scrub_test: get_primary test obj1 2026-02-17T05:06:43.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T05:06:43.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T05:06:43.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T05:06:43.895 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T05:06:44.059 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:79: TEST_scrub_test: local primary=1 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:80: TEST_scrub_test: get_not_primary test obj1 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-17T05:06:44.060 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-17T05:06:44.061 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-17T05:06:44.061 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T05:06:44.227 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-17T05:06:44.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-17T05:06:44.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-17T05:06:44.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:80: TEST_scrub_test: local otherosd=0 2026-02-17T05:06:44.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:81: TEST_scrub_test: '[' 0 = 2 ']' 2026-02-17T05:06:44.398 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:85: TEST_scrub_test: local anotherosd=2 2026-02-17T05:06:44.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:88: TEST_scrub_test: file_with_random_data 512 2026-02-17T05:06:44.398 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T05:06:44.399 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T05:06:44.399 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.ifcv4b8S1M bs=512 count=1 2026-02-17T05:06:44.400 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records in 2026-02-17T05:06:44.400 INFO:tasks.workunit.client.0.trial090.stderr:1+0 records out 2026-02-17T05:06:44.400 INFO:tasks.workunit.client.0.trial090.stderr:512 bytes copied, 5.8438e-05 s, 8.8 MB/s 2026-02-17T05:06:44.400 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:88: TEST_scrub_test: local corrupt_data_file=/tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:89: TEST_scrub_test: objectstore_tool td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-test 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-test 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:06:44.401 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-test TERM osd.2 2026-02-17T05:06:44.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:06:44.402 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:06:44.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:06:44.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:06:44.402 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-test 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-test/2 2026-02-17T05:06:44.507 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-test/2 obj1 set-bytes /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-test 2 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-test 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-test/2 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-17T05:06:44.659 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' 2026-02-17T05:06:44.660 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-test/2 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=db4d2075-d75b-4fbc-9e27-26050550734a --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.897552/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-17T05:06:44.661 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-test/2/whoami 2026-02-17T05:06:44.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:06:44.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:06:44.662 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:06:44.663 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:06:44.676 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:44.674+0000 7f85b4822780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:44.677 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:44.676+0000 7f85b4822780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:44.678 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:44.677+0000 7f85b4822780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:06:44.801 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:44.800+0000 7f85b4822780 -1 Falling back to public interface 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:06:44.833 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:06:44.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:44.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:06:44.998 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:06:45.135 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:06:45.134+0000 7f85b4822780 -1 osd.2 17 log_to_monitors true 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:06:45.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:06:46.163 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 21 up_thru 0 down_at 18 last_clean_interval [14,17) [v2:127.0.0.1:6818/953691675,v1:127.0.0.1:6819/953691675] [v2:127.0.0.1:6820/953691675,v1:127.0.0.1:6821/953691675] exists,up 9c5d4dbb-1da8-4acb-aa1a-c099bc696ef1 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:06:46.164 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:06:46.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:06:46.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:06:46.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:06:46.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:06:46.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:06:46.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:06:46.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:06:46.250 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:06:46.251 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:46.415 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:06:46.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T05:06:46.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T05:06:46.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T05:06:46.477 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:46.478 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:06:46.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T05:06:46.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T05:06:46.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674' 2026-02-17T05:06:46.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:46.537 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:06:46.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313219 2026-02-17T05:06:46.593 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313219 2026-02-17T05:06:46.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-38654705674 2-90194313219' 2026-02-17T05:06:46.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:46.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T05:06:46.594 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:46.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:06:46.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T05:06:46.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:46.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T05:06:46.596 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T05:06:46.596 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836492 2026-02-17T05:06:46.597 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:06:46.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T05:06:46.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:46.761 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T05:06:46.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:46.763 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:06:46.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T05:06:46.763 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:46.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T05:06:46.764 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T05:06:46.764 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 38654705674 2026-02-17T05:06:46.765 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:46.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705674 2026-02-17T05:06:46.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:06:47.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:06:47.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:48.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705674 2026-02-17T05:06:48.097 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:06:49.098 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:06:49.099 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705674 2026-02-17T05:06:49.264 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:49.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313219 2026-02-17T05:06:49.264 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:49.265 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:06:49.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313219 2026-02-17T05:06:49.266 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:49.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313219 2026-02-17T05:06:49.267 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313219' 2026-02-17T05:06:49.267 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 90194313219 2026-02-17T05:06:49.267 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:06:49.432 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313221 -lt 90194313219 2026-02-17T05:06:49.432 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:06:49.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:06:49.433 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:06:49.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:06:49.640 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:06:49.641 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:06:49.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:06:49.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:06:49.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:06:49.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:06:50.010 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:90: TEST_scrub_test: rm -f /tmp/tmp.ifcv4b8S1M 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:92: TEST_scrub_test: local pgid=1.0 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:93: TEST_scrub_test: pg_deep_scrub 1.0 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=1.0 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 1.0 2026-02-17T05:06:50.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:06:50.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:06:50.221 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:06:50.387 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:06:50.388 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:06:50.388 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:06:50.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:06:50.388 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:50.388 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:06:50.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-17T05:06:50.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-17T05:06:50.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-17T05:06:50.447 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:50.447 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:06:50.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705679 2026-02-17T05:06:50.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705679 2026-02-17T05:06:50.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705679' 2026-02-17T05:06:50.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:50.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:06:50.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313224 2026-02-17T05:06:50.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313224 2026-02-17T05:06:50.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705679 2-90194313224' 2026-02-17T05:06:50.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:50.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836497 2026-02-17T05:06:50.565 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:50.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:06:50.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-17T05:06:50.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:50.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-17T05:06:50.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-17T05:06:50.568 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836497 2026-02-17T05:06:50.568 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:06:50.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836497 2026-02-17T05:06:50.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:50.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705679 2026-02-17T05:06:50.736 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:50.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:06:50.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705679 2026-02-17T05:06:50.737 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:50.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705679 2026-02-17T05:06:50.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705679' 2026-02-17T05:06:50.739 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705679 2026-02-17T05:06:50.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:50.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705679 2026-02-17T05:06:50.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:06:51.902 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:06:51.903 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:52.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705679 2026-02-17T05:06:52.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:06:53.070 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:06:53.071 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:53.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705681 -lt 38654705679 2026-02-17T05:06:53.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:53.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313224 2026-02-17T05:06:53.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:53.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:06:53.239 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313224 2026-02-17T05:06:53.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:53.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313224 2026-02-17T05:06:53.241 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313224' 2026-02-17T05:06:53.242 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313224 2026-02-17T05:06:53.242 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:06:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313226 -lt 90194313224 2026-02-17T05:06:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T05:06:53.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T05:06:53.410 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T05:06:53.410 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T05:06:53.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T05:06:53.411 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T05:06:53.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T05:06:53.411 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:06:53.469 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:53.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:06:53.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:53.470 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:06:53.631 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:53.632 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 1.0 2026-02-17T05:06:53.788 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2026-02-17T05:06:53.797 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 1.0 2026-02-17T05:06:40.971837+0000 last_deep_scrub_stamp 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:06:53.798 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:53.799 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:06:53.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:40.971837+0000 '>' 2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:53.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:06:54.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:06:54.964 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:06:54.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:06:54.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:54.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:06:54.965 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:54.966 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:06:55.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:40.971837+0000 '>' 2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:55.132 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:06:56.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:06:56.133 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:06:56.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:06:56.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:56.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:06:56.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:56.135 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:06:56.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:40.971837+0000 '>' 2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:56.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:06:57.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:06:57.299 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:06:57.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:06:57.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:06:57.300 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:06:57.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:06:57.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:06:57.470 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:54.731347+0000 '>' 2026-02-17T05:06:40.971837+0000 2026-02-17T05:06:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T05:06:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: ceph pg dump pgs 2026-02-17T05:06:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: grep '^1.0' 2026-02-17T05:06:57.471 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: grep -q -- +inconsistent 2026-02-17T05:06:57.625 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:06:57.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:06:57.634 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-17T05:06:57.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: test 2 = 2 2026-02-17T05:06:57.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:98: TEST_scrub_test: ceph osd out 1 2026-02-17T05:06:57.911 INFO:tasks.workunit.client.0.trial090.stderr:marked out osd.1. 2026-02-17T05:06:57.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:99: TEST_scrub_test: wait_for_clean 2026-02-17T05:06:57.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:06:57.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:06:57.924 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:06:57.924 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:06:57.925 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:06:57.925 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:06:57.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:06:57.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:06:57.925 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:06:58.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:06:58.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:06:58.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:06:58.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:06:58.011 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:06:58.012 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:06:58.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:06:58.178 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:06:58.179 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:06:58.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:06:58.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:58.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:06:58.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-17T05:06:58.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-17T05:06:58.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-17T05:06:58.238 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:58.238 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:06:58.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705688 2026-02-17T05:06:58.297 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705688 2026-02-17T05:06:58.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688' 2026-02-17T05:06:58.298 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:06:58.298 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:06:58.353 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313233 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313233 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-38654705688 2-90194313233' 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836506 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:58.354 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:06:58.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-17T05:06:58.355 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-17T05:06:58.356 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-17T05:06:58.357 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836506 2026-02-17T05:06:58.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:06:58.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836506 2026-02-17T05:06:58.520 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:06:59.521 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:06:59.522 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:06:59.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-17T05:06:59.693 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:59.693 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705688 2026-02-17T05:06:59.694 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:59.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:06:59.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705688 2026-02-17T05:06:59.695 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:59.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705688 2026-02-17T05:06:59.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705688' 2026-02-17T05:06:59.696 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705688 2026-02-17T05:06:59.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:06:59.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705688 -lt 38654705688 2026-02-17T05:06:59.862 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:06:59.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313233 2026-02-17T05:06:59.863 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:06:59.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:06:59.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313233 2026-02-17T05:06:59.864 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:06:59.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313233 2026-02-17T05:06:59.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313233' 2026-02-17T05:06:59.866 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313233 2026-02-17T05:06:59.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313233 -lt 90194313233 2026-02-17T05:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:00.034 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:00.035 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:00.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:00.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:00.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:00.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:00.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:00.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:00.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:00.245 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:00.408 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:00.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:00.408 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:00.409 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:00.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:00.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:00.620 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:101: TEST_scrub_test: pg_deep_scrub 1.0 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=1.0 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 1.0 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:00.621 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:07:00.835 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:01.001 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:01.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-17T05:07:01.061 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-17T05:07:01.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-17T05:07:01.062 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:01.062 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705692 2026-02-17T05:07:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705692 2026-02-17T05:07:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705692' 2026-02-17T05:07:01.119 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:01.120 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:01.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313237 2026-02-17T05:07:01.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313237 2026-02-17T05:07:01.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705692 2-90194313237' 2026-02-17T05:07:01.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:01.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-17T05:07:01.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:01.179 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:01.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-17T05:07:01.180 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-17T05:07:01.181 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-17T05:07:01.181 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836510 2026-02-17T05:07:01.182 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:01.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-17T05:07:01.344 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:02.345 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:07:02.346 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:02.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-17T05:07:02.515 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:03.516 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:07:03.516 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:03.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836510 2026-02-17T05:07:03.684 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:03.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705692 2026-02-17T05:07:03.684 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:03.686 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:03.686 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705692 2026-02-17T05:07:03.687 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:03.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705692 2026-02-17T05:07:03.688 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705692' 2026-02-17T05:07:03.688 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705692 2026-02-17T05:07:03.688 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:03.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705693 -lt 38654705692 2026-02-17T05:07:03.855 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:03.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313237 2026-02-17T05:07:03.855 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:03.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:03.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313237 2026-02-17T05:07:03.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:03.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313237 2026-02-17T05:07:03.858 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313237' 2026-02-17T05:07:03.858 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313237 2026-02-17T05:07:03.858 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:04.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313238 -lt 90194313237 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stdout:#---------- 1.0 loop 0 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-17T05:07:04.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-17T05:07:04.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+remapped 2026-02-17T05:07:04.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+remapped == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-17T05:07:04.084 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:04.085 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:07:04.245 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-17T05:06:54.731347+0000 2026-02-17T05:07:04.246 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 1.0 2026-02-17T05:07:04.406 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.0 to deep-scrub 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 1.0 2026-02-17T05:06:54.731347+0000 last_deep_scrub_stamp 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T05:06:54.731347+0000 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T05:07:04.415 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:04.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:07:04.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:04.416 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:07:04.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:04.417 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:07:04.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:54.731347+0000 '>' 2026-02-17T05:06:54.731347+0000 2026-02-17T05:07:04.579 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:07:05.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:07:05.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:05.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:07:05.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:05.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:07:05.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:05.581 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:07:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:06:54.731347+0000 '>' 2026-02-17T05:06:54.731347+0000 2026-02-17T05:07:05.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:07:06.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:07:06.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:06.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-17T05:07:06.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:06.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-17T05:07:06.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:06.747 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-17T05:07:06.914 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:07:05.360492+0000 '>' 2026-02-17T05:06:54.731347+0000 2026-02-17T05:07:06.915 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T05:07:06.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:06.915 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-17T05:07:06.976 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: test 2 = 2 2026-02-17T05:07:06.976 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:06.977 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-17T05:07:07.034 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: test 2 = 2 2026-02-17T05:07:07.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: ceph pg dump pgs 2026-02-17T05:07:07.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: grep '^1.0' 2026-02-17T05:07:07.035 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: grep -q -- +inconsistent 2026-02-17T05:07:07.189 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:07:07.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:107: TEST_scrub_test: ceph osd in 1 2026-02-17T05:07:07.410 INFO:tasks.workunit.client.0.trial090.stderr:marked in osd.1. 2026-02-17T05:07:07.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:108: TEST_scrub_test: wait_for_clean 2026-02-17T05:07:07.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:07.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:07.419 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:07.419 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:07.420 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:07.420 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:07.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:07.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:07.420 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:07:07.506 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:07.676 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:07.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836518 2026-02-17T05:07:07.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836518 2026-02-17T05:07:07.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518' 2026-02-17T05:07:07.735 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:07.735 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:07.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705700 2026-02-17T05:07:07.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705700 2026-02-17T05:07:07.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-38654705700' 2026-02-17T05:07:07.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:07.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313244 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313244 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-38654705700 2-90194313244' 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836518 2026-02-17T05:07:07.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:07.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:07.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836518 2026-02-17T05:07:07.852 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:07.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836518 2026-02-17T05:07:07.853 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836518' 2026-02-17T05:07:07.854 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836518 2026-02-17T05:07:07.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:08.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836518 2026-02-17T05:07:08.025 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:09.026 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:07:09.026 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:09.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836518 -lt 21474836518 2026-02-17T05:07:09.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:09.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705700 2026-02-17T05:07:09.196 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:09.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:09.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705700 2026-02-17T05:07:09.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:09.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705700 2026-02-17T05:07:09.198 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705700' 2026-02-17T05:07:09.198 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705700 2026-02-17T05:07:09.199 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:09.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705700 -lt 38654705700 2026-02-17T05:07:09.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:09.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313244 2026-02-17T05:07:09.361 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:09.362 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:09.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313244 2026-02-17T05:07:09.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:09.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313244 2026-02-17T05:07:09.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313244' 2026-02-17T05:07:09.364 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313244 2026-02-17T05:07:09.364 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:09.532 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313245 -lt 90194313244 2026-02-17T05:07:09.532 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:09.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:09.533 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:09.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:09.906 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:09.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:09.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:09.907 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:10.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:10.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:10.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:10.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:110: TEST_scrub_test: repair 1.0 2026-02-17T05:07:10.112 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-17T05:07:10.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-17T05:07:10.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:10.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:07:10.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:10.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:07:10.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:10.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-17T05:07:10.432 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:10.441 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:07:10.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:10.442 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:07:10.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:07:05.360492+0000 '>' 2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:10.603 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:07:11.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:07:11.604 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:11.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:07:11.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:11.604 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:07:11.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:11.605 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:07:11.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:07:05.360492+0000 '>' 2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:11.766 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-17T05:07:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-17T05:07:12.767 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-17T05:07:12.767 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-17T05:07:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-17T05:07:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-17T05:07:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-17T05:07:12.768 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-17T05:07:10.983125+0000 '>' 2026-02-17T05:07:05.360492+0000 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:111: TEST_scrub_test: wait_for_clean 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:12.932 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:12.933 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:12.933 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:12.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:12.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:12.933 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:07:13.023 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:13.185 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836524 2026-02-17T05:07:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836524 2026-02-17T05:07:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524' 2026-02-17T05:07:13.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:13.243 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:13.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705706 2026-02-17T05:07:13.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705706 2026-02-17T05:07:13.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524 1-38654705706' 2026-02-17T05:07:13.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:13.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:13.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313251 2026-02-17T05:07:13.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313251 2026-02-17T05:07:13.359 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836524 1-38654705706 2-90194313251' 2026-02-17T05:07:13.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:13.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836524 2026-02-17T05:07:13.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:13.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:13.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836524 2026-02-17T05:07:13.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:13.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836524 2026-02-17T05:07:13.363 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836524' 2026-02-17T05:07:13.363 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836524 2026-02-17T05:07:13.363 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:13.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836522 -lt 21474836524 2026-02-17T05:07:13.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:14.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:07:14.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:14.696 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836525 -lt 21474836524 2026-02-17T05:07:14.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:14.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705706 2026-02-17T05:07:14.697 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:14.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:14.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705706 2026-02-17T05:07:14.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:14.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705706 2026-02-17T05:07:14.699 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705706' 2026-02-17T05:07:14.699 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705706 2026-02-17T05:07:14.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:14.864 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705707 -lt 38654705706 2026-02-17T05:07:14.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:14.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313251 2026-02-17T05:07:14.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:14.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:14.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313251 2026-02-17T05:07:14.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:14.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313251 2026-02-17T05:07:14.868 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313251' 2026-02-17T05:07:14.868 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313251 2026-02-17T05:07:14.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:15.030 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313252 -lt 90194313251 2026-02-17T05:07:15.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:15.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:15.031 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:15.239 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:15.240 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:15.409 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:15.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:15.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:15.410 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:15.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:15.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:15.622 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:15.622 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:15.623 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-17T05:07:15.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: test 2 = 2 2026-02-17T05:07:15.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: ceph pg dump pgs 2026-02-17T05:07:15.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: grep '^1.0' 2026-02-17T05:07:15.682 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: grep -vq -- +inconsistent 2026-02-17T05:07:15.837 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:07:15.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:117: TEST_scrub_test: ceph osd out 1 2026-02-17T05:07:16.055 INFO:tasks.workunit.client.0.trial090.stderr:marked out osd.1. 2026-02-17T05:07:16.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:118: TEST_scrub_test: wait_for_clean 2026-02-17T05:07:16.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:16.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:16.067 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:16.067 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:16.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:16.068 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:16.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:16.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:16.068 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:16.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:16.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:16.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:16.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:16.156 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-17T05:07:16.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:16.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:16.321 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:16.321 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:16.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:16.321 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:16.322 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:16.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836528 2026-02-17T05:07:16.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836528 2026-02-17T05:07:16.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528' 2026-02-17T05:07:16.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:16.379 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:16.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705710 2026-02-17T05:07:16.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705710 2026-02-17T05:07:16.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528 1-38654705710' 2026-02-17T05:07:16.439 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:16.439 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=90194313255 2026-02-17T05:07:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 90194313255 2026-02-17T05:07:16.495 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528 1-38654705710 2-90194313255' 2026-02-17T05:07:16.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:16.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836528 2026-02-17T05:07:16.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:16.497 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:16.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836528 2026-02-17T05:07:16.498 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:16.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836528 2026-02-17T05:07:16.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2026-02-17T05:07:16.500 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836528 2026-02-17T05:07:16.500 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:16.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836528 -lt 21474836528 2026-02-17T05:07:16.665 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:16.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705710 2026-02-17T05:07:16.666 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:16.667 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:16.667 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705710 2026-02-17T05:07:16.668 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705710 2026-02-17T05:07:16.669 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705710' 2026-02-17T05:07:16.669 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 38654705710 2026-02-17T05:07:16.670 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:16.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705710 -lt 38654705710 2026-02-17T05:07:16.832 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:16.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-90194313255 2026-02-17T05:07:16.833 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:16.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:16.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-90194313255 2026-02-17T05:07:16.834 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:16.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=90194313255 2026-02-17T05:07:16.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 90194313255' 2026-02-17T05:07:16.836 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 90194313255 2026-02-17T05:07:16.836 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:16.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313254 -lt 90194313255 2026-02-17T05:07:16.999 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:18.000 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-17T05:07:18.000 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313254 -lt 90194313255 2026-02-17T05:07:18.164 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:19.165 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-17T05:07:19.165 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:19.331 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 90194313257 -lt 90194313255 2026-02-17T05:07:19.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:19.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:19.332 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:19.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:19.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:19.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:19.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:19.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:19.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:19.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:19.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:19.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:19.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:19.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:19.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:19.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:19.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:19.912 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:19.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:19.913 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-17T05:07:19.972 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: test 0 = 0 2026-02-17T05:07:19.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:19.973 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-17T05:07:20.028 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: test 0 = 0 2026-02-17T05:07:20.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: ceph pg 1.0 query 2026-02-17T05:07:20.029 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: jq '.peer_info[1].stats.stat_sum.num_scrub_errors' 2026-02-17T05:07:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: test 0 = 0 2026-02-17T05:07:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: ceph pg dump pgs 2026-02-17T05:07:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: grep '^1.0' 2026-02-17T05:07:20.086 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: grep -vq -- +inconsistent 2026-02-17T05:07:20.245 INFO:tasks.workunit.client.0.trial090.stderr:dumped pgs 2026-02-17T05:07:20.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:124: TEST_scrub_test: perf_counters td/osd-scrub-test 3 2026-02-17T05:07:20.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-17T05:07:20.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-17T05:07:20.256 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-17T05:07:20.257 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-17T05:07:20.257 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:07:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-17T05:07:20.258 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:07:20.314 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 2, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.315 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-17T05:07:20.316 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:07:20.372 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.373 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.374 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 6, 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.375 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.376 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:07:20.377 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:07:20.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-17T05:07:20.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-17T05:07:20.378 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-17T05:07:20.430 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:07:20.430 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_ec": [ 2026-02-17T05:07:20.430 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.431 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_dp_repl": [ 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "level": "deep", 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.432 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_ec": [ 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "ec" 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.433 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: ], 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "osd_scrub_sh_repl": [ 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: { 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "labels": { 2026-02-17T05:07:20.434 INFO:tasks.workunit.client.0.trial090.stdout: "level": "shallow", 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "pooltype": "replicated" 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: }, 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "counters": { 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "preemptions": 0, 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_selected": 0, 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "chunk_busy": 0, 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "locked_object": 0, 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: "write_blocked_by_scrub": 0 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: } 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout: ] 2026-02-17T05:07:20.435 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:07:20.436 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_test ------------------' 2026-02-17T05:07:20.436 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Teardown Test TEST_scrub_test ------------------ 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:20.438 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:20.538 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:20.539 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:07:20.539 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:07:20.540 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:07:20.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:07:20.541 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:07:20.541 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:07:20.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:07:20.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:07:20.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:07:20.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:07:20.544 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:07:20.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:07:20.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.556 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:07:20.556 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:07:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:07:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:07:20.557 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_test ------------------' 2026-02-17T05:07:20.557 INFO:tasks.workunit.client.0.trial090.stdout:-------------- Complete Test TEST_scrub_test ------------------ 2026-02-17T05:07:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:07:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-test 0 2026-02-17T05:07:20.558 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:20.559 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:20.560 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:07:20.560 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:07:20.561 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:07:20.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:07:20.562 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:07:20.562 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:07:20.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:07:20.563 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:07:20.563 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.564 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:07:20.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:07:20.565 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-17T05:07:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:07:20.566 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.567 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.897552 2026-02-17T05:07:20.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.897552 2026-02-17T05:07:20.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:07:20.567 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:07:20.568 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:07:20.569 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:07:20.569 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:07:20.635 INFO:tasks.workunit:Running workunit scrub/osd-unexpected-clone.sh... 2026-02-17T05:07:20.635 DEBUG:teuthology.orchestra.run.trial090:workunit test scrub/osd-unexpected-clone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=325850157d309f65985eea9ec9bb9f1d56726fee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh 2026-02-17T05:07:20.697 INFO:tasks.workunit.client.0.trial090.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T05:07:20.701 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-unexpected-clone 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:22: run: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:23: run: shift 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:25: run: export CEPH_MON=127.0.0.1:7144 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:25: run: CEPH_MON=127.0.0.1:7144 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:26: run: export CEPH_ARGS 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:27: run: uuidgen 2026-02-17T05:07:20.702 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:27: run: CEPH_ARGS+='--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none ' 2026-02-17T05:07:20.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:20.703 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:30: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-17T05:07:20.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: set 2026-02-17T05:07:20.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T05:07:20.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: local funcs=TEST_recover_unexpected 2026-02-17T05:07:20.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:32: run: for func in $funcs 2026-02-17T05:07:20.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:33: run: setup td/osd-unexpected-clone 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-unexpected-clone 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:20.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:20.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:20.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:07:20.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:07:20.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:07:20.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:07:20.707 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:07:20.707 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:07:20.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:07:20.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:07:20.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:07:20.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:07:20.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:07:20.710 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-17T05:07:20.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:07:20.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.711 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.711 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1039454 2026-02-17T05:07:20.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:07:20.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:07:20.712 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-unexpected-clone 2026-02-17T05:07:20.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T05:07:20.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.713 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.713 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.1039454 2026-02-17T05:07:20.714 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T05:07:20.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T05:07:20.715 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-unexpected-clone 1' TERM HUP INT 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:34: run: TEST_recover_unexpected td/osd-unexpected-clone 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:40: TEST_recover_unexpected: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:42: TEST_recover_unexpected: run_mon td/osd-unexpected-clone a 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-unexpected-clone/a 2026-02-17T05:07:20.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-unexpected-clone/a --run-dir=td/osd-unexpected-clone 2026-02-17T05:07:20.732 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:20.733 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-unexpected-clone/a '--log-file=td/osd-unexpected-clone/$name.log' '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --mon-cluster-log-file=td/osd-unexpected-clone/log --run-dir=td/osd-unexpected-clone '--pid-file=td/osd-unexpected-clone/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T05:07:20.756 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:07:20.758 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.1039454/ceph-mon.a.asok 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:07:20.759 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.1039454/ceph-mon.a.asok config get fsid 2026-02-17T05:07:20.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T05:07:20.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T05:07:20.802 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T05:07:20.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T05:07:20.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.1039454/ceph-mon.a.asok 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T05:07:20.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.1039454/ceph-mon.a.asok config get mon_host 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:43: TEST_recover_unexpected: run_mgr td/osd-unexpected-clone x 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-unexpected-clone/x 2026-02-17T05:07:20.845 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T05:07:20.926 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:20.927 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:07:20.928 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-unexpected-clone/x '--log-file=td/osd-unexpected-clone/$name.log' '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --run-dir=td/osd-unexpected-clone '--pid-file=td/osd-unexpected-clone/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:44: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 0 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/0 2026-02-17T05:07:20.945 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/0' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/0/journal' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:20.946 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:20.947 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/0 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:07:20.948 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3b7fc443-3983-4ec6-9f2c-4d266db5340f 2026-02-17T05:07:20.949 INFO:tasks.workunit.client.0.trial090.stdout:add osd0 3b7fc443-3983-4ec6-9f2c-4d266db5340f 2026-02-17T05:07:20.949 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 3b7fc443-3983-4ec6-9f2c-4d266db5340f' 2026-02-17T05:07:20.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:07:20.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCI95NpPQLQOBAA/FmiwzbIdWsBMLAV2q/xxg== 2026-02-17T05:07:20.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCI95NpPQLQOBAA/FmiwzbIdWsBMLAV2q/xxg=="}' 2026-02-17T05:07:20.954 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3b7fc443-3983-4ec6-9f2c-4d266db5340f -i td/osd-unexpected-clone/0/new.json 2026-02-17T05:07:21.030 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:07:21.037 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/0/new.json 2026-02-17T05:07:21.038 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/0 --osd-journal=td/osd-unexpected-clone/0/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCI95NpPQLQOBAA/FmiwzbIdWsBMLAV2q/xxg== --osd-uuid 3b7fc443-3983-4ec6-9f2c-4d266db5340f 2026-02-17T05:07:21.052 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.051+0000 7f503a873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.054 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.053+0000 7f503a873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.054 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.053+0000 7f503a873780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.055 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.054+0000 7f503a873780 -1 bdev(0x33e0c00 td/osd-unexpected-clone/0/block) open stat got: (1) Operation not permitted 2026-02-17T05:07:21.055 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.054+0000 7f503a873780 -1 bluestore(td/osd-unexpected-clone/0) _read_fsid unparsable uuid 2026-02-17T05:07:21.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/0/keyring 2026-02-17T05:07:21.499 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:07:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T05:07:21.500 INFO:tasks.workunit.client.0.trial090.stdout:adding osd0 key to auth repository 2026-02-17T05:07:21.500 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stdout:start osd.0 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/0 --osd-journal=td/osd-unexpected-clone/0/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:07:21.580 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:07:21.594 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.593+0000 7f4aee7fb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.596 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.595+0000 7f4aee7fb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.597 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.596+0000 7f4aee7fb780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:21.657 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:21.658 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:07:21.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:21.658 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:07:21.736 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:21.782 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:21.781+0000 7f4aee7fb780 -1 Falling back to public interface 2026-02-17T05:07:22.136 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.135+0000 7f4aee7fb780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:07:22.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:22.737 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:22.738 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:07:22.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:22.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:22.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T05:07:22.819 INFO:tasks.workunit.client.0.trial090.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3315713331,v1:127.0.0.1:6801/3315713331] [v2:127.0.0.1:6802/3315713331,v1:127.0.0.1:6803/3315713331] exists,up 3b7fc443-3983-4ec6-9f2c-4d266db5340f 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:45: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 1 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:22.823 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:07:22.824 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:07:22.825 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:22.826 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e1959dee-23ac-46ab-8eec-cd9fd6ec27de' 2026-02-17T05:07:22.827 INFO:tasks.workunit.client.0.trial090.stdout:add osd1 e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:22.827 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:07:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCK95NpzpaYMRAANrjMWTYqu98nMg53nACQJw== 2026-02-17T05:07:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCK95NpzpaYMRAANrjMWTYqu98nMg53nACQJw=="}' 2026-02-17T05:07:22.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e1959dee-23ac-46ab-8eec-cd9fd6ec27de -i td/osd-unexpected-clone/1/new.json 2026-02-17T05:07:22.914 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:07:22.920 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/1/new.json 2026-02-17T05:07:22.921 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCK95NpzpaYMRAANrjMWTYqu98nMg53nACQJw== --osd-uuid e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:22.936 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.936+0000 7f8bcba5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:22.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.936+0000 7f8bcba5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:22.938 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.937+0000 7f8bcba5f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:22.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.939+0000 7f8bcba5f780 -1 bdev(0x4324c00 td/osd-unexpected-clone/1/block) open stat got: (1) Operation not permitted 2026-02-17T05:07:22.939 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:22.939+0000 7f8bcba5f780 -1 bluestore(td/osd-unexpected-clone/1) _read_fsid unparsable uuid 2026-02-17T05:07:23.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/1/keyring 2026-02-17T05:07:23.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:07:23.289 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T05:07:23.290 INFO:tasks.workunit.client.0.trial090.stdout:adding osd1 key to auth repository 2026-02-17T05:07:23.290 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:07:23.505 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T05:07:23.505 INFO:tasks.workunit.client.0.trial090.stdout:start osd.1 2026-02-17T05:07:23.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:23.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:07:23.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:07:23.506 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:07:23.518 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:23.518+0000 7f9e7b80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:23.519 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:23.519+0000 7f9e7b80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:23.520 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:23.520+0000 7f9e7b80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:23.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T05:07:23.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:23.672 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:07:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:23.673 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:23.689 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:23.689+0000 7f9e7b80f780 -1 Falling back to public interface 2026-02-17T05:07:23.833 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:23.970 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:23.970+0000 7f9e7b80f780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:07:24.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:24.834 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:24.835 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:07:24.835 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:24.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:24.836 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:24.999 INFO:tasks.workunit.client.0.trial090.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1525104601,v1:127.0.0.1:6811/1525104601] [v2:127.0.0.1:6812/1525104601,v1:127.0.0.1:6813/1525104601] exists,up e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:25.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:25.003 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:46: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 2 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:25.004 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:25.005 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T05:07:25.006 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T05:07:25.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-17T05:07:25.007 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T05:07:25.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:25.007 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 bae65289-f8d8-4d74-9c19-31b07d8dc19a' 2026-02-17T05:07:25.007 INFO:tasks.workunit.client.0.trial090.stdout:add osd2 bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:25.008 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T05:07:25.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCN95Npt6u6ABAAcLEBRgi4RH9olZ1hYYbH8g== 2026-02-17T05:07:25.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCN95Npt6u6ABAAcLEBRgi4RH9olZ1hYYbH8g=="}' 2026-02-17T05:07:25.013 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bae65289-f8d8-4d74-9c19-31b07d8dc19a -i td/osd-unexpected-clone/2/new.json 2026-02-17T05:07:25.180 INFO:tasks.workunit.client.0.trial090.stdout:2 2026-02-17T05:07:25.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/2/new.json 2026-02-17T05:07:25.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCN95Npt6u6ABAAcLEBRgi4RH9olZ1hYYbH8g== --osd-uuid bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:25.203 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.203+0000 7f3df8e13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.205 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.204+0000 7f3df8e13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.205 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.205+0000 7f3df8e13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.206 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.206+0000 7f3df8e13780 -1 bdev(0x3334c00 td/osd-unexpected-clone/2/block) open stat got: (1) Operation not permitted 2026-02-17T05:07:25.206 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.206+0000 7f3df8e13780 -1 bluestore(td/osd-unexpected-clone/2) _read_fsid unparsable uuid 2026-02-17T05:07:25.535 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/2/keyring 2026-02-17T05:07:25.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T05:07:25.536 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T05:07:25.536 INFO:tasks.workunit.client.0.trial090.stdout:adding osd2 key to auth repository 2026-02-17T05:07:25.537 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T05:07:25.746 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T05:07:25.747 INFO:tasks.workunit.client.0.trial090.stdout:start osd.2 2026-02-17T05:07:25.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:25.748 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T05:07:25.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T05:07:25.749 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T05:07:25.760 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.759+0000 7fa261a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.761 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.761+0000 7fa261a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.762 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.762+0000 7fa261a12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:25.893 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:25.892+0000 7fa261a12780 -1 Falling back to public interface 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:25.909 INFO:tasks.workunit.client.0.trial090.stdout:0 2026-02-17T05:07:25.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:25.910 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:26.074 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:26.167 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:26.166+0000 7fa261a12780 -1 osd.2 0 log_to_monitors true 2026-02-17T05:07:27.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:27.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:27.077 INFO:tasks.workunit.client.0.trial090.stdout:1 2026-02-17T05:07:27.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:27.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:27.077 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:27.243 INFO:tasks.workunit.client.0.trial090.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/380942781,v1:127.0.0.1:6819/380942781] [v2:127.0.0.1:6820/380942781,v1:127.0.0.1:6821/380942781] exists,up bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:27.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:27.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:27.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:27.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:48: TEST_recover_unexpected: ceph osd pool create foo 1 2026-02-17T05:07:27.455 INFO:tasks.workunit.client.0.trial090.stderr:pool 'foo' created 2026-02-17T05:07:27.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:49: TEST_recover_unexpected: rados -p foo put foo /etc/passwd 2026-02-17T05:07:28.078 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:50: TEST_recover_unexpected: rados -p foo mksnap snap 2026-02-17T05:07:28.095 INFO:tasks.workunit.client.0.trial090.stdout:created pool foo snap snap 2026-02-17T05:07:28.096 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:51: TEST_recover_unexpected: rados -p foo put foo /etc/group 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:53: TEST_recover_unexpected: wait_for_clean 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:28.113 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:28.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:28.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:28.114 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:28.196 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:28.197 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:28.197 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:28.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:28.364 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:28.364 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:28.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:28.364 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:28.365 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-17T05:07:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-17T05:07:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-17T05:07:28.425 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:28.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:28.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-17T05:07:28.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-17T05:07:28.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-17T05:07:28.482 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:28.482 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:28.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T05:07:28.542 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T05:07:28.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542147' 2026-02-17T05:07:28.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:28.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-17T05:07:28.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:28.543 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:28.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-17T05:07:28.544 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:28.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-17T05:07:28.545 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-17T05:07:28.546 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.0 seq 21474836483 2026-02-17T05:07:28.546 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:28.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836483 2026-02-17T05:07:28.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:29.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:29.710 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:29.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-17T05:07:29.879 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:29.879 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-17T05:07:29.880 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:29.880 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:29.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-17T05:07:29.881 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-17T05:07:29.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-17T05:07:29.883 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.1 seq 42949672962 2026-02-17T05:07:29.883 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:30.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-17T05:07:30.048 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:30.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T05:07:30.048 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:30.049 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:30.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T05:07:30.050 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:30.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T05:07:30.051 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T05:07:30.051 INFO:tasks.workunit.client.0.trial090.stdout:waiting osd.2 seq 60129542147 2026-02-17T05:07:30.051 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:30.217 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T05:07:30.217 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:30.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:30.218 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:30.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:30.424 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:30.425 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:30.594 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:30.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:30.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:30.595 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:30.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:30.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:30.808 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:30.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:55: TEST_recover_unexpected: get_primary foo foo 2026-02-17T05:07:30.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=foo 2026-02-17T05:07:30.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=foo 2026-02-17T05:07:30.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map foo foo 2026-02-17T05:07:30.809 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-17T05:07:30.978 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:55: TEST_recover_unexpected: local osd=1 2026-02-17T05:07:30.979 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 1 --op list foo 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: grep snapid.:1 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 1 --op list foo 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.1 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:30.980 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 1 --op list foo 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/1 2026-02-17T05:07:31.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/1 --op list foo 2026-02-17T05:07:31.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 1 2026-02-17T05:07:31.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:31.374 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:31.375 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:31.376 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/1/whoami 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:07:31.377 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:07:31.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:07:31.378 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:07:31.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:31.386+0000 7f724d439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:31.387 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:31.387+0000 7f724d439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:31.388 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:31.388+0000 7f724d439780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:31.510 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:31.509+0000 7f724d439780 -1 Falling back to public interface 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:31.542 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:31.543 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:07:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:31.543 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:31.702 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:31.833 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:31.833+0000 7f724d439780 -1 osd.1 18 log_to_monitors true 2026-02-17T05:07:32.703 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:32.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:32.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:32.704 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:32.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:32.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:32.867 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 22 up_thru 22 down_at 19 last_clean_interval [10,18) [v2:127.0.0.1:6810/2425459862,v1:127.0.0.1:6811/2425459862] [v2:127.0.0.1:6812/2425459862,v1:127.0.0.1:6813/2425459862] exists,up e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:32.867 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:32.868 INFO:tasks.workunit.client.0.trial090.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:32.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:32.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:32.869 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:32.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:32.947 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:32.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:32.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:32.948 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:32.948 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:33.111 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:33.111 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:33.112 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:33.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:33.112 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:33.112 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:33.168 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-17T05:07:33.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-17T05:07:33.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-17T05:07:33.169 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:33.169 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:33.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280514 2026-02-17T05:07:33.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280514 2026-02-17T05:07:33.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-94489280514' 2026-02-17T05:07:33.225 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:33.225 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:33.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-17T05:07:33.286 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-17T05:07:33.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-94489280514 2-60129542149' 2026-02-17T05:07:33.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:33.287 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-17T05:07:33.287 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:33.287 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:33.288 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-17T05:07:33.288 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:33.289 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-17T05:07:33.290 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-17T05:07:33.290 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836485 2026-02-17T05:07:33.290 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:33.450 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T05:07:33.451 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:34.452 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:34.452 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:34.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-17T05:07:34.618 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:35.619 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T05:07:35.619 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:35.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-17T05:07:35.781 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:35.781 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-94489280514 2026-02-17T05:07:35.781 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:35.782 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:35.783 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-94489280514 2026-02-17T05:07:35.783 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:35.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280514 2026-02-17T05:07:35.784 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 94489280514' 2026-02-17T05:07:35.784 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 94489280514 2026-02-17T05:07:35.784 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:35.949 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280514 -lt 94489280514 2026-02-17T05:07:35.950 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:35.950 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-17T05:07:35.950 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:35.951 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:35.952 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-17T05:07:35.952 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:35.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-17T05:07:35.953 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-17T05:07:35.953 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542149 2026-02-17T05:07:35.953 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:36.119 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542149 2026-02-17T05:07:36.119 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:36.119 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:36.120 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:36.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:36.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:36.328 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:36.496 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:36.496 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:36.496 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:36.496 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:36.704 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:36.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:36.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:36.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: JSON='["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T05:07:36.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:58: TEST_recover_unexpected: echo 'JSON is ["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-17T05:07:36.706 INFO:tasks.workunit.client.0.trial090.stdout:JSON is ["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:59: TEST_recover_unexpected: rm -f td/osd-unexpected-clone/_ td/osd-unexpected-clone/data 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:60: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:07:36.708 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.1 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:36.709 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T05:07:36.813 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:07:36.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/1 2026-02-17T05:07:36.814 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-17T05:07:36.897 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 1 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:36.898 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:36.899 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-17T05:07:36.900 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:start osd.1 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/1/whoami 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:07:36.901 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:07:36.909 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:36.909+0000 7f873e611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:36.911 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:36.910+0000 7f873e611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:36.911 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:36.911+0000 7f873e611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:37.054 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:37.054+0000 7f873e611780 -1 Falling back to public interface 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:37.068 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:37.069 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:07:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:37.069 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:37.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:37.349 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:37.349+0000 7f873e611780 -1 osd.1 24 log_to_monitors true 2026-02-17T05:07:38.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:38.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:38.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:38.234 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:38.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:38.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T05:07:38.403 INFO:tasks.workunit.client.0.trial090.stderr:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 25 last_clean_interval [22,24) [v2:127.0.0.1:6810/3883365283,v1:127.0.0.1:6811/3883365283] [v2:127.0.0.1:6812/3883365283,v1:127.0.0.1:6813/3883365283] exists,up e1959dee-23ac-46ab-8eec-cd9fd6ec27de 2026-02-17T05:07:38.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:38.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:38.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:38.403 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:38.404 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:38.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:38.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:38.484 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:38.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:38.485 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:38.485 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:38.647 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T05:07:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T05:07:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T05:07:38.706 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:38.706 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:38.761 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-17T05:07:38.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-17T05:07:38.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-120259084290' 2026-02-17T05:07:38.762 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:38.762 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:38.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-17T05:07:38.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-17T05:07:38.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-120259084290 2-60129542151' 2026-02-17T05:07:38.819 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:38.819 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T05:07:38.820 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:38.821 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:38.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T05:07:38.821 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:38.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T05:07:38.822 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T05:07:38.822 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836487 2026-02-17T05:07:38.822 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T05:07:38.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:39.989 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:39.990 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:40.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T05:07:40.154 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:40.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-17T05:07:40.155 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:40.155 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:40.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-17T05:07:40.156 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:40.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-17T05:07:40.157 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-17T05:07:40.157 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084290 2026-02-17T05:07:40.157 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:40.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-17T05:07:40.325 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:40.325 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-17T05:07:40.326 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:40.326 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:40.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-17T05:07:40.327 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:40.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-17T05:07:40.328 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-17T05:07:40.328 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 60129542151 2026-02-17T05:07:40.328 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:40.496 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542151 2026-02-17T05:07:40.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:40.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:40.497 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:40.704 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:40.705 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:40.869 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:40.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:40.870 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:40.871 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:41.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:41.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:41.080 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:61: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-17T05:07:41.081 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:41.082 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:41.082 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:41.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:41.184 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:41.185 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:41.275 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:41.276 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:41.277 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:07:41.278 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:07:41.279 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:07:41.280 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:07:41.289 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:41.288+0000 7f1b7003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:41.290 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:41.290+0000 7f1b7003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:41.291 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:41.291+0000 7f1b7003b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:41.428 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:41.427+0000 7f1b7003b780 -1 Falling back to public interface 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:41.440 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:41.441 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:07:41.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:41.441 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:41.607 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:41.786 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:41.786+0000 7f1b7003b780 -1 osd.2 29 log_to_monitors true 2026-02-17T05:07:42.608 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:42.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:42.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:42.609 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:42.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:42.609 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:42.774 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [14,29) [v2:127.0.0.1:6818/1530326851,v1:127.0.0.1:6819/1530326851] [v2:127.0.0.1:6820/1530326851,v1:127.0.0.1:6821/1530326851] exists,up bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:42.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:42.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:42.774 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:42.775 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:42.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:42.856 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:42.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:42.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:42.857 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:42.857 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:43.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:43.017 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:43.017 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:43.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:43.017 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:43.018 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:43.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-17T05:07:43.075 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-17T05:07:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T05:07:43.076 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:43.076 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084292 2026-02-17T05:07:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084292 2026-02-17T05:07:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-120259084292' 2026-02-17T05:07:43.134 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:43.134 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:43.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-17T05:07:43.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-17T05:07:43.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489 1-120259084292 2-141733920770' 2026-02-17T05:07:43.192 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:43.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836489 2026-02-17T05:07:43.192 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:43.193 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:43.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-17T05:07:43.194 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:43.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836489 2026-02-17T05:07:43.195 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T05:07:43.195 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836489 2026-02-17T05:07:43.195 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:43.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-17T05:07:43.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:44.361 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:44.362 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:44.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-17T05:07:44.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:45.530 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T05:07:45.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:45.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T05:07:45.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:45.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084292 2026-02-17T05:07:45.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:45.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:45.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084292 2026-02-17T05:07:45.699 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:45.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084292 2026-02-17T05:07:45.700 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084292' 2026-02-17T05:07:45.700 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084292 2026-02-17T05:07:45.700 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:45.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084292 2026-02-17T05:07:45.865 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:45.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-141733920770 2026-02-17T05:07:45.865 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:45.866 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:45.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-141733920770 2026-02-17T05:07:45.866 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:45.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-17T05:07:45.867 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 141733920770' 2026-02-17T05:07:45.867 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 141733920770 2026-02-17T05:07:45.868 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:46.045 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920770 -lt 141733920770 2026-02-17T05:07:46.045 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:46.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:46.046 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:46.255 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:46.256 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:46.420 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:46.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:46.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:46.421 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:46.626 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:46.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:46.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:46.627 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:63: TEST_recover_unexpected: rados -p foo rmsnap snap 2026-02-17T05:07:46.692 INFO:tasks.workunit.client.0.trial090.stdout:removed pool foo snap snap 2026-02-17T05:07:46.694 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:65: TEST_recover_unexpected: sleep 5 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:67: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:51.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:51.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:51.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:51.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:51.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:51.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:07:51.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T05:07:51.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:07:51.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:51.805 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-17T05:07:51.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-17T05:07:51.933 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:51.934 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:51.935 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-17T05:07:51.936 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:07:51.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:07:51.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:07:51.937 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:07:51.949 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:51.948+0000 7f91e8429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:51.951 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:51.950+0000 7f91e8429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:51.952 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:51.951+0000 7f91e8429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:52.077 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:52.075+0000 7f91e8429780 -1 Falling back to public interface 2026-02-17T05:07:52.099 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:52.100 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:52.261 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:52.386 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:52.385+0000 7f91e8429780 -1 osd.2 35 log_to_monitors true 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:53.263 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 36 last_clean_interval [33,35) [v2:127.0.0.1:6818/2891573771,v1:127.0.0.1:6819/2891573771] [v2:127.0.0.1:6820/2891573771,v1:127.0.0.1:6821/2891573771] exists,up bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:53.430 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:53.431 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:53.511 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:53.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:53.671 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:53.671 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:53.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:53.671 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:53.672 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:53.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-17T05:07:53.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-17T05:07:53.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T05:07:53.734 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:53.734 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:53.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084295 2026-02-17T05:07:53.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084295 2026-02-17T05:07:53.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-120259084295' 2026-02-17T05:07:53.793 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:53.793 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-120259084295 2-167503724546' 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-17T05:07:53.851 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:53.852 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:53.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-17T05:07:53.853 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:53.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-17T05:07:53.854 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T05:07:53.854 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836492 2026-02-17T05:07:53.854 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-17T05:07:54.022 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:55.023 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:55.024 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:55.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T05:07:55.188 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:55.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084295 2026-02-17T05:07:55.189 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:55.189 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:55.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084295 2026-02-17T05:07:55.190 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084295 2026-02-17T05:07:55.191 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084295' 2026-02-17T05:07:55.191 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084295 2026-02-17T05:07:55.191 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:55.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084295 -lt 120259084295 2026-02-17T05:07:55.357 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:55.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724546 2026-02-17T05:07:55.357 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:55.358 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:55.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724546 2026-02-17T05:07:55.359 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:55.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-17T05:07:55.360 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724546' 2026-02-17T05:07:55.360 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 167503724546 2026-02-17T05:07:55.360 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:55.529 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-17T05:07:55.529 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:55.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:55.530 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:07:55.738 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:07:55.739 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:07:55.905 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:07:55.905 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:07:55.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:55.906 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:68: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-17T05:07:56.122 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:07:56.123 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:07:56.226 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:56.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-17T05:07:56.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-17T05:07:56.365 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-17T05:07:56.366 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' 2026-02-17T05:07:56.367 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:start osd.2 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=b2906732-06cb-4a5a-9907-6f28ce8ea7d0 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1039454/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T05:07:56.368 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-17T05:07:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T05:07:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T05:07:56.369 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T05:07:56.370 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T05:07:56.379 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:56.377+0000 7fd51cd3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:56.380 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:56.379+0000 7fd51cd3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:56.381 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:56.379+0000 7fd51cd3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:0 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:56.533 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:56.550 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:56.549+0000 7fd51cd3d780 -1 Falling back to public interface 2026-02-17T05:07:56.695 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T05:07:56.825 INFO:tasks.workunit.client.0.trial090.stderr:2026-02-17T05:07:56.824+0000 7fd51cd3d780 -1 osd.2 40 log_to_monitors true 2026-02-17T05:07:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T05:07:57.697 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T05:07:57.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T05:07:57.698 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:57.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T05:07:57.698 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:osd.2 up in weight 1 up_from 45 up_thru 0 down_at 42 last_clean_interval [39,40) [v2:127.0.0.1:6818/4284622357,v1:127.0.0.1:6819/4284622357] [v2:127.0.0.1:6820/4284622357,v1:127.0.0.1:6821/4284622357] exists,up bae65289-f8d8-4d74-9c19-31b07d8dc19a 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T05:07:57.881 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T05:07:57.882 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T05:07:57.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T05:07:57.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T05:07:57.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T05:07:57.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T05:07:57.962 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T05:07:57.963 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T05:07:58.126 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T05:07:58.126 INFO:tasks.workunit.client.0.trial090.stderr:1 2026-02-17T05:07:58.126 INFO:tasks.workunit.client.0.trial090.stderr:2' 2026-02-17T05:07:58.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T05:07:58.127 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:58.127 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T05:07:58.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-17T05:07:58.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-17T05:07:58.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-17T05:07:58.183 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:58.183 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T05:07:58.243 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084297 2026-02-17T05:07:58.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084297 2026-02-17T05:07:58.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-120259084297' 2026-02-17T05:07:58.244 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T05:07:58.244 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T05:07:58.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528322 2026-02-17T05:07:58.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528322 2026-02-17T05:07:58.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-120259084297 2-193273528322' 2026-02-17T05:07:58.300 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:58.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-17T05:07:58.301 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:58.301 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T05:07:58.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-17T05:07:58.302 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:58.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-17T05:07:58.303 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-17T05:07:58.303 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.0 seq 21474836494 2026-02-17T05:07:58.303 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:58.466 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836494 2026-02-17T05:07:58.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T05:07:59.467 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T05:07:59.468 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T05:07:59.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-17T05:07:59.633 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:59.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084297 2026-02-17T05:07:59.633 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:59.634 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T05:07:59.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084297 2026-02-17T05:07:59.635 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:59.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084297 2026-02-17T05:07:59.636 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084297' 2026-02-17T05:07:59.636 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.1 seq 120259084297 2026-02-17T05:07:59.636 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T05:07:59.800 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084297 -lt 120259084297 2026-02-17T05:07:59.801 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T05:07:59.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-193273528322 2026-02-17T05:07:59.801 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T05:07:59.802 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T05:07:59.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-193273528322 2026-02-17T05:07:59.803 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T05:07:59.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528322 2026-02-17T05:07:59.804 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 193273528322' 2026-02-17T05:07:59.804 INFO:tasks.workunit.client.0.trial090.stderr:waiting osd.2 seq 193273528322 2026-02-17T05:07:59.804 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T05:07:59.970 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528322 -lt 193273528322 2026-02-17T05:07:59.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T05:07:59.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:07:59.971 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T05:08:00.178 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T05:08:00.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T05:08:00.179 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T05:08:00.339 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T05:08:00.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T05:08:00.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T05:08:00.340 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T05:08:00.551 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T05:08:00.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T05:08:00.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T05:08:00.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:70: TEST_recover_unexpected: sleep 5 2026-02-17T05:08:05.552 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:72: TEST_recover_unexpected: ceph pg repair 1.0 2026-02-17T05:08:05.708 INFO:tasks.workunit.client.0.trial090.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-17T05:08:05.716 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:74: TEST_recover_unexpected: sleep 10 2026-02-17T05:08:15.718 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:76: TEST_recover_unexpected: ceph log last 2026-02-17T05:08:15.920 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319300+0000 osd.1 (osd.1) 2 : cluster [ERR] 1.0 shard 0 1:602f83fe:::foo:1 : missing 2026-02-17T05:08:15.920 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319302+0000 osd.1 (osd.1) 3 : cluster [ERR] 1.0 shard 1 1:602f83fe:::foo:1 : missing 2026-02-17T05:08:15.920 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319365+0000 osd.1 (osd.1) 4 : cluster [ERR] repair 1.0 1:602f83fe:::foo:1 : is an unexpected clone 2026-02-17T05:08:15.920 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319436+0000 osd.1 (osd.1) 5 : cluster [ERR] 1.0 repair 1 missing, 0 inconsistent objects 2026-02-17T05:08:15.920 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319442+0000 osd.1 (osd.1) 6 : cluster [ERR] 1.0 repair 1 missing, 0 inconsistent objects 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:06.319463+0000 osd.1 (osd.1) 7 : cluster [ERR] 1.0 repair 3 errors, 2 fixed 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292634+0000 osd.1 (osd.1) 9 : cluster [ERR] 1.0 shard 1 soid 1:602f83fe:::foo:1 : candidate size 0 info size 15112 mismatch 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292669+0000 osd.1 (osd.1) 10 : cluster [ERR] 1.0 shard 0 soid 1:602f83fe:::foo:1 : data_digest 0x5c5f475 != data_digest 0x8cc0971c from auth oi 1:602f83fe:::foo:1(18'2 client.4150.0:1 dirty|data_digest s 15112 uv 1 dd 8cc0971c alloc_hint [0 0 0]) 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292670+0000 osd.1 (osd.1) 11 : cluster [ERR] 1.0 shard 1 soid 1:602f83fe:::foo:1 : data_digest 0xffffffff != data_digest 0x5c5f475 from shard 0, data_digest 0xffffffff != data_digest 0x8cc0971c from auth oi 1:602f83fe:::foo:1(18'2 client.4150.0:1 dirty|data_digest s 15112 uv 1 dd 8cc0971c alloc_hint [0 0 0]), size 0 != size 15112 from auth oi 1:602f83fe:::foo:1(18'2 client.4150.0:1 dirty|data_digest s 15112 uv 1 dd 8cc0971c alloc_hint [0 0 0]), size 0 != size 15112 from shard 0 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292672+0000 osd.1 (osd.1) 12 : cluster [ERR] 1.0 soid 1:602f83fe:::foo:1 : data_digest 0x8cc0971c != data_digest 0x5c5f475 from shard 0 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292716+0000 osd.1 (osd.1) 13 : cluster [ERR] deep-scrub 1.0 1:602f83fe:::foo:1 : is an unexpected clone 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292805+0000 osd.1 (osd.1) 14 : cluster [ERR] 1.0 deep-scrub 0 missing, 1 inconsistent objects 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:07.292806+0000 osd.1 (osd.1) 15 : cluster [ERR] 1.0 deep-scrub 4 errors 2026-02-17T05:08:15.921 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:09.020374+0000 mon.a (mon.0) 235 : cluster [ERR] Health check failed: 4 scrub errors (OSD_SCRUB_ERRORS) 2026-02-17T05:08:15.922 INFO:tasks.workunit.client.0.trial090.stdout:2026-02-17T05:08:09.020398+0000 mon.a (mon.0) 236 : cluster [ERR] Health check failed: Possible data damage: 1 pg inconsistent (PG_DAMAGED) 2026-02-17T05:08:15.927 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:79: TEST_recover_unexpected: timeout 60 ceph tell osd.0 version 2026-02-17T05:08:15.980 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:08:15.980 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:08:15.980 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T05:08:15.980 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T05:08:15.980 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:08:15.984 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:80: TEST_recover_unexpected: timeout 60 ceph tell osd.1 version 2026-02-17T05:08:16.039 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:08:16.039 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:08:16.039 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T05:08:16.039 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T05:08:16.039 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:08:16.043 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:81: TEST_recover_unexpected: timeout 60 ceph tell osd.2 version 2026-02-17T05:08:16.096 INFO:tasks.workunit.client.0.trial090.stdout:{ 2026-02-17T05:08:16.096 INFO:tasks.workunit.client.0.trial090.stdout: "version": "20.3.0-5271-g32585015", 2026-02-17T05:08:16.096 INFO:tasks.workunit.client.0.trial090.stdout: "release": "tentacle", 2026-02-17T05:08:16.096 INFO:tasks.workunit.client.0.trial090.stdout: "release_type": "dev" 2026-02-17T05:08:16.096 INFO:tasks.workunit.client.0.trial090.stdout:} 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:35: run: teardown td/osd-unexpected-clone 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:08:16.101 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:08:16.208 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:08:16.208 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:08:16.209 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:08:16.210 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:08:16.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:08:16.211 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:08:16.211 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:08:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:08:16.212 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:08:16.213 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:08:16.213 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:08:16.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:08:16.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T05:08:16.214 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-17T05:08:16.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:08:16.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:08:16.224 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:08:16.224 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1039454 2026-02-17T05:08:16.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:08:16.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:08:16.227 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-unexpected-clone 0 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T05:08:16.228 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T05:08:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T05:08:16.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T05:08:16.229 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T05:08:16.229 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T05:08:16.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T05:08:16.230 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T05:08:16.230 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T05:08:16.231 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:08:16.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T05:08:16.232 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T05:08:16.232 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:08:16.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:08:16.233 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T05:08:16.234 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-17T05:08:16.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T05:08:16.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T05:08:16.235 INFO:tasks.workunit.client.0.trial090.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1039454 2026-02-17T05:08:16.235 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1039454 2026-02-17T05:08:16.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T05:08:16.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T05:08:16.237 INFO:tasks.workunit.client.0.trial090.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T05:08:16.237 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T05:08:16.237 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T05:08:16.301 INFO:tasks.workunit:Stopping ['scrub'] on client.0... 2026-02-17T05:08:16.301 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T05:08:16.669 DEBUG:teuthology.parallel:result is None 2026-02-17T05:08:16.670 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T05:08:16.694 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T05:08:16.695 DEBUG:teuthology.orchestra.run.trial090:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T05:08:16.750 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T05:08:16.750 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T05:08:16.762 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T05:08:16.762 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T05:08:16.907 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T05:08:16.919 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T05:08:16.920 DEBUG:teuthology.orchestra.run.trial090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:08:16.936 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:08:16.966 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:08:16.966 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-17T05:08:16.967 INFO:teuthology.orchestra.run.trial090.stdout:^- 167-248-62-201.oa02.lnk0> 2 8 377 121 +322us[ +322us] +/- 42ms 2026-02-17T05:08:16.967 INFO:teuthology.orchestra.run.trial090.stdout:^+ 172-233-155-39.ip.linode> 4 9 377 133 -1333us[-1333us] +/- 65ms 2026-02-17T05:08:16.967 INFO:teuthology.orchestra.run.trial090.stdout:^+ ntp6.kernfusion.at 2 6 377 2 +1518us[+1518us] +/- 47ms 2026-02-17T05:08:16.967 INFO:teuthology.orchestra.run.trial090.stdout:^* vps5.drown.org 2 9 377 134 +221us[ +310us] +/- 22ms 2026-02-17T05:08:16.968 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T05:08:16.979 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T05:08:16.980 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T05:08:16.995 DEBUG:teuthology.orchestra.run.trial090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T05:08:17.060 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T05:08:17.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:08:17.087 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T05:08:17.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T05:08:17.116 INFO:teuthology.task.internal:Duration was 3974.861141 seconds 2026-02-17T05:08:17.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T05:08:17.128 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T05:08:17.128 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T05:08:17.164 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:08:17.410 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T05:08:17.410 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial090.front.sepia.ceph.com 2026-02-17T05:08:17.410 DEBUG:teuthology.orchestra.run.trial090:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T05:08:17.468 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T05:08:17.468 DEBUG:teuthology.orchestra.run.trial090:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:08:17.568 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T05:08:17.568 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:08:17.591 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:08:17.591 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:08:17.591 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:08:17.591 INFO:teuthology.orchestra.run.trial090.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T05:08:17.592 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T05:08:17.602 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T05:08:17.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T05:08:17.621 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T05:08:17.622 DEBUG:teuthology.orchestra.run.trial090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T05:08:17.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T05:08:17.680 DEBUG:teuthology.orchestra.run.trial090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:08:17.730 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = core 2026-02-17T05:08:17.742 DEBUG:teuthology.orchestra.run.trial090:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:08:17.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:08:17.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T05:08:17.809 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T05:08:17.810 DEBUG:teuthology.misc:Transferring archived files from trial090:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50751/remote/trial090 2026-02-17T05:08:17.811 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T05:08:17.868 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T05:08:17.868 DEBUG:teuthology.orchestra.run.trial090:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T05:08:17.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T05:08:17.940 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T05:08:17.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T05:08:17.957 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T05:08:17.957 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T05:08:17.977 INFO:teuthology.orchestra.run.trial090.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 05:08 /home/ubuntu/cephtest 2026-02-17T05:08:17.978 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T05:08:17.999 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T05:08:18.038 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} duration: 3974.8611409664154 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T05:08:18.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:08:18.159 INFO:teuthology.run:pass